AnnoLLM - Making Large Language Models to Be Better Crowdsourced Annotators
FinerWeb-10BT Refining Web Data with LLM-Based Line-Level Filtering
The Pile An 800GB Dataset of Diverse Text for Language Modeling
CCNet Extracting High Quality Monolingual Datasets from Web Crawl Data
OPENCSG CHINESE CORPUS A SERIES OF HIGHQUALITY CHINESE DATASETS FOR LLM TRAINING
The FineWeb Datasets Decanting the Web for the Finest Text Data at Scale