AutoMathText-2.5
AutoMathText-2.5 π AutoMathText-2.5: A Foundational High-Quality STEM Training Dataset π AutoMathText-2.5 consists of over 2 trillion tokens of high-quality, deduplicated text spanning web content, mathematics, code, reasoning, and bilingual data. This dataset was meticulously curated using a three-tier deduplication pipeline and AI-powered quality assessment to provide superior training data for large language models. Our dataset combines 50+β¦ See the full description on the dataset page: https://huggingface.co/datasets/math-ai/AutoMathText-2.5.
- Type: Dataset
- Imported from Hugging Face
- Popularity: 2 likes on Hugging Face
- Source: https://huggingface.co/datasets/math-ai/AutoMathText-2.5
- Tags: LLM, pretraining, finetuning, midtraining, reasoning, STEM, math
- Updated: 2026-10-01
More datasets
- prompts.chat β a.k.a. Awesome ChatGPT Prompts This is a Dataset Repository mirror of prompts.chat β a social platform for AI prompts. π’ Notice This Huggiβ¦
- FineWeb β π· FineWeb 15 trillion tokens of the finest data the π web has to offer What is it? The π· FineWeb dataset consists of more than 18.5T tokβ¦
- hh-rlhf β Dataset Card for HH-RLHF Dataset Summary This repository provides access to two different kinds of data: Human preference data about helpfuβ¦
- Grade School Math 8K β Dataset Card for GSM8K Dataset Summary GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school mβ¦
- wikipedia β Dataset Card for Wikimedia Wikipedia Dataset Summary Wikipedia dataset containing cleaned articles of all languages. The dataset is built fβ¦
- OpenAssistant Conversations β OpenAssistant Conversations Dataset (OASST1) Dataset Summary In an effort to democratize research on large-scale alignment, we release Openβ¦
- Alpaca β Dataset Card for Alpaca Dataset Summary Alpaca is a dataset of 52,000 instructions and demonstrations generated by OpenAI's text-davinci-00β¦
- databricks-dolly-15k β Summary databricks-dolly-15k is an open source dataset of instruction-following records generated by thousands of Databricks employees in sβ¦