Ultra-FineWeb
Ultra-FineWeb π Technical Report | π¦ UltraData Collection | π UltraData | π€ MiniCPM4 Series | π€ MiniCPM5 Series English | δΈζ π Introduction Ultra-FineWeb is a large-scale, high-quality, and efficiently-filtered dataset. We use the proposed efficient verification-based high-quality filtering pipeline to the FineWeb and Chinese FineWeb datasets (source data from Chinese FineWeb-edu-v2, which includes IndustryCorpus2, MiChao, WuDao, SkyPileβ¦ See the full description on the dataset page: https://huggingface.co/datasets/openbmb/Ultra-FineWeb.
- Type: Dataset
- Imported from Hugging Face
- Popularity: 449 likes on Hugging Face
- License: apache-2.0
- Source: https://huggingface.co/datasets/openbmb/Ultra-FineWeb
- Tags: llm, pretraining, web-corpus, data-filtering, high-quality
- Updated: 2026-10-01
More datasets
- prompts.chat β a.k.a. Awesome ChatGPT Prompts This is a Dataset Repository mirror of prompts.chat β a social platform for AI prompts. π’ Notice This Huggiβ¦
- FineWeb β π· FineWeb 15 trillion tokens of the finest data the π web has to offer What is it? The π· FineWeb dataset consists of more than 18.5T tokβ¦
- hh-rlhf β Dataset Card for HH-RLHF Dataset Summary This repository provides access to two different kinds of data: Human preference data about helpfuβ¦
- Grade School Math 8K β Dataset Card for GSM8K Dataset Summary GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school mβ¦
- wikipedia β Dataset Card for Wikimedia Wikipedia Dataset Summary Wikipedia dataset containing cleaned articles of all languages. The dataset is built fβ¦
- OpenAssistant Conversations β OpenAssistant Conversations Dataset (OASST1) Dataset Summary In an effort to democratize research on large-scale alignment, we release Openβ¦
- Alpaca β Dataset Card for Alpaca Dataset Summary Alpaca is a dataset of 52,000 instructions and demonstrations generated by OpenAI's text-davinci-00β¦
- FineWeb-Edu β π FineWeb-Edu 1.3 trillion tokens of the finest educational data the π web has to offer Paper: https://arxiv.org/abs/2406.17557 What is iβ¦