WMT T2T
Dataset Card for "wmt_t2t" Dataset Summary The WMT EnDe Translate dataset used by the Tensor2Tensor library. Translation dataset based on the data from statmt.org. Versions exist for different years using a combination of data sources. The base wmt allows you to create a custom dataset by choosing your own data/language pair. This can be done as follows: from datasets import inspect_dataset, load_dataset_builder inspect_dataset("wmt_t2t", "path/to/scripts") builder =… See the full description on the dataset page: https://huggingface.co/datasets/wmt/wmt_t2t.
- Type: Dataset
- Imported from Hugging Face
- Popularity: 1 likes on Hugging Face
- License: unknown
- Source: https://huggingface.co/datasets/wmt/wmt_t2t
- Tags: annotations_creators:no-annotation, language_creators:found, multilinguality:translation, source_datasets:extended|europarl_biling, source_datasets:extended|news_commentary, source_datasets:extended|opus_paracrawl, source_datasets:extended|un_multi
- Updated: 2026-10-01
More datasets
- prompts.chat — a.k.a. Awesome ChatGPT Prompts This is a Dataset Repository mirror of prompts.chat — a social platform for AI prompts. 📢 Notice This Huggi…
- FineWeb — 🍷 FineWeb 15 trillion tokens of the finest data the 🌐 web has to offer What is it? The 🍷 FineWeb dataset consists of more than 18.5T tok…
- hh-rlhf — Dataset Card for HH-RLHF Dataset Summary This repository provides access to two different kinds of data: Human preference data about helpfu…
- Grade School Math 8K — Dataset Card for GSM8K Dataset Summary GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school m…
- wikipedia — Dataset Card for Wikimedia Wikipedia Dataset Summary Wikipedia dataset containing cleaned articles of all languages. The dataset is built f…
- OpenAssistant Conversations — OpenAssistant Conversations Dataset (OASST1) Dataset Summary In an effort to democratize research on large-scale alignment, we release Open…
- Alpaca — Dataset Card for Alpaca Dataset Summary Alpaca is a dataset of 52,000 instructions and demonstrations generated by OpenAI's text-davinci-00…
- databricks-dolly-15k — Summary databricks-dolly-15k is an open source dataset of instruction-following records generated by thousands of Databricks employees in s…