Datasets

Training datasets with quantum-safe provenance

ecastillot/UTDQuake HF Unverified

UTDQuake: University of Texas at Dallas Earthquake Dataset A global earthquake dataset constructed from high-quality source and receiver metadata, including associated seismic phase picks across diverse station geometries. Installation (utdquake) pip install utdquake Documentation Full documentation for UTDQuake is available here: You will see: QuickStart guide to get you up and running Detailed API reference Tutorials… See the full description on the dataset page: https://huggingface.co/datasets/ecastillot/UTDQuake.

Size_categories:10M<n<100MFormat:parquetModality:tabularModality:textLibrary:datasetsLibrary:pandas
fixie-ai/common_voice_17_0 HF Unverified

Size_categories:10M<n<100MFormat:parquetModality:audioModality:textLibrary:datasetsLibrary:dask
R0mAI/opencodeinstruct-curated HF Unverified

Size_categories:1M<n<10MFormat:parquetModality:textLibrary:datasetsLibrary:pandasLibrary:polars
japanese-asr/whisper_transcriptions.reazon_speech_all HF Unverified

Size_categories:10M<n<100MFormat:parquetModality:audioModality:textLibrary:datasetsLibrary:dask
dalle-mini/wit HF Unverified

Size_categories:1M<n<10MFormat:parquetModality:imageModality:tabularModality:textLibrary:datasets
hotpotqa/hotpot_qa HF Unverified

Dataset Card for "hotpot_qa" Dataset Summary HotpotQA is a new dataset with 113k Wikipedia-based question-answer pairs with four key features: (1) the questions require finding and reasoning over multiple supporting documents to answer; (2) the questions are diverse and not constrained to any pre-existing knowledge bases or knowledge schemas; (3) we provide sentence-level supporting facts required for reasoning, allowingQA systems to reason… See the full description on the dataset page: https://huggingface.co/datasets/hotpotqa/hotpot_qa.

Task_categories:question-AnsweringAnnotations_creators:crowdsourcedLanguage_creators:foundMultilinguality:monolingualSource_datasets:originalLanguage:en
Idavidrein/gpqa HF Unverified

Dataset Card for GPQA GPQA is a multiple-choice, Q&A dataset of very hard questions written and validated by experts in biology, physics, and chemistry. When attempting questions out of their own domain (e.g., a physicist answers a chemistry question), these experts get only 34% accuracy, despite spending >30m with full access to Google. We request that you do not reveal examples from this dataset in plain text or images online, to reduce the risk of leakage into foundation model… See the full description on the dataset page: https://huggingface.co/datasets/Idavidrein/gpqa.

Benchmark:officialBenchmark:eval-YamlTask_categories:question-AnsweringTask_categories:text-GenerationLanguage:enSize_categories:1K<n<10K
mlfoundations/MINT-1T-PDF-CC-2023-50 HF PQC Verified

🍃 MINT-1T:Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens 🍃 MINT-1T is an open-source Multimodal INTerleaved dataset with 1 trillion text tokens and 3.4 billion images, a 10x scale-up from existing open-source datasets. Additionally, we include previously untapped sources such as PDFs and ArXiv papers. 🍃 MINT-1T is designed to facilitate research in multimodal pretraining. 🍃 MINT-1T is created by a team from the University of Washington in… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations/MINT-1T-PDF-CC-2023-50.

Task_categories:image-To-TextTask_categories:text-GenerationLanguage:enSize_categories:1M<n<10MFormat:webdatasetModality:image
espnet/yodas-granary HF Unverified

Dataset Card for YODAS-Granary Repository: NeMo-speech-data-processor: Granary Paper: Granary: Speech Recognition and Translation Dataset in 25 European Languages Shared by: ESPnet Dataset Description YODAS-Granary is a curated subset of the larger nvidia/Granary dataset, focusing on high-quality pseudo-labeled speech data for Automatic Speech Recognition (ASR) and Automatic Speech Translation (AST) across 23 European languages. Overview… See the full description on the dataset page: https://huggingface.co/datasets/espnet/yodas-granary.

Task_categories:automatic-Speech-RecognitionTask_categories:translationLanguage:bgLanguage:csLanguage:daLanguage:de
Dangindev/viet-cultural-vqa HF Unverified

Vietnamese Cultural VQA Dataset is a comprehensive multimodal dataset focusing on Vietnamese cultural heritage. It contains 28,505 images across 12 cultural categories with 119,012 question-answer pairs in Vietnamese and English. The dataset covers diverse aspects of Vietnamese culture including architecture, cuisine, traditional clothing, landscapes, festivals, folk culture, traditional games, sports, handicrafts, musical instruments, daily life, and transportation.

Task_categories:visual-Question-AnsweringTask_categories:image-ClassificationTask_categories:object-DetectionTask_ids:visual-Question-AnsweringLanguage:viLanguage:en
Vchitect/Vchitect_T2V_DataVerse HF Unverified

Vchitect-T2V-Dataverse Vchitect Team1  1Shanghai Artificial Intelligence Laboratory  Paper | Project Page | Data Overview The Vchitect-T2V-Dataverse is the core dataset used to train our text-to-video diffusion model, Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models. It comprises 14 million high-quality videos collected from the Internet, each paired with detailed textual… See the full description on the dataset page: https://huggingface.co/datasets/Vchitect/Vchitect_T2V_DataVerse.

Task_categories:text-To-VideoSize_categories:1M<n<10MFormat:webdatasetModality:textLibrary:datasetsLibrary:webdataset
mvp-lab/LLaVA-OneVision-1.5-Instruct-Data HF Unverified

LLaVA-OneVision-1.5 Instruction Data Paper | Code 📌 Introduction This dataset, LLaVA-OneVision-1.5-Instruct, was collected and integrated during the development of LLaVA-OneVision-1.5. LLaVA-OneVision-1.5 is a novel family of Large Multimodal Models (LMMs) that achieve state-of-the-art performance with significantly reduced computational and financial costs. This meticulously curated 22M instruction dataset (LLaVA-OneVision-1.5-Instruct) is part of a comprehensive and… See the full description on the dataset page: https://huggingface.co/datasets/mvp-lab/LLaVA-OneVision-1.5-Instruct-Data.

Task_categories:image-Text-To-TextLanguage:enSize_categories:10M<n<100MModality:imageModality:textMultimodal
HoneyDataV2/Honey-Data-V2 HF Unverified

Honey-Data-V2 [🏠 Homepage] [📖 arXiv (conference version)] [🤗 Bee models & datasets] [🍯 Honey-Data-15M] [💻 Code] Honey-Data-V2 is the corpus of the journal version of Bee, Bee: A High-Quality Corpus and Full-Stack Suite for End-to-End Training of Fully Open MLLMs, accepted to Computational Visual Media. The conference version (ICLR 2026) released Honey-Data-15M and the Bee-8B models trained on it. The journal version scales the corpus up by reapplying the same curation… See the full description on the dataset page: https://huggingface.co/datasets/HoneyDataV2/Honey-Data-V2.

Task_categories:visual-Question-AnsweringTask_categories:image-Text-To-TextLanguage:enLanguage:zhSize_categories:10M<n<100MModality:image
facebook/wiki_dpr HF Unverified

This is the wikipedia split used to evaluate the Dense Passage Retrieval (DPR) model. It contains 21M passages from wikipedia along with their DPR embeddings. The wikipedia articles were split into multiple, disjoint text blocks of 100 words as passages.

Task_categories:fill-MaskTask_categories:text-GenerationTask_ids:language-ModelingTask_ids:masked-Language-ModelingAnnotations_creators:no-AnnotationLanguage_creators:crowdsourced
OpenSQZ/AutoMathText-V2 HF Unverified

🚀 AutoMathText-V2: A 2.46 Trillion Token AI-Curated STEM Pretraining Dataset &nbsp; 🎉 AutoMathText-v2 has surpassed 1.5 million downloads! We'd love to know how you're using it. Please take 1 minute to fill out our use case survey. Your feedback will directly shape the future roadmap of this dataset.👉 Share your use case here 📊 AutoMathText-V2 consists of 2.46 trillion tokens of high-quality, deduplicated text spanning web content, mathematics, code, reasoning, and… See the full description on the dataset page: https://huggingface.co/datasets/OpenSQZ/AutoMathText-V2.

Task_categories:text-GenerationTask_categories:question-AnsweringLanguage:enLanguage:zhSize_categories:100M<n<1BModality:tabular
Salesforce/lotsa_data HF Unverified

LOTSA Data The Large-scale Open Time Series Archive (LOTSA) is a collection of open time series datasets for time series forecasting. It was collected for the purpose of pre-training Large Time Series Models. See the paper and codebase for more information. Citation If you're using LOTSA data in your research or applications, please cite it using this BibTeX: BibTeX: @article{woo2024unified, title={Unified Training of Universal Time Series Forecasting Transformers}… See the full description on the dataset page: https://huggingface.co/datasets/Salesforce/lotsa_data.

Size_categories:1M<n<10MFormat:arrowModality:textModality:timeseriesLibrary:datasetsLibrary:mlcroissant
yaak-ai/L2D HF Unverified

TL;DR of L2D, the world's largest self-driving dataset! Read more about L2D on the official Huggingface blog: LeRobot goes to driving school 90+ TeraBytes of multimodal data (5000+ hours of driving) from 30 cities in Germany 6x surrounding HD cameras and complete vehicle state: Speed/Heading/GPS/IMU Continuous: Gas/Brake/Steering and discrete actions: Gear/Turn Signals Environment state: Lane count, Road type (highway|residential), Road surface (asphalt, cobbled, sett), Max speed limit.… See the full description on the dataset page: https://huggingface.co/datasets/yaak-ai/L2D.

Task_categories:roboticsSize_categories:10M<n<100MFormat:parquetModality:tabularModality:textModality:timeseries
AlgorithmicResearchGroup/arxiv_s2orc_parsed HF Unverified

Dataset Card for "ArtifactAI/arxiv_s2orc_parsed" Dataset Description https://huggingface.co/datasets/AlgorithmicResearchGroup/arxiv_s2orc_parsed Dataset Summary AlgorithmicResearchGroup/arxiv_s2orc_parsed is a subset of the AllenAI S2ORC dataset, a general-purpose corpus for NLP and text mining research over scientific papers, The dataset is filtered strictly for ArXiv papers, including the full text for each paper. Github links have been extracted from each… See the full description on the dataset page: https://huggingface.co/datasets/AlgorithmicResearchGroup/arxiv_s2orc_parsed.

Task_categories:text-GenerationTask_categories:zero-Shot-ClassificationLanguage:enSize_categories:1M<n<10MFormat:parquetModality:text
CERN/ColliderML-Release-1 HF Unverified

ColliderML: Dataset Release 1 Dataset Description This dataset contains simulated high-energy physics collision events generated using the Open Data Detector (ODD) geometry within the Key4hep and ACTS (A Common Tracking Software) frameworks, representing a generic collider detector similar to those at the HL-LHC. Dataset Summary Collision Energy: 14 TeV (proton-proton) Detector: Open Data Detector (ODD) Simulation: DD4hep + Geant4 + ACTS Format: Apache Parquet… See the full description on the dataset page: https://huggingface.co/datasets/CERN/ColliderML-Release-1.

Task_categories:otherSize_categories:10M<n<100MFormat:parquetModality:timeseriesLibrary:datasetsLibrary:dask
UCSC-VLAA/GPT-Image-Edit-1.5M HF Unverified

GPT-Image-Edit-1.5M A Million-Scale, GPT-Generated Image Dataset 📃Arxiv | 🌐 Project Page | 💻Github GPT-Image-Edit-1.5M is a comprehensive image editing dataset that is built upon HQ-Edit, UltraEdit, OmniEdit and Complex-Edit, with all output images regenerated with GPT-Image-1. 📣 News [2025.08.20] 🚀 We provide a script for multi-process downloading. See Multi-process Download. [2025.07.27] 🤗 We release GPT-Image-Edit, a state-of-the-art image editing model with… See the full description on the dataset page: https://huggingface.co/datasets/UCSC-VLAA/GPT-Image-Edit-1.5M.

Task_categories:image-To-ImageLanguage:enSize_categories:1M<n<10MFormat:webdatasetModality:imageModality:text
Showing 20 of 341 datasets (page 11 of 18)