Datasets
Training datasets with quantum-safe provenance
Open-AoE — Egocentric Hand Manipulation Dataset Release Roadmap Tier Duration Status nano ~3 h ✅ Released tiny ~100 h ✅ Released full 2000 h 🚧 Uploading (batch4–6 ≈694h ready; see notes) Release notes 2026-07-30: Removed samples flagged in PR #1 for camera-intrinsics vs. video-resolution mismatches. 2026-07-31: Uploaded ~323h of data. 2026-08-12: Uploaded ~694h of data(ms only, waiting for HF storage expansion). Additional… See the full description on the dataset page: https://huggingface.co/datasets/inclusionAI/OpenAoE-2000h.
Boasting over 10,000 hours of cumulative data and 1 million+ clips, it ranks as the largest open-source embodied intelligence dataset in the industry. Compared with other datasets, it has the following advantages: Ample Data Volume & Strong Generalization Each skill is supported by sufficient data, collected from over 3,000 households and nearly 10,000 distinct fine-grained targets. It avoids simple repetitions and ensures robust generalization. Authentic Scenarios & Focused… See the full description on the dataset page: https://huggingface.co/datasets/ad1t7a/10Kh-RealOmin-OpenData.
TexVerse: A Universe of 3D Objects with High-Resolution Textures Yibo Zhang1,2, Li Zhang1,3, Rui Ma2 *, Nan Cao1,4 1Shanghai Innovation Institute 2Jilin University 3Fudan University 4Tongji University * Corresponding Author TexVerse is a large-scale 3D dataset featuring high-resolution textures. Its key characteristics include: Scale & Source: TexVerse dataset has 858,669 unique 3D models curated from… See the full description on the dataset page: https://huggingface.co/datasets/YiboZhang2001/TexVerse.
Arena Leaderboard Dataset Historical snapshots of the Arena leaderboard. Usage from datasets import load_dataset # Load all historical text style control data ds = load_dataset("lmarena-ai/leaderboard-dataset", "text_style_control", split="full") # Load the current text style control leaderboard ds = load_dataset("lmarena-ai/leaderboard-dataset", "text_style_control", split="latest") # Filter to overall category ds =… See the full description on the dataset page: https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset.
Further cleaning done. Please look through the dataset and ensure that I didn't miss anything. Update: Confirmed working method for training the model: https://huggingface.co/AlekseyKorshuk/vicuna-7b/discussions/4#64346c08ef6d5abefe42c12c Two choices: Removes instances of "I'm sorry, but": https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/blob/main/ShareGPT_V3_unfiltered_cleaned_split_no_imsorry.json Has instances of "I'm sorry, but":… See the full description on the dataset page: https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered.
Forecast News Deduplicated daily news corpus used by forecast-sim and future-sim. Snapshot 31,696,086 articles 3,401 daily partitions Coverage: 2016-08-26 through 2026-06-30 Snapshot published: 2026-07-13 Stored data size: approximately 168.8 GB The Parquet files are the canonical complete representation. The repository also contains daily JSONL files where available and compact headline JSON files used by article-browsing workflows. Layout Files… See the full description on the dataset page: https://huggingface.co/datasets/shash42/forecast-news.
MulSeT: A Benchmark for Multi-view Spatial Understanding Tasks Paper: Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture Code: https://github.com/WanyueZhang-ai/spatial-understanding A high-level overview of the MulSeT benchmark. The dataset challenges models to integrate information from two distinct viewpoints of a 3D scene to answer spatial reasoning questions. 📝 Dataset Summary MulSeT is a comprehensive benchmark… See the full description on the dataset page: https://huggingface.co/datasets/WanyueZhang/MulSeT.
ERA5 Based on Hersbach et al. 2020 with data exposed through Copernicus C3S API 26 variable subset of data as described in Table 3 of Bonev et al. 2023. Each file contains all 26 variables sampled every 6 hours (starting with 00:00:00) for an entire month in a given year.
MADLAD-400 Dataset and Introduction MADLAD-400 (Multilingual Audited Dataset: Low-resource And Document-level) is a document-level multilingual dataset based on Common Crawl, covering 419 languages in total. This uses all snapshots of CommonCrawl available as of August 1, 2022. The primary advantage of this dataset over similar datasets is that it is more multilingual (419 languages), it is audited and more highly filtered, and it is document-level. The main disadvantage… See the full description on the dataset page: https://huggingface.co/datasets/allenai/MADLAD-400.
RW-RL Dataset: Real-World Reinforcement Learning for Robots Human-intervention companion dataset: RW-RL-HIL-Dataset (BodenAI) is a separately hosted release of real-world policy rollouts and human corrections. Download it from its own dataset page. RW-RL Dataset is a real-world robot interaction dataset released by Boden Intelligence, Junpu Innovation Center, and the MINT Lab at Shanghai Jiao Tong University. It is designed for a bottleneck that… See the full description on the dataset page: https://huggingface.co/datasets/MINT-SJTU/RW-RL-Dataset.
Complete Wikipedia dump across all languages. Standard pretraining data source. Structured articles with metadata.
Dataset Card for "jat-dataset-tokenized" More Information needed
WorldBench WorldBench is a new benchmark designed to evaluate the physical understanding and prediction of modern world models and vision-language models. There are two components: Video based: This is a benchmark designed to evaluate video-to-video world foundation models such as Cosmos. It consists of videos 132 frames long of 425 simulated scenes with RGB, Normals, Depth, Flow, and Segmentations. Text based: This is a subset which adds text-based questions to 181 videos… See the full description on the dataset page: https://huggingface.co/datasets/worldbenchmark/IntuitivePhysics.
stock_dataset 中文 | English 中文 本数据集以未压缩的原始文件保存两类股票数据,保留原有目录结构和文件内容,可以直接按目录下载使用。 目录 内容 文件数 原始字节数 qlib/cn_data/ A 股原生 Qlib provider,含 CSI300、CSI500、CSI1000 历史股票池定义 61,008 707,180,289 qlib/us_data/ 美股原生 Qlib provider,含 SP500 股票池及基准 3,744 59,236,967 qlib/hk_data/ 港股原生 Qlib provider,含 HSI90 股票池及 HKHSI 基准 1,604 15,714,170 A股分钟/2000-2024/ 2000—2024 年 A 股 1、5、15、30、60 分钟 CSV 行情 309,495 216,090,239,948 合计 375,851 216,872,371,374 数据文件合计约 201.98… See the full description on the dataset page: https://huggingface.co/datasets/OpenFinMind/stock_dataset.
Gen-HumanEgo 1,800+ hours of egocentric human demonstrations with synchronized, structured supervision for embodied AI and robot learning. Gen-HumanEgo contains real-world first-person demonstrations collected across diverse tasks, people, environments, and ways of performing activities using a unified six-camera DAS-Ego setup. GenRobot's Data Foundation Model (DFM) processes the recordings to provide complementary training signals for human motion, spatial understanding… See the full description on the dataset page: https://huggingface.co/datasets/genrobot2025/Gen-HumanEgo.
[CVPR 2025] M3-VOS: Multi-Phase, Multi-Transition, and Multi-Scenery Video Object Segmentation If you like our project, please give us a star ⭐ on GitHub for the latest update. 💡 Description Venue: CVPR2025 Repository: 🛠️Tool, 🏠Page Paper: arxiv.org/html/2412.13803v2 Point of Contact: Jiaxin Li , Zixuan Chen 📁 Structure This dataset contains annotated videos and images for object segmentation tasks with phase transition information. The directory… See the full description on the dataset page: https://huggingface.co/datasets/zdbfv/M3_VOS.
SynData 中文说明 Demo If the video cannot be displayed in your environment, open it directly: assets/syndata-demo.mp4 1. Overview SynData is a next-generation large-scale real-world multimodal dataset newly released by PsiBot. It comprehensively covers key dimensions including vision, language, and action, and provides highly realistic, high-density, and highly usable human data as a solid foundation for embodied intelligence training. Powered by… See the full description on the dataset page: https://huggingface.co/datasets/PsiBotAI/SynData.
WorldCode Exported JSON Field Specification The following specification is based on the actual outputs produced by the export script, as well as the example file worldcode_HS-2-1420125020208_2025-10-21-14-50-09_3_s0_vlta_reorg_sample_1-2.json. Top-level Fields Field Description worldcode_name Name of the current sample, typically also the filename of the exported JSON. dataset_path Absolute path to the original worldcode directory. task_description… See the full description on the dataset page: https://huggingface.co/datasets/tars-robotics/WIYH.
3DCodeVerse — Towards Building the Universe via Code 3DCodeVerse aims to gather any code that creates, renders, or governs 3D — every dialect, one corpus. Text / Image / Video ↔ 3D Code ↔ 3D Assets Every entry is a self-contained, runnable project: the code, its rendered outputs, a metadata card, and text captions. Domains in scope: Object Modeling · Scene & World Modeling · Rendering · Materials & Shaders · Physics & Simulation · Animation & Articulation. 📄 Paper:… See the full description on the dataset page: https://huggingface.co/datasets/ilabai/3dcodeverse.
Dataset Card for "hellaswag" Dataset Summary HellaSwag: Can a Machine Really Finish Your Sentence? is a new dataset for commonsense NLI. A paper was published at ACL2019. Supported Tasks and Leaderboards More Information Needed Languages More Information Needed Dataset Structure Data Instances default Size of downloaded dataset files: 71.49 MB Size of the generated dataset: 65.32 MB Total amount of disk used: 136.81… See the full description on the dataset page: https://huggingface.co/datasets/Rowan/hellaswag.