Datasets
Unity hosts a variety of commonly used public datasets for easy access for Unity workloads. You can find all of Unity’s hosted datasets in the /datasets directory from any Unity node.
You can also view
/datasets in the Open OnDemand file browser by navigating to the “/datasets” entry in the “Files” dropdown.To get information about each dataset, see the menu below.
AI and ML
Aleph-Alpha
infoOur research has produced state-of-the-art multi-modal models (MAGMA), explainability techniques for transformer-based models (AtMan), and a comprehensive evaluation framework for large-scale model assessment
folder_open
/datasets/ai/aleph-alphaAlibaba-NLP
infoGTE-Qwen2-7B-instruct is the latest model in the gte (General Text Embedding) model family that ranks No.1 in both English and Chinese evaluations on the Massive Text Embedding Benchmark MTEB benchmark (as of June 16, 2024)
folder_open
/datasets/ai/alibabaAllen AI
AlpacaFarm
infoAlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback
folder_open
/datasets/ai/alpaca-farmAmass
infoAMASS is a large database of human motion unifying different optical marker-based motion capture datasets by representing them within a common framework and parameterization. AMASS is readily useful for animation, visualization, and generating training data for deep learning
folder_open
/datasets/ai/amassAudioset
infoAudioSet is an ontology and human-labeled dataset for audio event detection. It consists of 2,084,320 ten-second sound clips from YouTube videos labeled with a hierarchical ontology of 632 audio event classes, including human and animal sounds, musical instruments, and everyday environmental noises.
folder_open
/datasets/ai/audiosetBAAI
infoEmu3-Gen is a unified multimodal generative model designed for high-quality image generation and visual understanding within a single autoregressive framework. Built on a discrete visual tokenizer, Emu3-Gen supports text-to-image generation, image editing, and multimodal reasoning by modeling images and text as a shared sequence, enabling strong generative fidelity and flexible multimodal interactions
folder_open
/datasets/ai/baaiBigcode
infoBigCode is an open scientific collaboration working on responsible training of large language models for coding applications
folder_open
/datasets/ai/bigcodeBiomed Clip
infoBiomedCLIP is a biomedical vision-language foundation model that is pretrained on PMC-15M, a dataset of 15 million figure-caption pairs extracted from biomedical research articles in PubMed Central, using contrastive learning
folder_open
/datasets/ai/biomed-clipBlip 2
infoBLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
folder_open
/datasets/ai/blipBloom
infoBLOOM is an autoregressive Large Language Model (LLM), trained to continue text from a prompt on vast amounts of text data using industrial-scale computational resources.
folder_open
/datasets/ai/bloomByteDance
COCO
infoCOCO is a large-scale object detection, segmentation, and captioning dataset
folder_open
/datasets/ai/cocoCode Llama
DeepAccident
infoDeepAccident is the first V2X (vehicle-to-everything simulation) autonomous driving dataset that contains diverse collision accidents that commonly occur in real-world driving scenarios
folder_open
/datasets/ai/deep-accidentDeepSeek
infoDeepSeek trained via large-scale reinforcement learning (RL) without supervised fine-tuning (SFT) as a preliminary step, demonstrates remarkable reasoning capabilities. Through RL, DeepSeek-R1-Zero naturally emerges with numerous powerful and intriguing reasoning behaviors
folder_open
/datasets/ai/deepseekDeSTA
infoOne of the latest Large Audio Language Model
folder_open
/datasets/ai/destaDiffa
infoNew Audio LLM that uses diffusion language model
folder_open
/datasets/ai/diffaDINO v2
infoDINOv2 is a self-supervised method to learn visual representation
folder_open
/datasets/ai/dinov2epic-kitchens
infoEpic-Kitchens-100 is a large-scale dataset in first-person (egocentric) vision; multi-faceted, audio-visual, non-scripted recordings in kitchen environments.
folder_open
/datasets/ai/epic-kitchensFalcon
infoFalcon is a family of large language models, available in 7B, 40B, and 180B parameters, as pretrained and instruction tuned variants
folder_open
/datasets/ai/falconFlorence
infoFlorence-2 is an advanced vision foundation model that uses a prompt-based approach to handle a wide range of vision and vision-language tasks.
folder_open
/datasets/ai/florenceFLUX.1 Kontext
Fomo
infoFOMO-60K is a large-scale dataset of brain MRI scans, including both clinical and research-grade scans. The dataset includes a wide range of sequences, including T1, MPRAGE, T2, T2*, FLAIR, SWI, T1c, PD, DWI, ADC, and more.
folder_open
/datasets/ai/fomoGemma
infoGemma is a family of lightweight, state-of-the art open models built from the research and technology used to create Gemini models
folder_open
/datasets/ai/gemmaGenmo
infoFOMO-60K is a large-scale dataset of brain MRI scans, including both clinical and research-grade scans. The dataset includes a wide range of sequences, including T1, MPRAGE, T2, T2*, FLAIR, SWI, T1c, PD, DWI, ADC, and more.
folder_open
/datasets/ai/genmoGlm
infoChatGLM. To date, the GLM-4 models are pre-trained on ten trillions of tokens mostly in Chinese and English, along with a small set of corpus from 24 languages, and aligned primarily for Chinese and English usage
folder_open
/datasets/ai/glmGPT
infoa large-scale unsupervised language model which generates coherent paragraphs of text, achieves state-of-the-art performance on many language modeling benchmarks
folder_open
/datasets/ai/gptHiDream-I1
Ibm Granite
infoGranite 3.0, a new set of lightweight, state-of-the-art, open foundation models ranging in scale from 400 million to 8 billion active parameters
folder_open
/datasets/ai/ibm-graniteIdefics2
infoIdefics2 is an open multimodal model that accepts arbitrary sequences of image and text inputs
folder_open
/datasets/ai/idefics2Imagenet 1K
Inaturalist
infoThe iNaturalist 2017 dataset (iNat) contains 675,170 training and validation images from 5,089 natural fine-grained categories
folder_open
/datasets/ai/inaturalistInfly
infoINF-Retriever-v1 is an LLM-based dense retrieval model developed by INF TECH. It is built upon the gte-Qwen2-7B-instruct model and specifically fine-tuned to excel in retrieval tasks, particularly for Chinese and English data
folder_open
/datasets/ai/inflyInternLM
infoInternLM2, an open-source LLM that outperforms its predecessors in comprehensive evaluations across 6 dimensions and 30 benchmarks, long-context modeling, and open-ended subjective evaluations through innovative pre-training and optimization techniques
folder_open
/datasets/ai/internlmInternvl3-8b-hf
infoInternVL3-8B is an open-source multimodal vision-language model optimized for fine-grained visual understanding, multimodal reasoning, and instruction-following. It supports complex tasks including visual question answering, captioning, OCR, and diagram reasoning. Built upon advanced scaling strategies and alignment techniques, InternVL2.5 bridges the gap to proprietary models like GPT-4V through high-quality pretraining and preference optimization.
folder_open
/datasets/ai/internvlIntfloat
infoA novel and simple method for obtaining high-quality text embeddings using only synthetic data and less than 1k training steps
folder_open
/datasets/ai/intfloatKinetics
infoKinetics is a collection of large-scale, high-quality datasets of URL links of up to 650,000 video clips that cover 400/600/700 human action classes, depending on the dataset version.
folder_open
/datasets/ai/kineticsLG
infoLarge Language Models (LLMs) and Large Multimodal Models (LMMs) developed by LG AI Research. EXAONE stands for EXpert AI for EveryONE, a vision that LG is committed to realizing
folder_open
/datasets/ai/lgLinq
infoLinq-Embed-Mistral has been developed by building upon the foundations of the E5-mistral-7b-instruct and Mistral-7B-v0.1 models
folder_open
/datasets/ai/linqLlama2
Llama3
infoLlama 3 is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage
folder_open
/datasets/ai/llama3Llama4
infoLlama 4, developed by Meta, introduces a new auto-regressive Mixture-of-Experts (MoE) architecture
folder_open
/datasets/ai/llama4/Llava_OneVision
LLM-compiler
infoLLM Compiler: Foundation Language Models for Compiler Optimization
folder_open
/datasets/ai/llm-compilerLMSys
infoThe large model systems organization (LMSYS) develops large models and systems that are open accessible and scalable.
folder_open
/datasets/ai/lmsysLumina
infoLumina-Image 2.0: A Unified and Efficient Image Generative Framework
folder_open
/datasets/ai/luminaMims
infoTxAgent, an AI agent that leverages multi-step reasoning and real-time biomedical knowledge retrieval across a toolbox of 211 tools to analyze drug interactions, contraindications, and patient-specific treatment strategies
folder_open
/datasets/ai/mimsMixtral
Monai
infoM3 is a medical visual language model that empowers medical imaging professionals, researchers, and healthcare enterprises by enhancing medical imaging workflows across various modalities.
folder_open
/datasets/ai/monaiMoonshot-ai
infoKimi-Audio is an open-source audio foundation model excelling in audio understanding, generation, and conversation
folder_open
/datasets/ai/moonshotMsmarco
infoThe MS MARCO dataset is a large-scale information retrieval benchmark that uses real-world questions from Bing’s search queries to evaluate the performance of machine learning models in generating answers
folder_open
/datasets/ai/msmarcoNatural-questions
infoNatural Questions corpus, a question answering data set. Questions consist of real anonymized, aggregated queries issued to the Google search engine
folder_open
/datasets/ai/natural-questionsNvidia
Objaverse
infoObjaverse is a Massive Dataset with 800K+ Annotated 3D Objects
folder_open
/datasets/ai/objaverseOpenai-whisper
infoWhisper is a state-of-the-art model for automatic speech recognition (ASR) and speech translation
folder_open
/datasets/ai/whisperPerplexity AI
Phi
infoPhi-3.5-mini is a lightweight, state-of-the-art open model built upon datasets used for Phi-3
folder_open
/datasets/ai/phiPlaygroundai
infoA model that generates highly aesthetic images of resolution 1024x1024, as well as portrait and landscape aspect ratios
folder_open
/datasets/ai/playgroundaiPythia
infoPythia is the first LLM suite designed specifically to enable scientific research on LLMs
folder_open
/datasets/ai/pythiaQwen
infoQwen, the first installment of our large language model series. Qwen is a comprehensive language model series that encompasses distinct models with varying parameter counts
folder_open
/datasets/ai/qwenQwen2
infoQwen2 is the new series of Qwen large language models. For Qwen2, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters, including a Mixture-of-Experts model
folder_open
/datasets/ai/qwen2Qwen3
Rag-sequence-nq
infoRAG models where the parametric memory is a pre-trained seq2seq model and the non-parametric memory is a dense vector index of Wikipedia, accessed with a pre-trained neural retriever
folder_open
/datasets/ai/rag-sequence-nqS1-32B
infos1 is a reasoning model finetuned from Qwen2.5-32B-Instruct on just 1,000 examples. It matches o1-preview & exhibits test-time scaling via budget forcing.
folder_open
/datasets/ai/simplescalingScalabilityai
infoA novel transformer-based architecture for text-to-image generation that uses separate weights for the two modalities and enables a bidirectional flow of information between image and text tokens
folder_open
/datasets/ai/stabilityai/Sft
infoA sentence-transformers model finetuned from sentence-transformers/all-mpnet-base-v2
folder_open
/datasets/ai/sftSlimPajama
infoSlimPajama is a rigorously deduplicated, multi-source dataset, which has been refined and further deduplicated to 627B tokens from the extensive 1.2T token RedPajama dataset contributed by Together
folder_open
/datasets/ai/slim-pajamaT5
infoThe T5 model, short for Text-to-Text Transfer Transformer, is a machine learning model developed by Google
folder_open
/datasets/ai/t5Tulu
infoTülu 3: Pushing Frontiers in Open Language Model Post-Training
folder_open
/datasets/ai/tuluV2X
infoV2X-Sim, a comprehensive simulated multi-agent perception dataset for V2X-aided autonomous driving
folder_open
/datasets/ai/v2xVideo-MAE
infoVideo masked autoencoder (VideoMAE) is a scalable and general self-supervised pre-trainer for building video foundation models
folder_open
/datasets/ai/opengvlabVit
infoThe Vision Transformer (ViT) model uses the transformer architecture to process image patches for tasks like image classification
folder_open
/datasets/ai/vitWildchat
infoWildChat, a corpus of 1 million user-ChatGPT conversations, which consists of over 2.5 million interaction turns
folder_open
/datasets/ai/wildchatBioinformatics
AlphaFold3 Databases
infoProtein structure and sequence databases used with AlphaFold3, an updated version of AlphaFold capable of predicting the structure and interactions of biomolecules.
folder_open
/datasets/bio/alphafold3BFD/MGnify
infoBFD/MGnify is a database built for ColabFold by combining the Big Fantastic Database (BFD) with the MGnify database.
folder_open
/datasets/bio/colabfold/bfd_mgy_colabfoldBig Fantastic Database
infoBig Fantastic Database (BFD) is a protein sequence database. BFD was created by clustering 2.5 billion protein sequences from Uniprot/TrEMBL+Swissprot, Metaclust, Soil Reference Catalog and Marine Eukaryotic Reference Catalog. It consists of over 65M protein families represented as multiple sequence alignments and hidden Markov models. BFD was built using the Uniclust pipeline and is one of the protein sequence databases used with AlphaFold.
folder_open
/datasets/bio/alphafold/bfdcheckm
infoDatabase associated with CheckM, a tool for assessing the quality of genomes recovered from isolates, single cells, or metagenomes.
folder_open
/datasets/bio/checkm/ColabFoldDB
infoColabFoldDB is a protein database built for ColabFold by extending BFD/MGnify with additional metagenomic protein catalogs containing eukaryotic proteins, phage catalogs and an updated version of MetaClust.
folder_open
/datasets/bio/colabfold/colabfold_envdb_202108Databases for ColabFold
info“Databases built in MMseqs2 format to be used with ColabFold. The databases include PDB70 (version 220313), UniRef70 (versions 2103 and 2202), BFD/Mgnfy and the environmental database ColabFoldDB (version 202108)”
folder_open
/datasets/bio/colabfolddfam
infoDfam is a database of Transposable Element DNA sequence alignments, hidden Markov Models (HMMs), consensus sequences, and genome annotations.
folder_open
/datasets/bio/dfam/EggNOG - version 5.0
infoEggNOG is a database of orthology relationships, functional annotation, and gene evolutionary histories. The EggNOG database is used with EggNOG-mapper, a tool for functional annotation of novel sequences.
folder_open
/datasets/bio/eggnog5-data/EggNOG - version 6.0
infoEggNOG is a database of orthology relationships, functional annotation, and gene evolutionary histories. The EggNOG database is used with EggNOG-mapper, a tool for functional annotation of novel sequences.
folder_open
/datasets/bio/eggnog6-data/EVcouplings databases
infoEVcouplings is an open-source application for identifying evolutionary couplings and perform structure prediction of protein and RNA molecules.
folder_open
/datasets/bio/evcouplingsGenomes from NCBI RefSeq database
infoComplete archaeal, bacterial and viral genomes retrieved from the National Center for Biotechnology Information (NCBI) Reference Sequence Database.
folder_open
/datasets/bio/ncbi-refseq-genomesGMAP-GSNAP database (human genome)
infoThe programs GMAP (Genomic Mapping and Aligment Program) and GSNAP (Genomic Short-read Nucleotide Alignment Program) align RNA and DNA sequences from next-generation sequencing data to a genome reference sequence. The GMAP-GSNAP human genomic database available on Unity was built using the human genome assembly GRCh38.p14 (NCBI RefSeq assembly GCF_000001405.40)
folder_open
/datasets/bio/gmap-gsnapGTDB
infoThe Genome Taxonomy Database (GTDB) is a genome-based taxonomy for prokaryotic genomes collected from the NCBI RefSeq and GenBank Assembly databases.
folder_open
/datasets/bio/gtdb/Illumina iGenomes
infoThe Illumina iGenomes dataset is an assortment of genomes and annotation files (downloaded from UCSC, NCBI, or Ensembl) for commonly analyzed organisms.
folder_open
/datasets/bio/igenomesKraken2
infoDatabase for Kraken2, a tool that assigns taxonomic labels to DNA sequences. The database was built with the complete archaeal, bacterial and viral genomes downloaded from the NCBI Reference Sequence Database on July 22nd 2024.
folder_open
/datasets/bio/kraken2MGnify
infoMGnify is a database of non-redundant protein sequences predicted from metagenomic assemblies. MGnify is one of the protein sequence databases that can be used with AlphaFold.
folder_open
/datasets/bio/alphafold/mgnifyNCBI BLAST databases
infoNational Center for Biotechnology Information (NCBI) database presented in the format required for running Basic Local Alignment Search Tool (BLAST) as well as the sequence aligner DIAMOND. It contains the nucleotide database, the non-redundant Reference Sequence protein database for archaeal and bacterial genomes, the Reference Sequence Prokaryotic Representative Genome Database and the Reference Sequence Eukaryotic Representative Genome Database. NCBI’s BLAST databases are downloaded weekly. See the full details for more information.
folder_open
/datasets/bio/ncbi-db/NCBI RefSeq database
infoGenomic, transcript and protein data retrieved from the National Center for Biotechnology Information (NCBI) Reference Sequence Database.
folder_open
/datasets/bio/ncbi-refseq-all/Parameters of AlphaFold
infoAlphaFold is a deep leaning model designed to predict the 3D structure of proteins.
folder_open
/datasets/bio/alphafold/paramsParameters of Evolutionary Scale Modeling (ESM) models
infoESM models are a group of transformer protein language models designed to predict variant effects on protein function, protein sequences from backbone atom coordinates or protein structures from primary sequences.
folder_open
/datasets/bio/esm/PDB70
infoPDB70 is a protein database that contains profile hidden Markov models for a representative set of protein sequences from the Protein Data Bank database filtered with a maximum pairwise sequence identity of 70%. PDB70 can be used with AlphaFold.
folder_open
/datasets/bio/alphafold/pdb70PINDER
infoPINDER or Protein Interaction Dataset and Evaluation Resource, is a dataset and resource for training and evaluation of protein-protein docking algorithms.
folder_open
/datasets/bio/pinderPLINDER
infoPLINDER or Protein Ligand Interactions Dataset and Evaluation Resource, is a comprehensive, annotated, high quality dataset and resource for training and evaluation of protein-ligand docking algorithms.
folder_open
/datasets/bio/plinderProtein Data Bank
infoProtein sequences from the Protein Data Bank in CIF format.
folder_open
/datasets/bio/colabfold/pdbProtein Data Bank database in mmCIF format
infoProtein sequences from the Protein Data Bank in mmCIF format.
folder_open
/datasets/bio/alphafold/pdb_mmcifProtein Data Bank database in SEQRES records
infoProtein sequences from the Protein Data Bank in SEQRES records. SEQRES records contain the amino acid sequence of residues in each chain of the proteins.
folder_open
/datasets/bio/alphafold/pdb_seqresTara Oceans 18S amplicon
info18S amplicon sequencing data from the Tara Oceans expedition (2009-2013) DNA samples corresponding to size fractions for protists. The sequence files were downloaded from the European Nucleotide Archive under project number PRJEB6610.
folder_open
/datasets/bio/tara-oceans/18S-ampliconTara Oceans MATOU gene catalog
infoReference collection of expressed eukaryotic genes called Marine Atlas of Tara Oceans Unigenes (MATOU), obtained with the TARA Oceans expedition (2009-2013) samples.
folder_open
/datasets/bio/tara-oceans/MATOU-gene-catalogTara Oceans MGT transcriptomes
infoCollection of metagenomics-based transcriptomes (MGTs) of eukaryotic marine plankton communities obtained with the TARA Oceans expedition (2009-2013) samples.
folder_open
/datasets/bio/tara-oceans/MGT-transcriptomesTattabio
infoLLM that was trained genomic sequences with the goal of creating embeddings for protein sequences
folder_open
/datasets/bio/tattabioUniclust30
infoUniclust30 is a database of annotated protein sequences and alignments. It is built by clustering the sequences in UniProt Knowledgebase (UniProtKB) at the level of 30% pairwise sequence identity. Uniclust30 can be used with AlphaFold.
folder_open
/datasets/bio/alphafold/uniclust30UniProtKB
infoThe UniProt Knowledgebase (UniProtKB) is a database of protein sequences consisting of two sections called UniProtKB/Swiss-Prot and UniProtKB/TrEMBL. UniProtKB/Swiss-Prot contains manually annotated and non-redundant protein sequence records while UniProtKB/TrEMBL contains computationally analyzed and unreviewed protein sequence records.
folder_open
/datasets/bio/alphafold/uniprotUniRef100
infoUniRef100 is a database of protein sequences from UniProtKB and selected UniParc records.
folder_open
/datasets/bio/uniref100UniRef30
infoUniRef30 is a database of protein sequences built for ColabFold by clustering UniRef100 sequences with 30% sequence identity.
folder_open
/datasets/bio/colabfold/uniref30_2103UniRef90
infoUniRef90 is a database of protein sequences from UniProtKB and selected UniParc records. UniRef90 is built by clustering UniRef100 sequences such that each clustered set is composed of sequences that have at least 90% sequence identity to, and 80% overlap with, the longest sequence in the cluster.
folder_open
/datasets/bio/alphafold/uniref90Updated databases for ColabFold
info“Databases built in MMseqs2 format to be used with ColabFold. The databases include PDB100 (version 230517), UniRef30 (version 2302) and the environmental database ColabFoldDB (version 202108)”
folder_open
/datasets/bio/colabfold_new