Pythia

Path:/datasets/ai/pythia
URL:https://huggingface.co/collections/EleutherAI/pythia-scaling-suite-64fb5dfa8c21ebb3db7ad2e1
Downloaded:2025-04-02
Cite:Biderman, Stella, et al. “Pythia: A suite for analyzing large language models across training and scaling.” International Conference on Machine Learning. PMLR, 2023.
Variant:
  • pythia-1.4b
  • pythia-14m
  • pythia-160m
  • pythia-1b
  • pythia-2.8b
  • pythia-410m
  • pythia-6.9b
  • pythia-70m
Bibtex:
@misc{biderman2023pythiasuiteanalyzinglarge, title={Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling},  author={Stella Biderman and Hailey Schoelkopf and Quentin Anthony and Herbie Bradley and Kyle O'Brien and Eric Hallahan and Mohammad Aflah Khan and Shivanshu Purohit and USVSN Sai Prashanth and Edward Raff and Aviya Skowron and Lintang Sutawika and Oskar van der Wal}, year={2023}, eprint={2304.01373}, archivePrefix={arXiv}, primaryClass={cs.CL}, url={https://arxiv.org/abs/2304.01373}