Skip to content

Latest commit

 

History

History

resources

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 

README.md

Resources

Similar online guides

Useful compilations

Publicly available training LLM/VLM logbooks

Logbooks, chronicles, and technical reports of training LLMs/VLMs are among the best sources to learn from about dealing with training instabilities, infrastructure and scaling challenges, and choosing good hyper parameters. The earlier entries here are logbooks/chronicles kept during a training run; increasingly the same hard-won lessons appear as dedicated sections of technical reports - typically titled something like Infrastructure, Scaling, and Efficiency or Engineering Challenges and Solutions, and often covering reliability and operational challenges that rarely make it into a model card.

If you know of a public LLM/VLM training logbook, or a technical report with such a section, that is not on this list please kindly let me know via an Issue or add it via a PR. Thank you!

The listing is in no particular order other than being grouped by the year.

2021

2022

2023

2024

2025

2026

Hardware setup logbooks