Model Training - mat-yz-e/- GitHub Wiki
Model-Optimizer
https://github.com/NVIDIA/Model-Optimizer)
Marin Speerdrun
https://marin.community/speedrun/?track=scaling&xAxis=model_flops&yAxis=absolute
slime is an LLM post-training framework for RL Scaling
https://github.com/THUDM/slime
Train LLM From Scratch
https://github.com/FareedKhan-dev/train-llm-from-scratch
HRM-Text: Efficient Pretraining Beyond Scaling
https://github.com/sapientinc/HRM-Text
Fine-Tuning Liquid's LFM2.5: Accurate Tool Calling at 350M Parameters
https://www.distillabs.ai/blog/fine-tuning-liquids-lfm25-accurate-tool-calling-at-350m-parameters/
Simple & Scalable Pretraining for Neural Architecture Research
https://github.com/microsoft/ArchScale
frontier model training methodologies
https://djdumpling.github.io/2026/01/31/frontier_training.html
Fully automatic censorship removal for language models
https://github.com/p-e-w/heretic
Self-Distillation Enables Continual Learning
https://self-distillation.github.io/SDFT.html
End-to-End Test-Time Training for Long Context
https://github.com/test-time-training/e2e
SonicMoE: Accelerating MoE with IO and Tile-aware Optimizations
https://github.com/Dao-AILab/sonic-moe
An interface library for RL post training with environments
https://github.com/meta-pytorch/OpenEnv
NanoGPT (124M) in 3 minutes
https://github.com/KellerJordan/modded-nanogpt
We Got Claude to Fine-Tune an Open Source LLM
https://huggingface.co/blog/hf-skills-training
Evolution Strategies at the Hyperscale
https://github.com/ESHyperscale/HyperscaleES
RLinf: Reinforcement Learning Infrastructure for Agentic AI
https://github.com/RLinf/RLinf
The Smol Training Playbook
https://huggingface.co/spaces/HuggingFaceTB/smol-training-playbook
Post-training 101
https://tokens-for-thoughts.notion.site/post-training-101
SkyRL tx: An open source project to implement the Tinker API
https://novasky-ai.notion.site/skyrl-tx
Tunix: A JAX-Native Library for LLM Post-Training
https://developers.googleblog.com/en/introducing-tunix-a-jax-native-library-for-llm-post-training/
torchtitan - A PyTorch native platform for training generative AI models
https://github.com/pytorch/torchtitan
The Ultra-Scale Playbook: Training LLMs on GPU Clusters
https://huggingface.co/nanotron
How to Scale Your Model
https://jax-ml.github.io/scaling-book/index