LLM and Machine Learning Custom Hardware - ObrienlabsDev/blog GitHub Wiki
NVIDIA or Apple Silicon - Local
Tokens/sec for various M series and NVidia Ampere, Ada and Grace Blackwell GPUs
20260120 - https://github.com/ObrienlabsDev/blog/issues/160
Google Cloud
Asus Z790 H for Intel 14900K running a dual RTX-A4500 NVLink bridge
Keep CPU Undervolt Protection off for 15% performance improvement under CPU AI Overclocking
LLM Foundation Model Training
- andrej.karpathy Nanochat on NVIDIA DGX Spark GB10 - https://github.com/ObrienlabsDev/foundation-transformer-llm/issues/7
- andrej.karpathy Nanochat on NVIDIA DGX Spark GB10 - https://github.com/ObrienlabsDev/blog/issues/170
- https://github.com/obriensystems/nanochat/blob/dev/runs/runcpu.sh#L79
- DGX Spark https://github.com/ObrienlabsDev/foundation-transformer-llm/issues/7
- Apple Silicon https://github.com/ObrienlabsDev/foundation-transformer-llm/issues/8
- Windows/WSL NVIDIA https://github.com/ObrienlabsDev/foundation-transformer-llm/issues/9 = https://github.com/karpathy/nanochat/issues/542