PyTorch - BKJackson/BKJackson_Wiki GitHub Wiki

Torch.compile

Introduction to torch.compile - docs, vLLM uses torch.compile

FlexAttention in PyTorch

FlexAttention: The Flexibility of PyTorch with the Performance of FlashAttention - Aug 2024

PyTorch Lightning

PyTorch Lightning - Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.

Intro tutorials and examples

Running PyTorch Tutorials in Google Colab
UC Berkeley Intro to PyTorch - Google Colab notebook
PyTorch Examples by JC Johnson - 5 years old, basic concepts
Pytorch datasets and dataloaders