DeepSpeed - AshokBhat/ml GitHub Wiki

About

• https://www.deepspeed.ai/
• An easy-to-use deep learning optimization software suite
• For Deep Learning Training and Inference.
• Improves scale and speed

Features

• Train/Inference dense or sparse models with billions or trillions of parameters
• Achieve excellent system throughput and efficiently scale to thousands of GPUs
• Train/Inference on resource constrained GPU systems
• Achieve unprecedented low latency and high throughput for inference
• Achieve extreme compression for an unparalleled inference latency and model size reduction with low costs

See also