deepspeed

Community

Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention

Install

skillpm install deepspeed

Format score

90/100

Spec

v1.0

Installs

0

Author

@Orchestra-Research

Published

April 1, 2026

Tags

Source

https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/main/08-distributed-training/deepspeed