DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research

Last month, the DeepSpeed Team announced ZeRO-Infinity, a step forward in training models with tens of trillions of parameters. In addition to creating optimizations for scale, our team strives to introduce features that also improve speed, cost, and usability. As the DeepSpeed optimization library evolves, we are listening to the growing DeepSpeed community to learn […]

DeepSpeed - Microsoft Research

Gitee 极速下载/DeepSpeed

AI, Free Full-Text

DeepSpeed: Advancing MoE inference and training to power next-generation AI scale - Microsoft Research

Research @ Microsoft 2022: A look back at a year of accelerating progress in AI - Microsoft Research

DeepSpeed for Large Model Training and Inference

DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research

9 libraries for parallel & distributed training/inference of deep learning models, by ML Blogger

9 libraries for parallel & distributed training/inference of deep learning models, by ML Blogger

ZeRO-Infinity and DeepSpeed: Unlocking unprecedented model scale for deep learning training - Microsoft Research

Announcing the DeepSpeed4Science Initiative: Enabling large-scale scientific discovery through sophisticated AI system technologies - Microsoft Research

LLM（十二）：DeepSpeed Inference 在LLM 推理上的优化探究- 知乎

xTrimoPGLM: Unified 100B-Scale Pre-trained Transformer for Deciphering the Language of Protein

Generative AI

TensorFlow to PyTorch for SLEAP: Is it Worth it?