Kartik Bhat

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

A high-throughput and memory-efficient inference and serving engine for LLMs

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.