Nov11

Heterogeneous GPU Sharing on Kubernetes

A high-throughput and memory-efficient inference and serving engine for LLMs

Efficient Training (including pre-training and fine-tuning) for Big Models

A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster