Lin Zhecheng

katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repo is the core api for Katalyst, including crd, clientSet, informer, pd, general const variables and utils

Katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This is the core components in Katalyst system, including multiple agents and centralized components

A high-throughput and memory-efficient inference and serving engine for LLMs

校招、秋招、春招、实习好项目！带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step