Pinned Loading

1. kvcache-ai/ktransformers kvcache-ai/ktransformers Public

   A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

   Python 16.2k 1.2k

2. PaddlePaddle/Paddle PaddlePaddle/Paddle Public

   PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

   C++ 23.5k 5.9k

3. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 21.3k 3.7k

4. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 4.4k 469