PyPI page
Home page
Author:
kvcache-ai
Summary:
KTransformers: CPU-GPU heterogeneous inference framework for LLMs
Latest version:
0.6.1.post1
Required dependencies:
kt-kernel
Optional dependencies:
accelerate-kt
|
sglang-kt
|
transformers-kt
Downloads last day:
241
Downloads last week:
1,057
Downloads last month:
3,653