PyPI page
Home page
Author:
kvcache-ai
Summary:
KTransformers: CPU-GPU heterogeneous inference framework for LLMs
Latest version:
0.6.3
Required dependencies:
kt-kernel
Optional dependencies:
accelerate-kt
|
sglang-kt
|
transformers-kt
Downloads last day:
22
Downloads last week:
475
Downloads last month:
2,500