PyPI page
Home page
Author:
kvcache-ai
Summary:
KTransformers: CPU-GPU heterogeneous inference framework for LLMs
Latest version:
0.7.2
Required dependencies:
kt-kernel
Optional dependencies:
accelerate-kt
|
llamafactory-kt
|
sglang-kt
|
transformers-kt
Downloads last day:
43
Downloads last week:
367
Downloads last month:
1,352
7-day smoothing