PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
Asynchronous Self-Healing KV Cache for Silicon-Native LLMs by GDI Nexus
Latest version:
8.3.2
Required dependencies:
accelerate
|
coremltools
|
gradio
|
mlx
|
mlx-lm
|
numpy
|
rich
|
torch
|
transformers
Optional dependencies:
black
|
build
|
pytest
|
twine
Downloads last day:
8
Downloads last week:
93
Downloads last month:
997