PyPI page
Home page
Author:
KVict Team
License:
Apache-2.0
Summary:
KVict: KV cache eviction CLI, advisor service, and subscription stretching proxy for LLM APIs
Latest version:
1.2.0
Required dependencies:
httpx
|
keyring
|
numpy
|
nvidia-ml-py3
|
prometheus-client
|
pydantic
|
python-dotenv
|
pyyaml
|
typing-extensions
Optional dependencies:
aiosqlite
|
black
|
fastapi
|
flake8
|
mypy
|
pytest
|
pytest-asyncio
|
pytest-cov
|
tiktoken
|
uvicorn
|
vllm
Downloads last day:
5
Downloads last week:
10
Downloads last month:
17