PyPI page
Home page
Author:
Cactus Compute
License:
Cactus Compute License
Summary:
On-device AI inference — LLM, vision, speech, embeddings, and RAG
Latest version:
2.2.2
Required dependencies:
fastapi
|
huggingface-hub
|
numpy
|
pillow
|
protobuf
|
python-multipart
|
sentencepiece
|
torchvision
|
uvicorn
Optional dependencies:
einops
|
httpx
|
peft
|
pytest
|
scipy
|
sentencepiece
|
torch
|
torchvision
|
transformers
Downloads last day:
10
Downloads last week:
110
Downloads last month:
1,012
7-day smoothing