PyPI page
Home page
Author:
None
Summary:
Local LLM inference and GPU kernels for Apple Silicon
Latest version:
0.1.4
Required dependencies:
numpy
|
structlog
|
tqdm
Optional dependencies:
accelerate
|
alloy-kit
|
diffusers
|
gguf
|
httpx
|
huggingface-hub
|
librosa
|
peft
|
pillow
|
python-multipart
|
questionary
|
rich
|
starlette
|
torch
|
transformers
|
typer
|
uvicorn
|
xgrammar
Downloads last day:
0
Downloads last week:
38
Downloads last month:
696