PyPI page
Home page
Author:
Andrii Boiko
Summary:
Distil an expensive LLM API call on a narrow task into a small local model served behind an OpenAI-compatible cascade.
Latest version:
0.1.1
Required dependencies:
datasketch
|
fastapi
|
httpx
|
huggingface-hub
|
jinja2
|
jsonschema
|
matplotlib
|
mlx
|
mlx-lm
|
numpy
|
prometheus-client
|
pydantic
|
pyyaml
|
rich
|
scikit-learn
|
transformers
|
typer
|
uvicorn
Optional dependencies:
peft
|
pyarrow
|
torch
Downloads last day:
0
Downloads last week:
4
Downloads last month:
130
7-day smoothing