PyPI page
Home page
Author:
codelion
Summary:
An optimizing inference proxy for LLMs.
Latest version:
0.4.0
Required dependencies:
adaptive-classifier
|
aiohttp
|
azure-identity
|
beautifulsoup4
|
bitsandbytes
|
cerebras-cloud-sdk
|
datasets
|
flask
|
google-cloud-aiplatform
|
gradio
|
ipykernel
|
ipython
|
litellm
|
lxml
|
math-verify
|
mcp
|
mlx-lm
|
nbconvert
|
nbformat
|
networkx
|
numpy
|
openai
|
outlines
|
peft
|
presidio-analyzer
|
presidio-anonymizer
|
pyyaml
|
requests
|
scikit-learn
|
selenium
|
sentencepiece
|
spacy
|
tiktoken
|
torch
|
transformers
|
webdriver-manager
|
z3-solver
Optional dependencies:
accelerate
|
httpx
|
huggingface-hub
|
pandas
|
tabulate
|
tqdm
Downloads last day:
16
Downloads last week:
259
Downloads last month:
1,194
7-day smoothing