PyPI page
Home page
Author:
None
Summary:
An optimizing inference proxy for LLMs.
Latest version:
0.3.15
Required dependencies:
adaptive-classifier
|
aiohttp
|
azure-identity
|
beautifulsoup4
|
bitsandbytes
|
cerebras_cloud_sdk
|
datasets
|
flask
|
google-cloud-aiplatform
|
gradio
|
ipykernel
|
ipython
|
litellm
|
lxml
|
mcp
|
mlx-lm
|
nbconvert
|
nbformat
|
networkx
|
numpy
|
openai
|
outlines
|
peft
|
presidio_analyzer
|
presidio_anonymizer
|
pyyaml
|
requests
|
scikit-learn
|
selenium
|
sentencepiece
|
spacy
|
tiktoken
|
torch
|
transformers
|
webdriver-manager
|
z3-solver
Optional dependencies:
accelerate
|
httpx
|
huggingface_hub
|
pandas
|
tabulate
|
tqdm
Downloads last day:
266
Downloads last week:
1,886
Downloads last month:
4,574