PyPI page
Home page
Author:
None
Summary:
A Modular Framework for Efficient, Affordable, and Reproducible LLM Inference
Latest version:
0.0.6
Required dependencies:
anthropic
|
deepdiff
|
diskcache
|
google-genai
|
groq
|
huggingface_hub
|
nest_asyncio
|
openai
|
together
Optional dependencies:
deepdiff
|
diskcache
|
pytest
|
pytest-asyncio
|
pytest-cov
|
torch
|
transformers
Downloads last day:
51
Downloads last week:
75
Downloads last month:
242