PyPI page
Home page
Author:
None
License:
MIT
Summary:
Distributed Inference for Large Language Models.
Latest version:
1.0.2
Required dependencies:
accelerate
|
bitsandbytes
|
datasets
|
langchain
|
langchain-anthropic
|
langchain-google-genai
|
nltk
|
parsl
|
peft
|
pydantic
|
python-dotenv
|
sentence-transformers
|
torch
|
transformers
|
typer
Optional dependencies:
black
|
build
|
covdefaults
|
coverage
|
mike
|
mkdocs-gen-files
|
mkdocs-literate-nav
|
mkdocs-material
|
mkdocs-section-index
|
mkdocstrings
|
mkdocstrings-python
|
mypy
|
pre-commit
|
pytest
|
pytest-cov
|
ruff
|
tox
|
twine
|
types-pyyaml
|
virtualenv
Downloads last day:
43
Downloads last week:
88
Downloads last month:
101