PyPI page
Home page
Author:
None
Summary:
An efficient framework for training and serving top-tier, open-source conversational LLMs.
Latest version:
3.6.1
Required dependencies:
accelerate
|
beautifulsoup4
|
colorama
|
datasets
|
fastapi
|
flash-attn
|
markdownify
|
ninja
|
numba
|
openai
|
orjson
|
packaging
|
protobuf
|
pydantic
|
pylatexenc
|
pytest
|
ray
|
sentencepiece
|
shortuuid
|
sympy
|
tenacity
|
tiktoken
|
torch
|
tqdm
|
transformers
|
uvicorn
|
vllm
|
wandb
Downloads last day:
5
Downloads last week:
16
Downloads last month:
72