PyPI page
Home page
Author:
None
Summary:
Stateful LLM serving instances that self-reflect and learn from their mistakes during periods of low server utilization.
Latest version:
1.0.0a2
Required dependencies:
absl-py
|
fastapi
|
immutabledict
|
lm-eval
|
mlx
|
mlx-lm
|
optax
|
torch
|
tqdm
|
transformers
|
uvicorn
|
vizible
Downloads last day:
9
Downloads last week:
17
Downloads last month:
38