PyPI page
Home page
Author:
AllenChou
Summary:
OpenAI-compatible client + worker that bridge inference requests over a Redis queue (Redis Streams), for running LLMs across heavily restricted networks.
Latest version:
0.1.2
Required dependencies:
httpx
|
openai
|
redis
|
typer
Optional dependencies:
black
|
isort
|
pytest
|
pytest-asyncio
|
pyyaml
|
ruff
Downloads last day:
0
Downloads last week:
9
Downloads last month:
81