PyPI page
Home page
Author:
Oscar
Summary:
An asynchronous chat engine using vLLM with a async producer-consumer pattern.
Latest version:
1.0.14
Required dependencies:
pyjwt
|
vllm
|
websockets
Downloads last day:
12
Downloads last week:
21
Downloads last month:
76