PyPI page
Home page
Author:
Oscar
Summary:
An asynchronous chat engine using vLLM with a async producer-consumer pattern.
Latest version:
1.0.14
Required dependencies:
pyjwt
|
vllm
|
websockets
Downloads last day:
0
Downloads last week:
53
Downloads last month:
128