PyPI page
Home page
Author:
Fabrizio Pfannl
License:
Apache-2.0
Summary:
Automatic micro-batching for HTTP LLM calls and local PyTorch inference, backed by a Rust core.
Latest version:
0.1.1
Optional dependencies:
httpx
|
torch
Downloads last day:
1
Downloads last week:
55
Downloads last month:
61