PyPI Stats

Search

All packages
Top packages

Track packages

async-batch-llm


PyPI page
Home page
Author: Geoff Davis
License: MIT
Summary: Provider-neutral asyncio toolkit for concurrent LLM calls with retries, scoped RPM/TPM admission, bounded streaming, resumable checkpoints, and deadlines.
Latest version: 0.28.0
Required dependencies: pydantic | typing-extensions
Optional dependencies: google-genai | matplotlib | mkdocs | mkdocs-material | mkdocs-redirects | mkdocstrings | mypy | openai | prek | pydantic-ai | pymdown-extensions | pytest | pytest-asyncio | pytest-cov | pytest-timeout | ruff | tqdm | ty

Downloads last day: 22
Downloads last week: 141
Downloads last month: 907
7-day smoothing