PyPI page
Home page
Author:
eugr
License:
MIT License
Copyright (c) 2026 Eugene Rakhmatulin
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated...
Summary:
llama-bench style benchmarking tool for all OpenAI-compatible LLM endpoints
Latest version:
0.4.0
Required dependencies:
aiohttp
|
asyncio
|
numpy
|
openai
|
pydantic
|
requests
|
tabulate
|
tokenizers
|
transformers
Optional dependencies:
fastapi
|
pydantic
|
pytest
|
pytest-asyncio
|
uvicorn
Downloads last day:
314
Downloads last week:
1,925
Downloads last month:
6,228