PyPI page
Home page
Author:
None
License:
MIT License Copyright (c) 2025 Wenjie Zhang Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal...
Summary:
A FastAPI-based load balancer for vLLM servers with OpenAI-compatible API
Latest version:
0.1.0
Required dependencies:
aiohttp
|
fastapi
|
httpx
|
loguru
|
openai
|
psutil
|
pydantic
|
requests
|
rich
|
toml
|
typer
|
uvicorn
Downloads last day:
4
Downloads last week:
48
Downloads last month:
57