PyPI page
Home page
Author:
Utkarsh Tiwari
Summary:
LocalLab: A lightweight AI inference server for running LLMs locally or in Google Colab with a friendly API.
Latest version:
0.11.3
Required dependencies:
accelerate
|
bitsandbytes
|
click
|
colorama
|
dataclasses-json
|
fastapi
|
fastapi-cache2
|
httpx
|
huggingface_hub
|
llama-cpp-python
|
nest-asyncio
|
netifaces
|
nvidia-ml-py3
|
psutil
|
pydantic
|
pyngrok
|
pynvml
|
python-dotenv
|
python-multipart
|
questionary
|
requests
|
rich
|
torch
|
transformers
|
typing_extensions
|
uvicorn
|
websockets
Optional dependencies:
pytest
|
pytest-asyncio
|
pytest-cov
Downloads last day:
1
Downloads last week:
113
Downloads last month:
197