PyPI page
Home page
Author:
All Advance AI
Summary:
A simple and efficient python library for fast inference of GGUF Large Language Models.
Latest version:
1.0.9
Required dependencies:
aiohttp
|
chromadb
|
click
|
cryptography
|
flask
|
flask-cors
|
flask-socketio
|
google-cloud-aiplatform
|
huggingface-hub
|
langchain
|
llama-cpp-python
|
llama-index
|
llama-index-llms-llama-cpp
|
openai
|
pdfminer.six
|
pydantic
|
pyjwt
|
python-dotenv
|
python-multipart
|
sentence-transformers
|
vertexai
Downloads last day:
72
Downloads last week:
154
Downloads last month:
208