PyPI page
Home page
Author:
Gavin Li
Summary:
AirLLM runs 70B large language models on a single 4GB GPU without quantization, distillation or pruning. 405B Llama 3.1 on 8GB, DeepSeek-V3 671B on ~12GB.
Latest version:
3.0.1
Required dependencies:
accelerate
|
huggingface-hub
|
safetensors
|
scipy
|
sentencepiece
|
torch
|
tqdm
|
transformers
Downloads last day:
444
Downloads last week:
4,565
Downloads last month:
14,838