PyPI page
Home page
Author:
Neuralmagic, Inc.
License:
Apache
Summary:
A library for compressing large language models utilizing the latest techniques and research in the field for both training aware and post training techniques. The library is designed to be flexible and easy to use on top of PyTorch and HuggingFace Transformers, allowing for quick experimentation.
Latest version:
0.10.0.2
Required dependencies:
accelerate
|
auto-round
|
compressed-tensors
|
datasets
|
loguru
|
numpy
|
nvidia-ml-py
|
pillow
|
pyyaml
|
requests
|
torch
|
tqdm
|
transformers
Optional dependencies:
beautifulsoup4
|
cmarkgfm
|
librosa
|
lm_eval
|
markdown
|
mkdocs
|
mkdocs-api-autonav
|
mkdocs-awesome-nav
|
mkdocs-gen-files
|
mkdocs-material
|
mkdocs-minify-plugin
|
mkdocs-section-index
|
mkdocstrings-python
|
mypy
|
pandas
|
pre-commit
|
pymdown-extensions
|
pytest
|
pytest-mock
|
pytest-rerunfailures
|
qwen_vl_utils
|
ruff
|
soundfile
|
torchcodec
|
torchvision
|
trl
Downloads last day:
15,749
Downloads last week:
85,523
Downloads last month:
305,589