PyPI page
Home page
Author:
Suneel Marthi
License:
Apache-2.0
Summary:
Model-agnostic edge deployment analysis framework — PLE memory analysis, TurboQuant/RotorQuant KV compression, mmap profiling, and LoRA fine-tuning for memory-constrained devices.
Latest version:
0.1.2
Required dependencies:
accelerate
|
bitsandbytes
|
click
|
datasets
|
flash-attn
|
huggingface-hub
|
numpy
|
peft
|
protobuf
|
pydantic
|
pyyaml
|
rich
|
safetensors
|
scipy
|
sentencepiece
|
tabulate
|
torch
|
transformers
|
trl
Optional dependencies:
gradio
|
matplotlib
|
mypy
|
pytest
|
pytest-cov
|
ruff
Downloads last day:
15
Downloads last week:
67
Downloads last month:
367