PyPI Stats

Search

All packages
Top packages

Track packages

tensor-parallel


PyPI page
Home page
Author: Andrei Panferov and Yaroslav Lisnyak
License:
Summary: Automatically shard your large model between multiple GPUs, works without torch.distributed
Latest version: 2.0.0
Required dependencies: torch | transformers
Optional dependencies: accelerate | black | einops | isort | peft | psutil | pytest | pytest-asyncio | pytest-forked

Downloads last day: 122
Downloads last week: 718
Downloads last month: 3,520