PyPI page
Home page
Author:
License:
Summary:
Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput large-batch generation.
Latest version:
0.1.8
Required dependencies:
attrs
|
numpy
|
pulp
|
torch
|
tqdm
|
transformers
Downloads last day:
11
Downloads last week:
43
Downloads last month:
277