PyPI page
Home page
Author:
Google LLC
Summary:
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
Latest version:
0.2.2
Required dependencies:
absl-py
|
blobfile
|
coverage
|
flax
|
grpcio
|
jax
|
jaxlib
|
numpy
|
parameterized
|
portpicker
|
prometheus-client
|
pytest
|
seqio
|
shortuuid
|
tiktoken
Downloads last day:
14
Downloads last week:
773
Downloads last month:
4,244