PyPI page
Home page
Author:
FlashInfer team
Summary:
FlashInfer: Kernel Library for LLM Serving
Latest version:
0.6.3
Required dependencies:
apache-tvm-ffi
|
click
|
einops
|
ninja
|
numpy
|
nvidia-cudnn-frontend
|
nvidia-cutlass-dsl
|
nvidia-ml-py
|
packaging
|
requests
|
tabulate
|
torch
|
tqdm
Downloads last day:
69,462
Downloads last week:
556,316
Downloads last month:
1,975,287