PyPI page
Home page
Author:
None
Summary:
lk_moe is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features an efficient GPU parallel and NUMA parallel architecture, supporting hybrid inference for MOE large models.
Latest version:
2.1.1
Downloads last day:
167
Downloads last week:
203
Downloads last month:
728