PyPI page
Home page
Author:
None
Summary:
A petabyte scale data processing framework for AI models using Ray.
Latest version:
0.1.1
Required dependencies:
daft
|
loguru
|
ray
|
transformers
Optional dependencies:
av
|
chonkie
|
imagehash
|
pillow-simd
|
scenedetect
|
sentence-transformers
|
silero-vad
|
teraflopai-data
|
trafilatura
|
vllm
|
warcio
Downloads last day:
3
Downloads last week:
28
Downloads last month:
42