PyPI page
Home page
Author:
None
Summary:
A petabyte scale data processing framework for AI models using Ray.
Latest version:
0.1.0
Required dependencies:
daft
|
loguru
|
ray
|
transformers
Optional dependencies:
av
|
chonkie
|
imagehash
|
jotun
|
opencv-python
|
pillow-simd
|
scenedetect
|
sentence-transformers
|
silero-vad
|
trafilatura
|
vllm
|
warcio
Downloads last day:
0
Downloads last week:
7
Downloads last month:
19