PyPI page
Home page
Author:
SysML Team of Alibaba Tongyi Lab
License:
Apache-2.0
Summary:
Data Processing for and with Foundation Models.
Latest version:
1.5.3
Required dependencies:
beautifulsoup4
|
cudf-cu12
|
datasets
|
dep-logic
|
dill
|
emoji
|
fsspec
|
gitpython
|
httpx
|
jsonargparse
|
jsonlines
|
loguru
|
lz4
|
multiprocess
|
mwparserfromhell
|
numpy
|
pandas
|
pillow
|
psutil
|
pydantic
|
regex
|
requests
|
streamlit
|
tabulate
|
tomli
|
tomli-w
|
tqdm
|
uv
|
wget
|
zstandard
Optional dependencies:
accelerate
|
audiomentations
|
av
|
bitarray
|
black
|
boto3
|
build
|
click
|
coverage
|
dashscope
|
decord
|
diffusers
|
docstring-parser
|
easyocr
|
einops
|
fastapi
|
fasttext-wheel
|
ffmpeg-python
|
fire
|
flake8-black
|
ftfy
|
furo
|
imagededup
|
kenlm
|
label-studio
|
librosa
|
linkify-it-py
|
matplotlib
|
mcp
|
myst-parser
|
nlpaug
|
nlpcda
|
nltk
|
onnxruntime
|
openai
|
opencc
|
opencv-contrib-python
|
pdfplumber
|
pre-commit
|
ptlflow
|
pylance
|
pyspark
|
pytest
|
pytest-cov
|
python-docx
|
qwen-vl-utils
|
rank-bm25
|
ray
|
recommonmark
|
rembg
|
resampy
|
rouge
|
s3fs
|
samplerate
|
scenedetect
|
selectolax
|
sentencepiece
|
simhash-pybind
|
simple-aesthetics-predictor
|
soundfile
|
spacy
|
spacy-pkuseg
|
sphinx
|
sphinx-autobuild
|
sphinx-copybutton
|
tiktoken
|
timm
|
toml
|
torch
|
torchaudio
|
torchcodec
|
transformers
|
ultralytics
|
uvloop
|
vllm
|
wandb
|
wordcloud
Downloads last day:
119
Downloads last week:
461
Downloads last month:
2,098