PyPI Stats

Search

All packages
Top packages

Track packages

py-data-juicer


PyPI page
Home page
Author: SysML Team of Alibaba Tongyi Lab
License: Apache-2.0
Summary: Data Processing for and with Foundation Models.
Latest version: 1.5.5
Required dependencies: beautifulsoup4 | cudf-cu12 | datasets | decord | dep-logic | dill | emoji | fsspec | gitpython | httpx | jsonargparse | jsonlines | loguru | lz4 | multiprocess | mwparserfromhell | numpy | pandas | pillow | psutil | pydantic | regex | requests | streamlit | tabulate | tomli | tomli-w | torchcodec | tqdm | uv | wget | zstandard
Optional dependencies: accelerate | audiomentations | av | bitarray | black | boto3 | build | click | coverage | dashscope | deepface | diffusers | docstring-parser | easyocr | einops | fastapi | fasttext-predict | ffmpeg-python | fire | flake8-black | ftfy | funasr | furo | imagededup | imageio | imageio-ffmpeg | kenlm | label-studio | librosa | linkify-it-py | matplotlib | mcp | myst-parser | nlpaug | nlpcda | nltk | onnxruntime | openai | opencc | opencv-contrib-python | pandas | pdfplumber | pre-commit | ptlflow | pylance | pyspark | pytest | pytest-cov | python-docx | qwen-vl-utils | rank-bm25 | ray | recommonmark | rembg | resampy | rouge | s3fs | samplerate | scenedetect | scipy | selectolax | sentencepiece | simhash-pybind | simple-aesthetics-predictor | soundfile | spacy | spacy-pkuseg | sphinx | sphinx-autobuild | sphinx-copybutton | tf-keras | tiktoken | timm | toml | torch | torchaudio | transformers | ultralytics | uvloop | vllm | wandb | wordcloud

Downloads last day: 115
Downloads last week: 663
Downloads last month: 2,992