PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
Modern Data Centric AI system for Large Language Models
Latest version:
0.10.0
Required dependencies:
accelerate
|
addict
|
appdirs
|
chonkie
|
cloudpickle
|
colorama
|
colorlog
|
contractions
|
cookiecutter
|
datasets
|
datasketch
|
fasttext-wheel
|
gcsfs
|
google-api-core
|
google-api-python-client
|
google-cloud-aiplatform
|
google-cloud-bigquery
|
google-genai
|
gradio
|
httpx
|
json5
|
librosa
|
lxml_html_clean
|
modelscope
|
networkx
|
nltk
|
numpy
|
openai
|
pandas
|
presidio_analyzer
|
pydantic
|
pymupdf
|
pytest
|
pyvis
|
rapidfuzz
|
rich
|
scipy
|
sentencepiece
|
sqlglot
|
tiktoken
|
torch
|
torchaudio
|
torchvision
|
tqdm
|
trafilatura
|
transformers
|
vendi-score
Optional dependencies:
asyncio
|
clickhouse-driver
|
librosa
|
lightrag-hku
|
litellm
|
llamafactory
|
mineru
|
mineru-vl-utils
|
numpy
|
pypdf
|
reportlab
|
sentence_transformers
|
sglang
|
sqlite-lembed
|
sqlite-vec
|
vllm
Downloads last day:
0
Downloads last week:
214
Downloads last month:
738