PyPI page
Home page
Author:
Rehan Fazal
Summary:
Text preprocessing & PII anonymization pipeline for NLP/ML: ONNX NER ensemble, language detection, stopword removal, and configurable token replacement.
Latest version:
0.10.0
Required dependencies:
emoji
|
ftfy
|
huggingface-hub
|
lingua-language-detector
|
numpy
|
onnxruntime
|
presidio-anonymizer
|
regex
|
stop-words
|
tokenizers
|
unidecode
Optional dependencies:
coverage
|
cryptography
|
datafog-core
|
datasets
|
datasketch
|
datatrove
|
docling
|
faker
|
fastmcp
|
gliclass
|
gliner
|
gliner2
|
haystack-ai
|
hypothesis
|
langchain-core
|
onnx
|
onnxruntime-gpu
|
orjson
|
pillow
|
presidio-analyzer
|
pyarrow
|
pytesseract
|
pytest
|
pytest-cov
|
pytest-timeout
|
rapidfuzz
|
ruff
|
spacy
|
squeakycleantext
|
torch
|
transformers
Downloads last day:
90
Downloads last week:
527
Downloads last month:
16
7-day smoothing