PyPI page
Home page
Author:
Omar Kamali
License:
MIT
Summary:
A Python package for consuming Wikipedia language models including tokenizers, ngram models, markov chains, and vocabularies.
Latest version:
0.1.3
Required dependencies:
babelvec
|
datasets
|
huggingface-hub
|
numpy
|
pandas
|
pyarrow
|
pycountry
|
sentencepiece
|
tokenizers
|
torch
|
transformers
|
vocabulous
Optional dependencies:
jupyter
|
pytest
|
pytest-cov
Downloads last day:
0
Downloads last week:
6
Downloads last month:
18
7-day smoothing