PyPI Stats

Search

All packages
Top packages

Track packages

filipino-tokenizer


PyPI page
Home page
Author: None
License: MIT License Copyright (c) 2026 John Paul Curada Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated d...
Summary: Morphology-aware BPE tokenizer for Philippine languages (Tagalog)
Latest version: 0.4.1

Optional dependencies: transformers

Downloads last day: 6
Downloads last week: 171
Downloads last month: 2,133