PyPI page
Home page
Author:
None
License:
MIT License
Copyright (c) 2024 Abdul Hameed Azeemi
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associate...
Summary:
A lightweight, extensible Python library for data pruning with Hugging Face datasets and transformers
Latest version:
0.0.1
Required dependencies:
accelerate
|
datasets
|
pandas
|
scikit-learn
|
torch
|
tqdm
|
transformers
Optional dependencies:
black
|
flake8
|
kenlm
|
mypy
|
pytest
|
pytest-cov
Downloads last day:
4
Downloads last week:
11
Downloads last month:
20