Rftokenizer

Latest version: v2.3.2

Safety actively analyzes 723177 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 2

1.1.0

Compatibility update for sklearn 0.23 + joblib

1.0.1

* Added Arabic model
* Re-arranged folder setup for PyPI deployment

1.0.0

* Single file implementation, no classes for multilabel encoder etc.
* Switch classifier to xgboost
* Add interface for getting probabilities instead of predictions
* Add hyperparameter optimization code
* Various minor improvements

0.9.0

For more details see:

Zeldes, Amir (2018) A Characterwise Windowed Approach to Hebrew Morphological Segmentation. In: Proceedings of the 15th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology. Brussels, Belgium.

Page 2 of 2

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.