Sentencepiece

Latest version: v0.2.0

Safety actively analyzes 682487 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 5 of 5

0.1.6

* Bug fix: do not apply normalization to the user-defined-symbols.
* Bug fix: stop adding extra whitespaces before user-defined symbols
* Feature: added --minloglevel flag to suppress LOG(INFO) message
* Feature: added --split_by_number flag to allow numbers to attach other symbols.
* Feature: added --max_sentence_length flag to control the maximum byte length of input sentence for training.
* used tf-versioned so file for _sentencepiece_processor_ops to minimize ABI incompatibility for tf wapper.

For more detail: https://github.com/google/sentencepiece/compare/v0.1.5...master

0.1.6pre1

SentencePiece Windows release

0.1.5

0.1.4

Initial SentencePiece releases

Page 5 of 5

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.