Latest version: v0.1.6
The information on this page was curated by experts in our Cybersecurity Intelligence Team.
A score-based implementation of WordPiece tokenization training, compatible with HuggingFace tokenizers.
No known vulnerabilities found