Latest version: v0.1.17
The information on this page was curated by experts in our Cybersecurity Intelligence Team.
TS Tokenizer is a hybrid (lexicon-based and rule-based) tokenizer designed specifically for tokenizing Turkish texts.
No known vulnerabilities found
Has known vulnerabilities