Iamtokenizing

Latest version: v0.7.0

The latest version of iamtokenizing with no known security vulnerabilities is 0.7.0. We recommend installing version 0.7.0.

The information on this page was curated by experts in our Cybersecurity Intelligence Team.

Latest release: v0.7.0 at Jan. 4, 2023
License: GPL-3.0-only (GNU General Public License v3.0 only)

Description

Simple tokenizers: n-grams and chargrams splitting, white space splitting, or splitting using configurable REGEX expression, or detection into context tokenization. Based on ExtractionString object from the extractionstring package.

Resources

Package homepage
PyPi

Vulnerabilities

See all vulnerabilities

No known vulnerabilities found

Versions (10)

See all versions

Has known vulnerabilities

0.7.0
0.6.2
0.6.1
0.5.6
0.5.5
0.5.1
0.5.0
0.4.2
0.3.1
0.3.0