Microtc

This version includes a parameter to disable unit vector

This version improves the performance of SparseMatrix

This version solves the bugs corresponding to the non-breaking space and the single quotation.

This version has a parameter to disable text transformations. This might be useful if another process applied the text transformations.

This version includes a parameter to create the Bag of Word model with a maximum number of terms. For example, the following code can be used to create a model with at most 1024 terms (tokens) using q-grams (2, 3, 4) and words.
python
from microtc import TextModel

tm = TextModel(token_list=[-1, 2, 3, 4],
token_max_filter=2024,
max_dimension=True)