Model2vec

What's Changed
* fix: Fixed local distillation by Pringled in https://github.com/MinishLab/model2vec/pull/149
* Bump version by Pringled in https://github.com/MinishLab/model2vec/pull/150


**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.3.4...v0.3.5

What's Changed
* docs: Add txtai integration docs by Pringled in https://github.com/MinishLab/model2vec/pull/130
* docs: Reworked documentation by Pringled in https://github.com/MinishLab/model2vec/pull/131
* feat: Added semantic chunking with chonkie tutorial by Pringled in https://github.com/MinishLab/model2vec/pull/133
* feat: Updated config values by Pringled in https://github.com/MinishLab/model2vec/pull/136
* feat: add support for pattern for unused tokens. by stephantul in https://github.com/MinishLab/model2vec/pull/138
* feat: Add multiprocessing by Pringled in https://github.com/MinishLab/model2vec/pull/141 (suggested by [davidmezzetti](https://github.com/davidmezzetti) in https://github.com/MinishLab/model2vec/issues/139)
* feat: Added multiprocessing threshold parameter by Pringled in https://github.com/MinishLab/model2vec/pull/142
* docs: Add langchain example by Pringled in https://github.com/MinishLab/model2vec/pull/143
* fix: Removed unneeded tokenize call by Pringled in https://github.com/MinishLab/model2vec/pull/144
* docs: update README.md by eltociear in https://github.com/MinishLab/model2vec/pull/145
* Bump version by Pringled in https://github.com/MinishLab/model2vec/pull/146

New Contributors
* eltociear made their first contribution in https://github.com/MinishLab/model2vec/pull/145

**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.3.3...v0.3.4

What's Changed
* feat: Added onnx and tokenizer files support script by Pringled in https://github.com/MinishLab/model2vec/pull/119
* docs: Update readme by Pringled in https://github.com/MinishLab/model2vec/pull/122
* fix: Fixed CI by Pringled in https://github.com/MinishLab/model2vec/pull/124
* docs: Updated results table by Pringled in https://github.com/MinishLab/model2vec/pull/125
* docs: Updated slogan by Pringled in https://github.com/MinishLab/model2vec/pull/127
* fix: Added jinja2 requirement by Pringled in https://github.com/MinishLab/model2vec/pull/128
* Bumped version by Pringled in https://github.com/MinishLab/model2vec/pull/129


**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.3.2...v0.3.3

What's Changed
* fix: Fixed package extras bug by Pringled in https://github.com/MinishLab/model2vec/pull/120
* Bump version by Pringled in https://github.com/MinishLab/model2vec/pull/121


**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.3.1...v0.3.2

What's Changed
* fix: update added tokens to be more agnostic by stephantul in https://github.com/MinishLab/model2vec/pull/107
* fix: don't rely on reported vocab size, log warning if inconsistent by stephantul in https://github.com/MinishLab/model2vec/pull/109
* docs: Fixed broken links by Pringled in https://github.com/MinishLab/model2vec/pull/112
* feat: make encode_batch_fast optional by stephantul in https://github.com/MinishLab/model2vec/pull/113
* fix: normalize would lead to NaN for empty docs by stephantul in https://github.com/MinishLab/model2vec/pull/114
* docs: Add tokenlearn results by Pringled in https://github.com/MinishLab/model2vec/pull/116
* docs: Updated plot by Pringled in https://github.com/MinishLab/model2vec/pull/117
* Bump version by Pringled in https://github.com/MinishLab/model2vec/pull/118


**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.3.0...v0.3.1

What's Changed
* fix: Fix token type ids not supported by Pringled in https://github.com/MinishLab/model2vec/pull/77
* docs: Add deduplication tutorial by Pringled in https://github.com/MinishLab/model2vec/pull/72
* Fix distill model bos and eos token by zechengz in https://github.com/MinishLab/model2vec/pull/78
* docs: Added Sentence Transformers example code by Pringled in https://github.com/MinishLab/model2vec/pull/80
* docs: Update readme by Pringled in https://github.com/MinishLab/model2vec/pull/81
* docs: Move results and add blogpost by Pringled in https://github.com/MinishLab/model2vec/pull/82
* docs: Fixed broken link by Pringled in https://github.com/MinishLab/model2vec/pull/84
* fix: move tensor to cpu by stephantul in https://github.com/MinishLab/model2vec/pull/86
* feat: Numpy inference by stephantul in https://github.com/MinishLab/model2vec/pull/87
* feat: local loading by stephantul in https://github.com/MinishLab/model2vec/pull/88
* feat: faster tokenization by stephantul in https://github.com/MinishLab/model2vec/pull/89
* enhancement: Add dynamic version by stephantul in https://github.com/MinishLab/model2vec/pull/91
* enhancement: Add explained variance messages by stephantul in https://github.com/MinishLab/model2vec/pull/92
* docs: Updated slogan by Pringled in https://github.com/MinishLab/model2vec/pull/94
* feat: Add python3.9 support by Pringled in https://github.com/MinishLab/model2vec/pull/96
* enh: remove CLI command by stephantul in https://github.com/MinishLab/model2vec/pull/98
* fix: rename show progress bar argument by stephantul in https://github.com/MinishLab/model2vec/pull/99
* fix: Reverted eos bos change by Pringled in https://github.com/MinishLab/model2vec/pull/101
* docs: Added results link by Pringled in https://github.com/MinishLab/model2vec/pull/102
* docs: Fix broken link by Pringled in https://github.com/MinishLab/model2vec/pull/103
* increment version by stephantul in https://github.com/MinishLab/model2vec/pull/104

New Contributors
* zechengz made their first contribution in https://github.com/MinishLab/model2vec/pull/78

**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.2.4...v0.3.0