Chonkie

Latest version: v0.4.0

Safety actively analyzes 701533 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 3

0.2.0.post1

Breaking Changes

* Semantic Chunkers will no longer be taking in an additional `tokenizer` object, and would instead infer the tokenizer from the `embedding_model` passed. This is done to ensure that the `tokenizer` and `embedding_model` token counts always match as that is a necessary condition for some of the optimizations on them.

What's Changed
* Update Docs by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/14
* Update acknowledgements in README.md for improved clarity and appreci… by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/15
* Update README.md + fix DOCS.md typo by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/17
* Remove Spacy dependency from Chonkie by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/20
* Remove Spacy dependency from 'sentence' install + Add FAQ to DOCS.md by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/21
* Update README.md + minor updates by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/22
* fix: tokenizer mismatch for `SemanticChunker` + Add BaseEmbeddings by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/24
* Update dependency version of SentenceTransformer to at least 2.3.0 by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/27
* Add initial batching support via `chunk_batch` fn + update DOCS by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/28
* [BUG] Fix the start_index and end_index to point to character indices, not token indices by mrmps in https://github.com/bhavnicksm/chonkie/pull/29
* [DOCS] Fix typo for import tokenizer in quick start example by jasonacox in https://github.com/bhavnicksm/chonkie/pull/30
* Major Update: Fix bugs + Update docs + Add slots to dataclasses + update word & sentence splitting logic + minor changes by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/32

New Contributors
* mrmps made their first contribution in https://github.com/bhavnicksm/chonkie/pull/29
* jasonacox made their first contribution in https://github.com/bhavnicksm/chonkie/pull/30

**Full Changelog**: https://github.com/bhavnicksm/chonkie/compare/v0.1.2...v0.2.0.post1

0.1.2

What's Changed
* Make imports as a part of Chunker __init__ instead of file imports to make Chonkie import faster by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/12
* Run Black + Isort + beautify the code a bit by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/13


**Full Changelog**: https://github.com/bhavnicksm/chonkie/compare/v0.1.1...v0.1.2

0.1.1

What's Changed
* Update README.md by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/10
* Bump version to 0.1.1 in pyproject.toml and __init__.py by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/11


**Full Changelog**: https://github.com/bhavnicksm/chonkie/compare/v0.1.0...v0.1.1

0.1.0

What's Changed
* Disentangle the Embedding Model from SemanticChunker + Update DOCS and README by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/9


**Full Changelog**: https://github.com/bhavnicksm/chonkie/compare/v0.0.3...v0.1.0

0.0.3

What's Changed
* Bump version to 0.0.2 in pyproject.toml and __init__.py for release by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/6
* Update README.md + remove .github action by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/7
* Bump version to 0.0.3 in pyproject.toml and __init__.py for release by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/8


**Full Changelog**: https://github.com/bhavnicksm/chonkie/compare/v0.0.2...v0.0.3

0.0.2.post1

What's Changed
* Add support for Transformers and TikToken by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/4
* Update README.md by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/5
* Bump version to 0.0.2 in pyproject.toml and __init__.py for release by bhavnicksm in https://github.com/bhavnicksm/chonkie/pull/6


**Full Changelog**: https://github.com/bhavnicksm/chonkie/compare/v0.0.1a8...v0.0.2.post1

Page 2 of 3

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.