Ai21-tokenizer

Chore

* chore(release): v0.3.8 [skip ci] ([`645ff5e`](https://github.com/AI21Labs/ai21-tokenizer/commit/645ff5ea0ffda722dae0fd211bded29f75b72066))

Fix

* fix: readme example (56) ([`b713da8`](https://github.com/AI21Labs/ai21-tokenizer/commit/b713da8cdfe6434ac03cd25eaea7036ed172bf59))

Chore

* chore(release): v0.3.7 [skip ci] ([`a181ae6`](https://github.com/AI21Labs/ai21-tokenizer/commit/a181ae67bee062b1ac74633a0b6d37fc2a34c4fc))

Ci

* ci: workflow dispatch for release (54) ([`dbf5609`](https://github.com/AI21Labs/ai21-tokenizer/commit/dbf5609f63966804ea56e3c6b3e671498cd9feb3))

* ci: Automate pypi publish (53)

* ci: Automate pypi publish on new release

* fix: Remove comment

* fix: title of action

* fix: title of action ([`7c04fda`](https://github.com/AI21Labs/ai21-tokenizer/commit/7c04fdab10f57c4ed61ce974a5f98ed2b5ec0abd))

Fix

* fix: Examples in readme (55)

* ci: workflow dispatch for release

* docs: Updated readme with more examples

* docs: Added docs to base class ([`94f3a3c`](https://github.com/AI21Labs/ai21-tokenizer/commit/94f3a3c9539346ac1bc501f6c83ce1e3525d055a))

Chore

* chore(release): v0.3.6 [skip ci] ([`550644d`](https://github.com/AI21Labs/ai21-tokenizer/commit/550644d181a36eb9a2d4312959a27a04743cde25))

Ci

* ci: added python version to pypi publish (50) ([`83cbbea`](https://github.com/AI21Labs/ai21-tokenizer/commit/83cbbeaa2626ff0adfc10a4d325a345322fade70))

* ci: exclude changelog (48) ([`9222c55`](https://github.com/AI21Labs/ai21-tokenizer/commit/9222c5566b8d220ca70e9c1eb6ed6aec679c9873))

Documentation

* docs: CODEOWNERS (49) ([`1e6513b`](https://github.com/AI21Labs/ai21-tokenizer/commit/1e6513badd83cde1b48da6dcf5c31ae0ec1795c3))

Fix

* fix: support ai21_tokenizer.__version__ (52) ([`13944eb`](https://github.com/AI21Labs/ai21-tokenizer/commit/13944eb7a8ae540e0be329abb12920e374c62b23))

Chore

* chore(release): v0.3.5 [skip ci] ([`217b14e`](https://github.com/AI21Labs/ai21-tokenizer/commit/217b14ef23e7e63da9e0de5896bb002dcf89697d))

Fix

* fix: newline n and prettier (47)

* fix: newline n and prettier

* fix: exclude

* fix: exclude from pretty ([`f5c9204`](https://github.com/AI21Labs/ai21-tokenizer/commit/f5c920422c31b671d09af43758560dd2779ac358))

Chore

* chore(release): v0.3.4 [skip ci] ([`be67c79`](https://github.com/AI21Labs/ai21-tokenizer/commit/be67c79136f6d1c284cb4f373d39fb0ef903733a))

Fix

* fix: newline r (46) ([`bc97ae1`](https://github.com/AI21Labs/ai21-tokenizer/commit/bc97ae14d403ee6e4313a1b313ea328dfe265a8a))

Chore

* chore(release): v0.3.3 [skip ci] ([`f6db520`](https://github.com/AI21Labs/ai21-tokenizer/commit/f6db5207bcf415f1b89bb3270fc1a7dbe6dc8031))

Ci

* ci: on push release (43) ([`95bfc95`](https://github.com/AI21Labs/ai21-tokenizer/commit/95bfc951906f79b0cdfea7544b4bb49222ae19a6))

Documentation

* docs: readme (44) ([`af23ac4`](https://github.com/AI21Labs/ai21-tokenizer/commit/af23ac4442cb358809aa27d4cfd2fecb95060044))

Fix

* fix: setup (45) ([`1b8c00f`](https://github.com/AI21Labs/ai21-tokenizer/commit/1b8c00f3240e94237f084202fd77ee8c7ef5a726))