Bpetokenizer

What's Changed
* feat: from_pretrained enabled with wi17k_base by Hk669 in https://github.com/Hk669/bpetokenizer/pull/6

New PRs
* Hk669 made their first PR in https://github.com/Hk669/bpetokenizer/pull/6

**Full Changelog**: https://github.com/Hk669/bpetokenizer/compare/v1.0.32...v1.0.4

added the `mode` parameter in the `save` and `load` methods to help developers, save and load their vocab and the merges of the tokenizer in their desired format .

**Full Changelog**: https://github.com/Hk669/bpetokenizer/compare/v1.0.21...v1.0.3

**first release**

adds the following functionalities:

- BPETokenizer: which can be used to build your tokenizer for the LLM
- Tokenizer: a base class which leverages the save and load of the vocab and merges