Highlights
- No major change in using default parsers.
- If you're using a custom model, you need to update it. Read on the "Updating Models" section.
- The `defineClassAs` method in `javascript/src/html_processor.ts` is removed.
Updating Models
As described in 112, the model file structure has been updated for performance improvement and file size reduction. The change is simple; it just adds one layer depth by grouping features as the following example shows.
Before:
json
{"UW1:a": 123, "UW3:b": 271}
After:
json
{"UW1": {"a": 123}, "UW3": {"b": 271}}
You can update your custom model to the latest by running [scripts/translate_model.py](https://github.com/google/budoux/blob/2dfdc7699f430f5e48e78b7e98d7573997d19754/scripts/translate_model.py).
$ python translate_model.py --format=json old-model.json > new-model.json
What's Changed
* Nit fix on some test descriptions by tushuhei in https://github.com/google/budoux/pull/109
* Delete unused tsconfig by tushuhei in https://github.com/google/budoux/pull/110
* Add unit test for Web Components by tushuhei in https://github.com/google/budoux/pull/111
* Update the model structure for faster processing by tushuhei in https://github.com/google/budoux/pull/112
* Refactor feature_extractor by tushuhei in https://github.com/google/budoux/pull/113
* Use tempfile for unit test by tushuhei in https://github.com/google/budoux/pull/114
* Add model translator for ICU by tushuhei in https://github.com/google/budoux/pull/115
* Add a model format updater by tushuhei in https://github.com/google/budoux/pull/117
* Remove defineClassAs function by tushuhei in https://github.com/google/budoux/pull/119
* Remove unnecessary assertion by tushuhei in https://github.com/google/budoux/pull/118
* Remove skip nodes data from JS by tushuhei in https://github.com/google/budoux/pull/120
* Update the Prepare KNBC script to break chunks by specified sequences by tushuhei in https://github.com/google/budoux/pull/121
* Update JA model by tushuhei in https://github.com/google/budoux/pull/122
* Version Bump to 0.5.0 by tushuhei in https://github.com/google/budoux/pull/123
**Full Changelog**: https://github.com/google/budoux/compare/v0.4.1...v0.5.0