G2p

[1.0.20230412](https://github.com/roedoejet/g2p/compare/v1.0.20230228...v1.0.20230412) (2023-04-12)


⚠ BREAKING CHANGES

* put network_to_echart where we can test it properly

Features

* add -a/--substring-alignments argument to cli ([6b41213](https://github.com/roedoejet/g2p/commit/6b41213b58be0dcfcfcd0ffb65472f2fd27668cd))
* add accessors for useful things like the input and output languages ([cacce3b](https://github.com/roedoejet/g2p/commit/cacce3b97286110a8462da60eed60078f1740a13))
* add aligned cmudict and lexicon transducer type ([596ab82](https://github.com/roedoejet/g2p/commit/596ab8286382ec943a0ed25ad97f7491c9b491f4))
* add alignments method to get textual alignments ([e2303f4](https://github.com/roedoejet/g2p/commit/e2303f4c4246a0b356c2277f44223caa70413166))
* add edges for alignments in lexicon ([f2c9f6c](https://github.com/roedoejet/g2p/commit/f2c9f6cbe0a46b92367e0e009990bebb09515078))
* add proper typing to compose_indices ([7bbfb6d](https://github.com/roedoejet/g2p/commit/7bbfb6da580ab61c0e69ffc76d4a82da1133e7f8))
* add type checking and use Tuples (as they can be type checked) ([4780702](https://github.com/roedoejet/g2p/commit/47807024c0c1e3c2ae15b834b050ca20411bb6e1))
* language name for spelling variants describe the variant ([ffba389](https://github.com/roedoejet/g2p/commit/ffba389713889c222a071f9fd97f544c673e9434))
* make the use of None explicit and limited ([97aaed5](https://github.com/roedoejet/g2p/commit/97aaed5fabe9bf71e85ca49046e5c828350703f2))
* make TransductionGraph and CompositeTransductionGraph compatible ([e00790a](https://github.com/roedoejet/g2p/commit/e00790ad0c16a54e4d6fc282c9239933b3047da9))
* output monotonic alignments for deletions and reorderings ([126aa83](https://github.com/roedoejet/g2p/commit/126aa83119698f8f0e77c82b316c98a6aa4c5a31))
* properly normalize edges on concatenation ([f37897c](https://github.com/roedoejet/g2p/commit/f37897c838d6e87e6bffed5ee9fc9612daef0ffc))
* shrink pickle by optimizing alignment storage ([0860ad6](https://github.com/roedoejet/g2p/commit/0860ad6e8e71099a95551bc7a2c0bbee2e479268))
* support lexicon mappings in Studio (but they are slow) ([c824f6b](https://github.com/roedoejet/g2p/commit/c824f6bc586772ac7149a3193e70e7a89b5236f9))
* switch script to use phonetisaurus from PyPI ([bb91b12](https://github.com/roedoejet/g2p/commit/bb91b1246f7fadb810db2894e3490a5a5c4c3c98))


Bug Fixes

* add spaces and avoid formatting ([a5c2894](https://github.com/roedoejet/g2p/commit/a5c2894e04475704e03d3da74ada738be28f7bff))
* avoid crashing on empty edges ([8d57e68](https://github.com/roedoejet/g2p/commit/8d57e68d4927e58add7305aa4f50cdcf94d59488))
* avoid creating None in input position ([404306d](https://github.com/roedoejet/g2p/commit/404306d2682ff8dda9ec09d329178290315721cd))
* comment and clean up substring_alignments ([9cd84d8](https://github.com/roedoejet/g2p/commit/9cd84d8c79879dde60f5b75d6a57f5ff2c5d6932))
* disable the utf8 fix for windows when running in pytest ([bd5690a](https://github.com/roedoejet/g2p/commit/bd5690a14eea28c61e84e04c0db4cf130ce64bc8)), closes [#241](https://github.com/roedoejet/g2p/issues/241)
* do not call logging.basicConfig, just config the logger itself ([8ff314f](https://github.com/roedoejet/g2p/commit/8ff314fdaa2e08c33aa2ad0f309db0818a1d5a74))
* emit input unchanged when no transducers exist ([b0db10e](https://github.com/roedoejet/g2p/commit/b0db10e44ff5800f6938a9ab8dfd6cf201591d04))
* fix doctor ([0b0f2ed](https://github.com/roedoejet/g2p/commit/0b0f2edb99de004e6a1b8a5e2d8e272b59420e9e))
* fix speed issues by not deep-copying alignments ([56e933b](https://github.com/roedoejet/g2p/commit/56e933bba6e537442040ac03f3f9833d1c0cf5df))
* make pretty_edges consistent and fix tests to expect tuples ([065fa23](https://github.com/roedoejet/g2p/commit/065fa2341aa57b09b20638a4c0864879531605a2))
* make sure we do not output bogus edges ([fab9f0a](https://github.com/roedoejet/g2p/commit/fab9f0a55ffcb8b815e3fc738f25caa31595444d))
* most sensible possible behaviour, keep spaces if user wanted them ([70ab1e6](https://github.com/roedoejet/g2p/commit/70ab1e61e67d2684d350c6dcb7f74b8cc14d68bd))
* remove impossible try/catch ([2db239a](https://github.com/roedoejet/g2p/commit/2db239a2793b3824c45bed0fa7e62cdc02f401bc))
* remove spaces in `sanitize_unidecode_output` as suggested by [littell](https://github.com/littell) ([bd1b1ec](https://github.com/roedoejet/g2p/commit/bd1b1ece13ce7c596608b56f2897ad301a622c59))
* remove spontaneous extraneous spaces from und-ipa ([9e64b7f](https://github.com/roedoejet/g2p/commit/9e64b7fa98141336aedb11d8d7a07932c7fcd143))
* remove unnecessary default value ([722215a](https://github.com/roedoejet/g2p/commit/722215afac4e28bc1698b13e88aa709310ba1e5d))
* restore original edges API and rename alignments ([c054256](https://github.com/roedoejet/g2p/commit/c05425661b301816bd49cb1b3de30cfce447b254))
* switching back to Custom did not actually work ([7f0f640](https://github.com/roedoejet/g2p/commit/7f0f640a8332293d7ccbe79e6153b9892717de2a))
* the only special character we want to escape is ? ([7af2f0b](https://github.com/roedoejet/g2p/commit/7af2f0bb54252b13cb60316f29bae4ca438df823))
* update treatment of deletions in lexicon to match rules ([18bdc6b](https://github.com/roedoejet/g2p/commit/18bdc6ba1260a402f8845030dc5c56b23fd9b646))
* use OrderedDict explicitly for clarity ([d2ef567](https://github.com/roedoejet/g2p/commit/d2ef5677ec8530a8fe99a237ec88629bf687b729))


Documentation

* add documentation for lexicon mappings ([dcf5973](https://github.com/roedoejet/g2p/commit/dcf597310d6babc1d5a17f95486e5e9af656f136))
* add links to non-packaged files ([9d6275c](https://github.com/roedoejet/g2p/commit/9d6275c0df1d4369e543fc5539eaa0f358361bfb))
* clarify use of generic type ([7bb7df6](https://github.com/roedoejet/g2p/commit/7bb7df638dfe25a00f907c57e068268ed9128e64))
* clean up docstrings ([91aa3b3](https://github.com/roedoejet/g2p/commit/91aa3b3f9bedb42841f107ed00ffe5508ce1b8b7))


Tests

* add alignment tests and improve coverage for tranducers ([76f85dd](https://github.com/roedoejet/g2p/commit/76f85dd831a9dfce62892ab5cfc1e01ae04d3a2d))
* add coverage of invalid regex in rule ([bd81a70](https://github.com/roedoejet/g2p/commit/bd81a70b3822686ecdb17aee9727fb12e88477fd))
* add coverage to studio tests and app ([0945336](https://github.com/roedoejet/g2p/commit/09453367cb98aef8eba3a1b155aa11e635737bd0))
* add test of lexicon loading from config file ([22de19b](https://github.com/roedoejet/g2p/commit/22de19b209666ac10396cb6e412cd90e558a91c5))
* fix studio test ([31c9e48](https://github.com/roedoejet/g2p/commit/31c9e485b4629647589fa114c2a2e0635f24c7a1))
* long delay no longer necessary ([33efc1e](https://github.com/roedoejet/g2p/commit/33efc1ef1254d2e2d87e62496e102c430068f05d))
* make test_tokenizer.py exercise tce and unknown lang and default ([1da815b](https://github.com/roedoejet/g2p/commit/1da815ba669a0518bbbbf975610afb2ea4d03eff))
* run the expensive doctor test because it can catch errors ([bb60f55](https://github.com/roedoejet/g2p/commit/bb60f5536cc8ef461e67b773b0e11a3ebc0b9855))
* update lexicon test for eng ipa ([f05a513](https://github.com/roedoejet/g2p/commit/f05a5139ceb72f9f817cedba1a00372967b599e8))


Code Refactoring

* add explicit b, m, p, u rules to moh for borrowed words ([2dc5e42](https://github.com/roedoejet/g2p/commit/2dc5e42032a85028428049d502cf48964135fd1e))
* put network_to_echart where we can test it properly ([970e358](https://github.com/roedoejet/g2p/commit/970e358f3d10765b63571bf9e293ffc93451ac9f))
* remove superfluous list comprehension ([dd8f5df](https://github.com/roedoejet/g2p/commit/dd8f5df91b7aba317a8737b4d8c6ac7a2b12df4c))
* **test:** when a mapping fails, show test case filename:lineno ([fb309ec](https://github.com/roedoejet/g2p/commit/fb309ec4f61a6a87acdc5ddf1516bcadc2a66363))
* **tests:** quiet yappy test suites ([c6423b6](https://github.com/roedoejet/g2p/commit/c6423b6f3d71c2c5f1d19b5c8e9ec1c3066fec40))


Styles

* all other badges are rounded, why not the readme one? ([ba76f57](https://github.com/roedoejet/g2p/commit/ba76f570c74899e145bdbb91627583b72209adf2))
* rewrite moh_equiv and moh_to_ipa in compact form ([c781cbe](https://github.com/roedoejet/g2p/commit/c781cbee7661b940cdc4ff766e97e1308fdc780f))


Continuous Integration

* replace deprecated actions/create-release by ncipollo/release-action ([43d1060](https://github.com/roedoejet/g2p/commit/43d10608abbd9c1cc5e4c42fa243571321f4e0b7)), closes [#200](https://github.com/roedoejet/g2p/issues/200)
* replace deprecated set-output and bump github-tag-action ([8b40a1b](https://github.com/roedoejet/g2p/commit/8b40a1b335c374c1b8eb761dec2f38ee1355c511)), closes [#200](https://github.com/roedoejet/g2p/issues/200)

[1.0.20230228](https://github.com/roedoejet/g2p/compare/v1.0.20230224...v1.0.20230228) (2023-02-28)

Bug fixes

* Fix to Han/Kanji characters in Und ([6e248a08de](https://github.com/roedoejet/g2p/commit/6e248a08de7886898ce49c31613907cc53d117d4))

[1.0.20230224](https://github.com/roedoejet/g2p/compare/v0.5.20221013...v1.0.20230224) (2023-02-24)


Features

* add nsy mapping for the nsyilxcən Language ([8d7f04c](https://github.com/roedoejet/g2p/commit/8d7f04c396387939962627bed2a9955b48f6c71f))
* improve the g2p-studio static page ([79d4257](https://github.com/roedoejet/g2p/commit/79d425702d870adc1bbfd07f3b6c93f453e26454))


Bug Fixes

* **mappings:** bullet operator -> middle dot ([f5b3d06](https://github.com/roedoejet/g2p/commit/f5b3d0632340f10bbe5d2b9c498d62aec9797a54))
* **studio:** upgrade heroku stack and python runtime ([b10abee](https://github.com/roedoejet/g2p/commit/b10abeee60ec5bffe543b93167f769e843aff424))
* address CWE-830 by adding integrity to scripts from cloudflare ([00ccd31](https://github.com/roedoejet/g2p/commit/00ccd3107acee615537a940a7bec1615fc6a88c4))
* generate swagger.json the way our pre-commit hooks want it ([0373abe](https://github.com/roedoejet/g2p/commit/0373abe1dd0df5d5275512f05ff4e72cd8f865b1))
* in 2022, "python" is Python 3 ([38c41da](https://github.com/roedoejet/g2p/commit/38c41daeb13e7fa33a2ea7a4a7a536e82defbcc8))
* in 2022, "python" is Python 3 and "pip" works in CI ([f2b892a](https://github.com/roedoejet/g2p/commit/f2b892a0abfb228691cdb05e016fff1a6879763f))
* on Windows, make generated files out LF so they're not spuriously changed ([0613906](https://github.com/roedoejet/g2p/commit/06139066f644912feda7a83eb359a91f6dded7ff))
* **ci:** add codecov token to ci tests ([2fbfe06](https://github.com/roedoejet/g2p/commit/2fbfe064266717b337add785765c6e6da0e50d32))
* **ci:** change ubuntu version ([48158a2](https://github.com/roedoejet/g2p/commit/48158a21dbfb4ed12020a5395df6ae52a8eb2a11))
* **nsy:** add glotal stop self-map so g2p knows it is an nsy letter ([05a9c75](https://github.com/roedoejet/g2p/commit/05a9c75dcd96ef0e3aae8898a97db228f87a4467))
* **nsy:** fix the nsy->nsy-ipa mapping to the picky requirements of g2p ([b6d5389](https://github.com/roedoejet/g2p/commit/b6d538996f5134c1d5ac0fa85792f6299f01b3bb))
* **nsy:** handle a few more spelling variants ([2a51896](https://github.com/roedoejet/g2p/commit/2a5189699c359c523c79822f9e79c80c6d4a3a18))
* make Undetermined (und) process Arabic characters correctly ([53dded4](https://github.com/roedoejet/g2p/commit/53dded4576d86c4728409021b85b7693736bb52b))
* **reqs:** update flask to avoid werkzeug error ([361c936](https://github.com/roedoejet/g2p/commit/361c936fc95e4e1e4554dba1760f79cf29b2bdd4))


Performance Improvements

* collapse loops ([809adaa](https://github.com/roedoejet/g2p/commit/809adaaefae06564e0d8b1b3756c99c48daefe71))


Code Refactoring

* change Nsyilxcən code to oka in all the files too ([b5b3a60](https://github.com/roedoejet/g2p/commit/b5b3a6010503ce8512ea6dd9f01e7f534527f412))
* change to main ([1ad9a98](https://github.com/roedoejet/g2p/commit/1ad9a984a0dfc0bbee81600d1fd086bc181c1ac0))
* create class mg-bot for cleaner bottom margin implementation ([cb4ab03](https://github.com/roedoejet/g2p/commit/cb4ab03036ba076d2a70b6ecf0de37c0d79ebd02))
* rename nsy->oka to the official iso-6639-1 code for Nsyilxcən ([f0b5bd6](https://github.com/roedoejet/g2p/commit/f0b5bd684ee0e7b5635255cd8320b96057312813))
* **docs:** use unpkg for fetching swagger ui ([297b069](https://github.com/roedoejet/g2p/commit/297b069dcbaf01d40b4d1ca37e90477504dfd736))


Styles

* apply a number of pylint recommendations ([2e9b067](https://github.com/roedoejet/g2p/commit/2e9b067c1b29c855fded4a9556d434cccede8738))
* let git blame ignore black and isort only commits ([56896de](https://github.com/roedoejet/g2p/commit/56896de7c61e98a5f499f97ed9e034f8213eec43))


Tests

* add --describe option to run.py and exit 1 on error ([6b560f0](https://github.com/roedoejet/g2p/commit/6b560f030e8023e460c470a944b99b9335836091))
* test that eng-ipa->eng-arpabet works ok with NFC and NFD inputs ([2712b32](https://github.com/roedoejet/g2p/commit/2712b3253b1f5be2aa32fd8f60139780ebbbc53d))
* use NFD output in fn_unicode test cases ([a51bb46](https://github.com/roedoejet/g2p/commit/a51bb466b49538bbb865add4eaf006c66f69863e))
* **nsy:** add references to most entries in nsy.csv ([e7f7726](https://github.com/roedoejet/g2p/commit/e7f7726185421e47b9244165b9fbc60d215a39b3))
* **nsy:** fix the last word (question mark -> glottal stop) ([946d7c3](https://github.com/roedoejet/g2p/commit/946d7c31d9c9e9b39fe5a325d540c3cd02362b0e))


Continuous Integration

* add CodeQL automated vulnerability scanning ([9fc96fd](https://github.com/roedoejet/g2p/commit/9fc96fd0266647dba7ce48b4afc6074003cb6d98))
* bump CI actions to current to heed GitHub warnings ([4858bbb](https://github.com/roedoejet/g2p/commit/4858bbb41e9e6dd37662d57adc48b40fa59c2039))
* g2p codecov action does not use dir ([8880845](https://github.com/roedoejet/g2p/commit/888084540ee0950e2ef0b0a174be256b5595c521))
* only run CodeQL on cron and push to master and release ([11aaff4](https://github.com/roedoejet/g2p/commit/11aaff43bbeb7d1e3058bea3c2545a003d3f7baa))
* stop failing CI when codecov fails to upload ([557fc3d](https://github.com/roedoejet/g2p/commit/557fc3dae500c1509b251a912183ab757bb6ac02))
* use ubuntu-20.04 since ubuntu-latest no longer supports Python 3.6 ([cb91794](https://github.com/roedoejet/g2p/commit/cb91794ae52809af9906f9489af844de05e64abf))

[0.5.20221013](https://github.com/roedoejet/g2p/compare/v0.5.20220318...v0.5.20221013) (2022-10-13)


Features

* add dummy mappings for english and mohawk ([eaf2c70](https://github.com/roedoejet/g2p/commit/eaf2c704e20628b9aad9856c4a6c18d6dcd82f79))
* add dummy mappings for english and mohawk ([85d06f0](https://github.com/roedoejet/g2p/commit/85d06f0929e9eef703182581d2a720890124a616))
* add iku-ipa to hamming-eng-ipa mapping ([9ae5484](https://github.com/roedoejet/g2p/commit/9ae5484c127106c3dbd7edd9ba9ba97e467b3074))
* add und and str dummy mappings as well as distance specification for mapping alignment ([7f93447](https://github.com/roedoejet/g2p/commit/7f93447ac1d2fc953354e32c627b753cd245be6f))
* **mappings:** added more dummy mappings ([d89f5b7](https://github.com/roedoejet/g2p/commit/d89f5b7b20bd105cc292231ee9e5afd62ab65c0a))
* add und-ipa to hamming-eng-ipa ([7cf4118](https://github.com/roedoejet/g2p/commit/7cf4118ddf3e47a46068a225c3b194003ca05e1c))
* basic Finnish mapping ([36d17e0](https://github.com/roedoejet/g2p/commit/36d17e0f670361532b9eec5f6e0268196937bd86))
* check Python version ([9e086e1](https://github.com/roedoejet/g2p/commit/9e086e1e0f0e86851bfeb899776a6ad5de11948c))
* do arpabet checking for hamming-eng-arpabet too ([11728ec](https://github.com/roedoejet/g2p/commit/11728ec315abdfe68643ddd58935c5ac031e6932))
* include NFC/D normalization in g2p graph ([f3b918c](https://github.com/roedoejet/g2p/commit/f3b918cb5258798eb340c5a48e6d51d6e28188d6)), closes [#158](https://github.com/roedoejet/g2p/issues/158) [#158](https://github.com/roedoejet/g2p/issues/158)
* und now maps colon to an empty string ([0b8c8d9](https://github.com/roedoejet/g2p/commit/0b8c8d949da6fd3b2ab1e3475dd85d7662114be6))
* **mappings:** allow abbreviations to be declared recursively ([e1a270f](https://github.com/roedoejet/g2p/commit/e1a270fccac700c55c9f3fc6cb19f8613bec1ca1))
* **show-mappings:** add --csv option ([43573ac](https://github.com/roedoejet/g2p/commit/43573ac643783d22a6a8240a1824631431b9fe00))
* **show-mappings:** added cli cmd g2p show-mappings ([9b2e489](https://github.com/roedoejet/g2p/commit/9b2e48964167c071db42127443990b84819a4cd8))


Bug Fixes

* **studio:** sort nodes in language echart ([11b92f2](https://github.com/roedoejet/g2p/commit/11b92f222a336754144f25a3e67d0fedaeedc54c))
* accept single or multiple mappings in config.yaml ([0c4961f](https://github.com/roedoejet/g2p/commit/0c4961faaa3604cbe2269dfbf6ada014d310438b))
* always declare your file encoding, or Windows barfs ([67de22f](https://github.com/roedoejet/g2p/commit/67de22fb347f12fe4e495bbe62af8ba1a751cd6a))
* always declare your file encoding, or Windows barfs ([56e327b](https://github.com/roedoejet/g2p/commit/56e327b3d5eb28c03dd168794635f66fd271303b))
* avoid failure on corrupted pickles ([6f30f0e](https://github.com/roedoejet/g2p/commit/6f30f0e52b333c1738a33eb259861b7255136f12))
* catch same input and output g2p mapping bug ([0a9d141](https://github.com/roedoejet/g2p/commit/0a9d14190011f307d298ded3a8b1fbc50bda2a1f))
* correct fin diphthong mappings slightly ([b8ae37d](https://github.com/roedoejet/g2p/commit/b8ae37da7525643cd306e11ab36a766f0aff1576))
* doh! always run the test suites before pushing your changes... ([6af7d5e](https://github.com/roedoejet/g2p/commit/6af7d5e0676fdf5ed0ba9212736768b436b8c370))
* edit fin-ipa to eng-ipa mappings to fix some vowels ([19a9189](https://github.com/roedoejet/g2p/commit/19a91891141f4d46796f4b9845737f0326470649))
* ensure python g2p/mappings/langs/__init__.py can always run ([ea45afa](https://github.com/roedoejet/g2p/commit/ea45afa8148ed9f805ad6ea808d67bc410fc5a19))
* find language_name robustly ([4e0ccb9](https://github.com/roedoejet/g2p/commit/4e0ccb99fa0fc1b0af452497ffd31a9214a05b46))
* g2p show-mappings -v show in, out, rest, in that order ([da06abd](https://github.com/roedoejet/g2p/commit/da06abdba55f5ae012513fb0e3bc9fcf3ead05a2))
* generated mappings should prevent feedback and apply-longest-first ([d10944a](https://github.com/roedoejet/g2p/commit/d10944a47898a8218c76275525c41d0c77550de8))
* grammar ([e14cbcd](https://github.com/roedoejet/g2p/commit/e14cbcdc853dab4e61a859f77f4ee3c942bda4b8))
* lock click==8.0.4 since we support Python 3.6 ([f941c64](https://github.com/roedoejet/g2p/commit/f941c64bed810c7bb6fb2a60dedb176a991404f2))
* make make_tokenizer disambiguate in_lang and tok_path ([9e7f986](https://github.com/roedoejet/g2p/commit/9e7f98619bf7bb6f12342ce7ebc42a1a07e8a1e1))
* make Mohawk tokenizer recognize colon as a letter ([767fed4](https://github.com/roedoejet/g2p/commit/767fed460388c79100ec35f9f84864e957ed0d04))
* make Mohawk tokenizer recognize colon as a letter ([a32a3a7](https://github.com/roedoejet/g2p/commit/a32a3a7468a4af0acd05e9cfd2a9bdaaa91dba9d))
* make und work in g2p studio ([0dd3e25](https://github.com/roedoejet/g2p/commit/0dd3e2537cacef94fb2ddcb95a445436470074c1)), closes [#165](https://github.com/roedoejet/g2p/issues/165)
* mic "o" didn't get mapped to proper eng-arpabet ([1373b41](https://github.com/roedoejet/g2p/commit/1373b414bad5789f3e00187de5ccc63a9cb64d7d))
* name g2p in package.json, not readalongs ([b18eea8](https://github.com/roedoejet/g2p/commit/b18eea81acda306445c378ebab06b9b22d0843d3))
* recreate langs.pkl to allow merging ([387c6fc](https://github.com/roedoejet/g2p/commit/387c6fc5021cc63ef2ed27e59c373815b551584a))
* remove stray BOMs everywhere ([3c0f13b](https://github.com/roedoejet/g2p/commit/3c0f13b28e23becd3fca782f2adce4e8a6ad32a5))
* supported renamed dolgo/dogol distance in panphon ([0c73399](https://github.com/roedoejet/g2p/commit/0c73399253b027a494db881c491d037cedaecf29))
* **indices:** handle orphan characters with heuristic of attaching to index of previous character if it exists, otherwise attaching to the index of the following character, if no characters exist before or after, then none type is returned. Fixes [172](https://github.com/roedoejet/g2p/issues/172) ([b1ca2cb](https://github.com/roedoejet/g2p/commit/b1ca2cb066124bace5e7d737ce8af62f29789abf))
* **moe:** add self-mappings for k, m, n, p, s, t ([a82d098](https://github.com/roedoejet/g2p/commit/a82d098363f6d8c7165135904d9be6e9142a9b54))
* regenerate mappings and configs ([0d71872](https://github.com/roedoejet/g2p/commit/0d7187258c17a8f875c9fe02b3779a1d08324e8f))
* remove UTF-8 BOM and CRLF (will fix code separately) ([5806ab9](https://github.com/roedoejet/g2p/commit/5806ab9a94bfbb8e03dbdb78bb7349f3cdfdf26a))
* rules with alternations should tokenize correctly ([9fd6407](https://github.com/roedoejet/g2p/commit/9fd64078da9ce14cf04c8047725fb9f932a85f34))
* show default directory in help ([679ffe1](https://github.com/roedoejet/g2p/commit/679ffe19e4988348ee9eeb4dcc25bf33b79fdd3b))
* tell user to rerun g2p update (they can) ([eeac7dd](https://github.com/roedoejet/g2p/commit/eeac7dd44812306d6221cc20ae6764d303483c61))
* tli_equiv and tce_equiv had BOMs, update to remove them ([5b5d0b5](https://github.com/roedoejet/g2p/commit/5b5d0b50436cb7b8e893d68364d28837c87b53cc))
* use an automatically generated mapping for moe-ipa -> eng-ipa ([1bc9b05](https://github.com/roedoejet/g2p/commit/1bc9b05a3ad5a1454c3fd7d15e863d609935b25b))
* **ci:** trailing space for json ([a58c205](https://github.com/roedoejet/g2p/commit/a58c205352c0955d124608c73ce863b2ddaa7daf))
* **git:** make fixes to ejective mappings ([27003e2](https://github.com/roedoejet/g2p/commit/27003e2ed74ef9144ad2b4866129033f980a51df))
* **indices:** fix numerous errors within the indices functionality ([7a6c631](https://github.com/roedoejet/g2p/commit/7a6c6318b4cab9c532e4304697ddc792aac1911a))
* **mappings:** fix normalization issues in win and eng mappings ([fd2bb0f](https://github.com/roedoejet/g2p/commit/fd2bb0fbc19ba44868e2764a307baff607ec65b1))
* **moe:** remove two more duplicate rules ([bd36902](https://github.com/roedoejet/g2p/commit/bd3690221d87ccc6f7c9eb494de80fe7c45f8979))
* **studio:** updated reverse initialization and rule ordering values ([2c9c61f](https://github.com/roedoejet/g2p/commit/2c9c61f26a651edeb540fb1345d57fa3d944dfbf))
* **win:** use the \u02D0, not :; use prevent-feeding ([80f80da](https://github.com/roedoejet/g2p/commit/80f80da073ed529f4215042d050187493448ac0b)), closes [#100](https://github.com/roedoejet/g2p/issues/100)
* update mappings ([1cba84f](https://github.com/roedoejet/g2p/commit/1cba84f2ed0d28f77a5b744a95029d7c8ce00fe4))
* use longest mapping for fin ([12dc3da](https://github.com/roedoejet/g2p/commit/12dc3da280e96676f25aef64a4c58bbe64f348e3))
* warn of missing language_name before caching ([3eb0ed7](https://github.com/roedoejet/g2p/commit/3eb0ed7387d5395d8ccb4400f5630eba5a72a010))
* write compact json rules with in+out first, then rest ([e9cb0e6](https://github.com/roedoejet/g2p/commit/e9cb0e6492572af2606c87e7feaa0b4bca7021e1))


Performance Improvements

* **dockerfile:** bump the OS to bullseye and optimize the build ([20f1926](https://github.com/roedoejet/g2p/commit/20f192624a7707fe2c763bdf32995d6cdd143f09))
* **test:** speed up test_studio by minizing keyup events ([4dad4d5](https://github.com/roedoejet/g2p/commit/4dad4d5cd119844542d22220a4c98c4277f4b954))


Reverts

* revert accidental removal of moe generated mapping ([e11db2f](https://github.com/roedoejet/g2p/commit/e11db2fa0d7b82fc87dd89dfe561b16b5e9cd5cb))


Build Systems

* Dockerfile should update pip before using it ([3ca1ea2](https://github.com/roedoejet/g2p/commit/3ca1ea26be49d76841551212256fa026c57eee46))
* move flake8 config to setup.cfg ([b637ac8](https://github.com/roedoejet/g2p/commit/b637ac80537e6846b501f5454f04ebba4f6ab612))


Continuous Integration

* add CI job to run tests on Windows ([f4e5dc3](https://github.com/roedoejet/g2p/commit/f4e5dc324358be89d00702381f63ed972dbc9ea8))
* adjust coverage configuration for CI and manual testing ([907e4f1](https://github.com/roedoejet/g2p/commit/907e4f179a184cbc1175374586683f57fc94adca))
* before a release, do full os/pyversion matrix testing ([e01319f](https://github.com/roedoejet/g2p/commit/e01319fee269b2c80579ba880ad9ec2c92d4414f))
* publish with build instead of calling setup.py directly ([a1a024f](https://github.com/roedoejet/g2p/commit/a1a024f0ad9b883fe40280b9cb3c260e2b3680d3))
* quote python versions so 3.10 works ([528ea8c](https://github.com/roedoejet/g2p/commit/528ea8c0fbf9ad2f6dde10f47ce3237052e0d597))
* run full matrix CI only on PRs to release ([888404c](https://github.com/roedoejet/g2p/commit/888404c280cd1609ebe2fbae324d4974821dbc28))
* run the CI tests on pull requests too ([bb88b9b](https://github.com/roedoejet/g2p/commit/bb88b9b6f080c55b281e32ce23f8189d21073b29))
* skip CI tests for commits with no-ci in the message ([5393045](https://github.com/roedoejet/g2p/commit/5393045cbba3c67cb5b883671c8815401042f0bc))
* tests workflow should update pip ([49abd45](https://github.com/roedoejet/g2p/commit/49abd452201aacb59ce697bd15781cde449f0ac4))
* **test-studio:** adjust to test-studio CI workflow ([bb03712](https://github.com/roedoejet/g2p/commit/bb0371256ba60516e9b93aa548bb038aaa605512))


Tests

* **tokenizer:** more unit testing for refactored tok ([119d2b7](https://github.com/roedoejet/g2p/commit/119d2b7ef6896dbe1dd61030edd04025323832b4))
* fix typo testing create_multi_mapping ([3d7d23d](https://github.com/roedoejet/g2p/commit/3d7d23d923c46a05deecd0025dbbfc1cb8b632a4))
* **show-mappings:** unit testing for show-mappings ([36f4996](https://github.com/roedoejet/g2p/commit/36f499666ba6b565cfe4307b4099301ea6d96258))
* add eng-ipa and eng-arpabet tests ([e5ed8b8](https://github.com/roedoejet/g2p/commit/e5ed8b8fca1de93e4de0240957919a02353fd1b4))
* add fin tests ([6c608af](https://github.com/roedoejet/g2p/commit/6c608af28897e1a81a7f7ae6d22530a22d0beca0))
* allow testing update on input/output directories ([eacd5de](https://github.com/roedoejet/g2p/commit/eacd5de15ec1d2d7922fc347f9211901431203c1))
* exercise win ejectives being removed from eng ([6a69f60](https://github.com/roedoejet/g2p/commit/6a69f606d4838bac4e5f8a4bd747794a57ba0591))
* fix fin test ([3639f69](https://github.com/roedoejet/g2p/commit/3639f69bca278ff053a03a4b20d2c5447914d2b3))
* hopefully fully test everything ([699ba10](https://github.com/roedoejet/g2p/commit/699ba10096f4de701f4a26f2f9401ff91866f5c2))
* proper e2e tests for studio ([5692a93](https://github.com/roedoejet/g2p/commit/5692a93dc0fe895b9fed597112d1d274050def44))
* silence expected warnings by asserting them ([5fd2be8](https://github.com/roedoejet/g2p/commit/5fd2be8ce588cdde409ac88dcea9882ead44c355))
* update fin tests ([9ac849f](https://github.com/roedoejet/g2p/commit/9ac849ffa50221db52014fc6bc892b252ad2deca))
* **studio:** make the test_studio.py test suite more robust ([303b794](https://github.com/roedoejet/g2p/commit/303b79442efc6044c24508d3f1567313b74f5304)), closes [#195](https://github.com/roedoejet/g2p/issues/195)


Documentation

* add citation ([7416775](https://github.com/roedoejet/g2p/commit/74167758507f1cd4a851bafaa0368a274fbfa5f5))
* add citation to table of contents ([1713e0c](https://github.com/roedoejet/g2p/commit/1713e0c4b1b5c24a4235a343f6b32a017378d587))
* add CITATION.cff file ([a9abc07](https://github.com/roedoejet/g2p/commit/a9abc07d86482c8f4854ecaa5cddc6dd656a7361))
* add minimal coding docs to __init__.py ([8593aa2](https://github.com/roedoejet/g2p/commit/8593aa2ea461b10fe0564d8b472408a1adf02165))
* add plain text citation and update name ([bf5889c](https://github.com/roedoejet/g2p/commit/bf5889cba1a669b2f02454411c31070969701332))
* add See also section in README.md TOC ([517b190](https://github.com/roedoejet/g2p/commit/517b1906ceefad8faa151f93ae12fed960ad6305))
* fix help text for g2p update -o ([c23fcf3](https://github.com/roedoejet/g2p/commit/c23fcf3141d5e42a10dc5153405f55c0643fce26))
* let run_studio.py log a bit on screen where it's launching ([2e38153](https://github.com/roedoejet/g2p/commit/2e381533121ad4970bdc3ff12ad9696e4c7de4a9))
* update docstring ([2ab8313](https://github.com/roedoejet/g2p/commit/2ab8313cdb6b50ccb87e5a2a17f4ee23081610ff))
* update to stable version and link to blog ([6478537](https://github.com/roedoejet/g2p/commit/647853724cf9c5540a752a095e037c0232d8ee0e))


Styles

* add pre-commit hooks for black, etc and commitlint ([6297bee](https://github.com/roedoejet/g2p/commit/6297bee8fe06aba468941478c45982b9b66b5ee6))
* blackify all Python files ([9c26df4](https://github.com/roedoejet/g2p/commit/9c26df474a70543588e4f8b3ce7d56a36f475da4))
* blackify and isort a few more files ([cd31657](https://github.com/roedoejet/g2p/commit/cd3165733bbb5cd21b28aa2a3115cc13887dfa90))
* blackify g2p/mappings/tokenizer.py, and globals should be lowercase, not uppercase ([94561df](https://github.com/roedoejet/g2p/commit/94561dffdf74dab96b3643670bd21cbff29ccd27))
* blackify test_create_mapping.py ([460deb0](https://github.com/roedoejet/g2p/commit/460deb0a01a3c39e649c6aac46950fb9cfec4fd2))
* bump dev dependencies ([93ea50f](https://github.com/roedoejet/g2p/commit/93ea50fca52df060322db10dfca1c3ca1027ee5e))
* convert moe_to_ipa.json to our new, compact format ([9545832](https://github.com/roedoejet/g2p/commit/9545832676f027bc4332ed77f6c0872a80fd0f1b))
* isort all Python files ([1fa3d9d](https://github.com/roedoejet/g2p/commit/1fa3d9d34b4087c44047df64fb0f936db73cb09f))
* rewrite und_to_ipa.json in new compact format ([95e25af](https://github.com/roedoejet/g2p/commit/95e25af6e41943c7b9837a7c60acd15c76797755))
* **show-mappings:** black my work, and an extra test ([4738921](https://github.com/roedoejet/g2p/commit/4738921dd9ac55f714998179b5a0ead7d2967b26))
* remove husky commitlint (replace by python gitlint) ([e40a06f](https://github.com/roedoejet/g2p/commit/e40a06fd75f89d30277a669fb2e965b35c567364))
* use gitlint to enforce conventional commits ([29c4b05](https://github.com/roedoejet/g2p/commit/29c4b05d92a02bb234d84a91afd8183664bbbaef))
* use gitlint to validate commit messages ([904fb4c](https://github.com/roedoejet/g2p/commit/904fb4c9bd4ea1d08a12ba28a0b6555023286364))


Code Refactoring

* **tokenizer:** get_tokenizer still works, with deprecated warning ([d6aa3ab](https://github.com/roedoejet/g2p/commit/d6aa3ab20b983b7ecfca5cf0ea0b763b9303a192))
* **tokenizer:** refactor to same import strategy as make_g2p ([24557b7](https://github.com/roedoejet/g2p/commit/24557b789fcaca4facd5260b5afc42353ef9f803))
* apply a lot of flake8 recommendations ([1bf8ae0](https://github.com/roedoejet/g2p/commit/1bf8ae0261e150c383bc8ed501d0278abb99960b))
* black and isort and mypy, oh my ([ac4ce57](https://github.com/roedoejet/g2p/commit/ac4ce5778bec223531f96563449b781dca7ba34f))
* clean up imports ([df56d8f](https://github.com/roedoejet/g2p/commit/df56d8f906a4b1e4e78a106187d80232774d8610))
* clean up normalize with indices code ([9a5bc3c](https://github.com/roedoejet/g2p/commit/9a5bc3cd2916d1b810bf938de976eb049d007fe6))
* factor out loading public test data ([6cc278e](https://github.com/roedoejet/g2p/commit/6cc278e3b442784b64fbf2dacf342caac0037781))
* further readability refactorizations ([2b7d777](https://github.com/roedoejet/g2p/commit/2b7d777a5615a79481625abd38fdd239417d6411))
* general refactoring ([bea2c09](https://github.com/roedoejet/g2p/commit/bea2c09ff40cae4fcbbffe7f683debcd5331e49c))
* make test_fallback unit test easier to read ([940af15](https://github.com/roedoejet/g2p/commit/940af15aa4fd11321ee98b1bd6cbab578a0afaf5))
* spruce up distance metric code ([876021e](https://github.com/roedoejet/g2p/commit/876021e74078a4a7bec349edb5ae304c7b6c44b8))
* **ci:** move tests out of suite because they require 3.8 ([cff8d1e](https://github.com/roedoejet/g2p/commit/cff8d1e866b0c4b2540e6c9dae933a597bbcab97))
* **show-mappings:** -v as synonym for --verbose ([f18220f](https://github.com/roedoejet/g2p/commit/f18220ffe2030de4a18cbe59335c436c7156de32))
* **show-mappings:** remove old mapping viz generator ([57b5aa1](https://github.com/roedoejet/g2p/commit/57b5aa17b7111bf4a42a3eab5f5409907d4a8cd1))
* **show-mappings:** suggested edits ([95653ed](https://github.com/roedoejet/g2p/commit/95653ed80d4a29c0c3ed66ff1e1df03db6b18e53))
* move cache_langs to utils ([1aef962](https://github.com/roedoejet/g2p/commit/1aef962f61899846d5765d64b7f56444dad1b71e))
* replace function attributes by module globals ([e5199f0](https://github.com/roedoejet/g2p/commit/e5199f0bbb1212ad60cafb1a7201b11812245f11))
* use else block ([85fad34](https://github.com/roedoejet/g2p/commit/85fad346e9aa07d13d7397f668683f87d0b9ba4d))

[0.5.20220318](https://github.com/roedoejet/g2p/compare/v0.5.20211217...v0.5.20220318) (2022-03-18)


Features

* new g2p generate-mapping --from --to mode - WIP ([3c9f3a9](https://github.com/roedoejet/g2p/commit/3c9f3a933aa89390314d5819347ae8db3869bcf5))
* **gen-map:** implement and test gen-map with multiple target mappings ([67dac09](https://github.com/roedoejet/g2p/commit/67dac0995ace958188b4fbcd0d7f827656817031))


Bug Fixes

* **api:** add index and debugger flags to documentation, add localhost server option and fix tests ([fcc5225](https://github.com/roedoejet/g2p/commit/fcc52253f09106344844625219b5121015ef2636))
* remove unused import ([f573038](https://github.com/roedoejet/g2p/commit/f573038083bf1b12d47e9043c6024ebeafa6461d))
* **docs:** fixed typo in swagger spec ([c6d8ea7](https://github.com/roedoejet/g2p/commit/c6d8ea70f961f4ba8b9144f5354b38d9df1dd087))
* **test:** fix coverage drop ([bae0380](https://github.com/roedoejet/g2p/commit/bae0380899ef3482f22dd4f4215e601db70e791d))
* move temporary test output to tmpdir for gen-map ([ce95d48](https://github.com/roedoejet/g2p/commit/ce95d485ffc8c5a3b3e7c258f76687a5080d6e48))
* **gen-map:** allow --from and --to to alternatively be comma separated ([24b686d](https://github.com/roedoejet/g2p/commit/24b686d128ad885f9fecaba993157414434b759e))
* **gen-map:** fix obsolete semicolon reference in error message ([2d9facf](https://github.com/roedoejet/g2p/commit/2d9facf4eb3fffb40df724f8267fee3ed57e2bb3))
* **gen-map:** new generated mappings default to NFC ([af8ca55](https://github.com/roedoejet/g2p/commit/af8ca550455bd1a2fda2f75e841ce2ab3244031c))
* **gen-map:** several improvements polishing the from/to mode ([c0eb5f0](https://github.com/roedoejet/g2p/commit/c0eb5f047fec3d1cc9c625c89e3231b1a15507af))


Documentation

* **gen-map:** better usage docs for --from/--to mode ([746fce0](https://github.com/roedoejet/g2p/commit/746fce01dedfc4c0c1c7e4070611c143674320e1))


Styles

* apply some pylint recommended changes ([7bd0934](https://github.com/roedoejet/g2p/commit/7bd0934cf2287d925878838860c862ffe5e8c5bd))
* configured isort and mypy like in ReadAlongs/Studio ([a346f05](https://github.com/roedoejet/g2p/commit/a346f05d7c1c7f15b9cc680eeda8eea92e06f500))
* rewrite all generated JSON mapping in human-readable format ([d7401f4](https://github.com/roedoejet/g2p/commit/d7401f42d93fedc64a2f3229c7e08c3db20c46bd))


Code Refactoring

* output mappings in a more compact JSON format ([204d8c5](https://github.com/roedoejet/g2p/commit/204d8c5eaf792325d759c1bb2af1e4919256a249))


Tests

* **gen-map:** improve unit testing coverage ([5522a41](https://github.com/roedoejet/g2p/commit/5522a419cf353f7cf5184368259826e257e11efa))
* **gen-map:** unit testing for new --from/--to gen-map ([b25b006](https://github.com/roedoejet/g2p/commit/b25b006e46a11f08aacbd0cf82cf0d078ee69e46))
* **scan:** make sure g2p scan works with NFC and NFD input ([de2c09e](https://github.com/roedoejet/g2p/commit/de2c09e493e56c04eec9f9bc52fc040f135bbe46))

[0.5.20211217](https://github.com/roedoejet/g2p/compare/v0.5.20211029...v0.5.20211217) (2021-12-17)


Bug Fixes

* **deployment:** move back to eventlet but lock master branch commit for gunicorn until new release ([223390a](https://github.com/roedoejet/g2p/commit/223390a22cd444c9d02b6689f21303660f90ba93))
* **deployment:** replace eventlet with gevent ([7cd6bfa](https://github.com/roedoejet/g2p/commit/7cd6bfa4a1787437429451bf80a705c84142d975))
* **deps:** use locked gunicorn commit with a syntax that enables caching ([333f023](https://github.com/roedoejet/g2p/commit/333f023b84d2e829e1ad67f8303a5f7bc4a36bd2)), closes [/github.com/benoitc/gunicorn/pull/2581#issuecomment-994198667](https://github.com/roedoejet//github.com/benoitc/gunicorn/pull/2581/issues/issuecomment-994198667)
* **fra:** use \b for end of word, so it works before punctuation ([22c9fd9](https://github.com/roedoejet/g2p/commit/22c9fd9d32646895146098b13ce8bb4e5bdb930a))
* **mappings:** reverse length sort abbreviations to prevent substring errors. fixes [133](https://github.com/roedoejet/g2p/issues/133) ([c7538c6](https://github.com/roedoejet/g2p/commit/c7538c6685fa1266dc090f8ec84c0f1a017e9e93))
* **test:** test suite corrected for exceptions.IncorrectFileType change ([cc64588](https://github.com/roedoejet/g2p/commit/cc64588e8066f6f79d10f304cca1e2d385668a5d))
* **tokenizer;--config:** fix case-insensitive tok bug; --config can now load single mapping ([3d88a6d](https://github.com/roedoejet/g2p/commit/3d88a6da06bd570a19a48138ffb979157f78d8b1))
* fix bug causing exception with empty rules ([4d644a0](https://github.com/roedoejet/g2p/commit/4d644a03c5628954c21ad1284bddabe1102ce23e))
* **transducer:** hide dummy rules ([ad32663](https://github.com/roedoejet/g2p/commit/ad32663ba49824be1a424eebe4b1c04337b353e1))
* **transducer:** include all rules to debugger ([d516064](https://github.com/roedoejet/g2p/commit/d51606490272c3b86f0577e3800adc6ef65403be))
* friendlier error messages when mapping or abbrev files not found ([6226d4f](https://github.com/roedoejet/g2p/commit/6226d4f09c08c2cddf580e9de1365624886e3270))


Tests

* add case feeding test mapping with test case ([993ede7](https://github.com/roedoejet/g2p/commit/993ede71c3111fcb35d6b1fb45374e3c85d1900a))
* unit testing for bug causing exception with empty rules ([9f1eecb](https://github.com/roedoejet/g2p/commit/9f1eecbb25a8204b13eb082c4f7aeb5ca6c828e9))


Continuous Integration

* bump rtd to 3.8 ([0ff7b4b](https://github.com/roedoejet/g2p/commit/0ff7b4bb2d1fc4c0b2a3435e887490f2925e1f24))
* change from travis to gh-actions ([75f8c46](https://github.com/roedoejet/g2p/commit/75f8c467ab42747cfb83bafc8aa71decb478a0be))
* show github workflow build status badge ([5d0c97b](https://github.com/roedoejet/g2p/commit/5d0c97b2112dd8a40efb642b790f74b4caff588c))
* stop pointing to file ([3a2f1f7](https://github.com/roedoejet/g2p/commit/3a2f1f740e124501d7ed8367fa7ffe1696d2fc48))
* switch to codecov ([2e00437](https://github.com/roedoejet/g2p/commit/2e00437ca337473af3c223e00de96e3f6073e929))


Styles

* blackify mappings/__init__.py test_mappings.py and test_transducer.py ([d6ae834](https://github.com/roedoejet/g2p/commit/d6ae834863d309cd05096d32c7237eea35e21615))
* blackify mappings/utils.py and tests/test_z_local_config.py ([9b156b8](https://github.com/roedoejet/g2p/commit/9b156b87b63f6ff3c337c3e82ec1ecc45a2af03a))


Documentation

* **coverage:** change to codecov ([3f91397](https://github.com/roedoejet/g2p/commit/3f913970a644957778a75d46e8f095eb40af452b))
* **readme:** add link to blog ([823672d](https://github.com/roedoejet/g2p/commit/823672dfffedd8cd8eb372869a29bbc399e20ccb))


Code Refactoring

* **reqs:** move requirements to folder ([5a606e1](https://github.com/roedoejet/g2p/commit/5a606e13cdf89d8e90c274a97064dde8d6e3337f))
* make_g2p should raise more meaningful exceptions on caller errors ([adcf91f](https://github.com/roedoejet/g2p/commit/adcf91fd06fec3617cbd6df98225edc4c232f3ff))