Everyvoice

What's Changed
* ci: fail CI if everyvoice -h imports shared_types, that is slow by joanise in https://github.com/roedoejet/EveryVoice/pull/369
* docs: minor typo correction in Contributing.md by MENGZHEGENG in https://github.com/roedoejet/EveryVoice/pull/378
* Improve handling of inputs by roedoejet in https://github.com/roedoejet/EveryVoice/pull/348
* Better handle universal_checkpoint and Everyvoice vocoder by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/373
* chore: submodule udpate by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/390
* feat: getting rid of all intermediate logs_and_checkpoints/ & preprocessed/ during unittests by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/380
* feat: clean up cached preprocessed audio after unittests by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/386
* Change long tensors to integer tensors where possible by roedoejet in https://github.com/roedoejet/EveryVoice/pull/383
* fix: our test*.py are not executable, let's not pretend they are by joanise in https://github.com/roedoejet/EveryVoice/pull/393
* chore: submodule update by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/394
* docs: add a PR template by joanise in https://github.com/roedoejet/EveryVoice/pull/391
* ci: validate that schemas are up to date by joanise in https://github.com/roedoejet/EveryVoice/pull/389
* chore: update submodule wav2vec2aligner by joanise in https://github.com/roedoejet/EveryVoice/pull/397
* chore: submodule update by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/398
* fix(ci): update pip before installing dependencies by joanise in https://github.com/roedoejet/EveryVoice/pull/399
* fix: save processed audio in wav instead of pt by MENGZHEGENG in https://github.com/roedoejet/EveryVoice/pull/382
* fix: make-everyvoice-env warns on CUDA mismatch but continue by joanise in https://github.com/roedoejet/EveryVoice/pull/403
* ci: fix and revamp how we publish documentation with mike by joanise in https://github.com/roedoejet/EveryVoice/pull/402
* chore: submodule update by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/405
* feat(text): apply global cleaners to symbol sets by roedoejet in https://github.com/roedoejet/EveryVoice/pull/408
* docs: recommendations for doing multi-repo PRs by joanise in https://github.com/roedoejet/EveryVoice/pull/410
* fix: lock protobuf to a version compatible with tensorboard by joanise in https://github.com/roedoejet/EveryVoice/pull/423
* feat!: when preprocessing, everyvoice forces equal length time and f… by roedoejet in https://github.com/roedoejet/EveryVoice/pull/421
* Remove old HiFiGAN code by roedoejet in https://github.com/roedoejet/EveryVoice/pull/426
* docs: update submodules to add the PR template there too by joanise in https://github.com/roedoejet/EveryVoice/pull/428
* perf: Optimize the CLI by completely avoiding Pydantic imports from `everyvoice -h`. by joanise in https://github.com/roedoejet/EveryVoice/pull/429
* Refactor functions only required by config/utils under config by joanise in https://github.com/roedoejet/EveryVoice/pull/432
* chore: update submodule by roedoejet in https://github.com/roedoejet/EveryVoice/pull/431
* test: make sure a ckpt has no objects, only basic structures by joanise in https://github.com/roedoejet/EveryVoice/pull/434
* Vocoder matching by roedoejet in https://github.com/roedoejet/EveryVoice/pull/427
* Add Praat TextGrid as possible synthesis output by roedoejet in https://github.com/roedoejet/EveryVoice/pull/436
* Dev.ap/demo gradio by roedoejet in https://github.com/roedoejet/EveryVoice/pull/442
* chore: update submodule by roedoejet in https://github.com/roedoejet/EveryVoice/pull/445
* Dev.ap/update reqs by roedoejet in https://github.com/roedoejet/EveryVoice/pull/447
* feat: save and check a config lock for everyvoice preprocess by joanise in https://github.com/roedoejet/EveryVoice/pull/440
* remove resampling question from wizard by joanise in https://github.com/roedoejet/EveryVoice/pull/459
* Wizard checks if wav files are found, warns, and gives recovery option by joanise in https://github.com/roedoejet/EveryVoice/pull/454
* Fixes vocoder step bug in demo by wiitt in https://github.com/roedoejet/EveryVoice/pull/458
* feat: allow validation after N training steps by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/461
* perf: speed up g2p processing by caching the results by joanise in https://github.com/roedoejet/EveryVoice/pull/464
* Add a data permission question to the new-project wizard by joanise in https://github.com/roedoejet/EveryVoice/pull/462
* Dev.ej/466 sample wavs by joanise in https://github.com/roedoejet/EveryVoice/pull/471
* feat: help smooth out losses' value on resume by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/473
* Dev.vg/448 demo lang speak opt by wiitt in https://github.com/roedoejet/EveryVoice/pull/475
* Fix(CI): updated WizardTest to handle new email-validator error message by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/480
* Fixing everyvoice.tests.test_utls by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/479
* Add data attestation as a requirement by roedoejet in https://github.com/roedoejet/EveryVoice/pull/481
* fix: test_no_permissions() should leave a logs_and_checkpoints/ by SamuelLarkin in https://github.com/roedoejet/EveryVoice/pull/487
* docs: add ethics section, remove poorly rendered documentation sections by roedoejet in https://github.com/roedoejet/EveryVoice/pull/486

New Contributors
* wiitt made their first contribution in https://github.com/roedoejet/EveryVoice/pull/458

**Full Changelog**: https://github.com/roedoejet/EveryVoice/compare/v0.1.0a0.dev0...v0.1.0a2

:sparkles: New Features
- [`a205bc5`](https://github.com/roedoejet/EveryVoice/commit/a205bc587281ede83eed5b8657d59db56b5494cc) - Making the configs' properties relative paths. *(commit by SamuelLarkin)*
- [`ded2b14`](https://github.com/roedoejet/EveryVoice/commit/ded2b14ec5cb62863d55a78e0cb59080ecc9fe61) - move to torch 2.0 *(commit by roedoejet)*
- [`717fed0`](https://github.com/roedoejet/EveryVoice/commit/717fed038eaa0978b3dc25b5a80365bb5cad41dc) - New assertions when loading configs. *(commit by SamuelLarkin)*
- [`aaed3d5`](https://github.com/roedoejet/EveryVoice/commit/aaed3d5bcd5aa95bf4680f642abc27fc4fbf6e42) - make installation more robust with fallbacks for compiled modules *(commit by joanise)*
- [`e828331`](https://github.com/roedoejet/EveryVoice/commit/e8283319ea00565b64eb5883d53836cb72e62fb0) - add ctc segmentation tool to everyvoice *(commit by roedoejet)*
- [`fd1940e`](https://github.com/roedoejet/EveryVoice/commit/fd1940e05bd347d6234e17391fec864bf65292e9) - replace repeated prepro warnings by a summary of missing symbols *(commit by joanise)*
- [`b924bf7`](https://github.com/roedoejet/EveryVoice/commit/b924bf76588de5b6313e65c77f6a11f3d7dd1fcf) - support cpu-only env in make-fresh-env.sh *(commit by joanise)*
- [`dad4e48`](https://github.com/roedoejet/EveryVoice/commit/dad4e48b7e6feed7f7da46a28d7869b5ad4ec710) - revamped make-everyvoice-env script *(commit by joanise)*
- [`4b756da`](https://github.com/roedoejet/EveryVoice/commit/4b756daaa60591fafd1aa41da85e10cb1bbda0c1) - **CLI**: Creating a new CLI to view checkpoint's info. *(commit by SamuelLarkin)*
- [`8908fac`](https://github.com/roedoejet/EveryVoice/commit/8908facc8f8ef84555c231c6643edf5f5111db88) - Record the model's architecture and configuration in logs *(commit by SamuelLarkin)*
- [`fc5cac5`](https://github.com/roedoejet/EveryVoice/commit/fc5cac5f6d9bba46da800c85ff51353223d900d0) - **fs2**: add attention binarization loss *(commit by roedoejet)*
- [`4aad942`](https://github.com/roedoejet/EveryVoice/commit/4aad942e69ff50f08704ce8a80a244f47193b823) - gracefully handle an input filelist without a header line *(commit by joanise)*
- [`10558d2`](https://github.com/roedoejet/EveryVoice/commit/10558d29944428d06bb54589c6ff2a48befd2dac) - parameterize the Python version in make-everyvoice-env *(commit by joanise)*
- [`85a9a8a`](https://github.com/roedoejet/EveryVoice/commit/85a9a8a7028a39a3805849af65f0db1b3040660c) - Added lookuptables_from_config() *(commit by SamuelLarkin)*
- [`56e870d`](https://github.com/roedoejet/EveryVoice/commit/56e870dab2db99768b206f19d3f277532f94a92e) - Added model_kwargs to train_base_command() *(commit by SamuelLarkin)*
- [`44c88a1`](https://github.com/roedoejet/EveryVoice/commit/44c88a147c4f8d89ddaa4d27fc82a9bce6f5b874) - renamed lookuptables testcase *(commit by SamuelLarkin)*
- [`55b7865`](https://github.com/roedoejet/EveryVoice/commit/55b7865c456bc25aef03d495ac5e72f634ed22c5) - add ability to set validation interval *(commit by roedoejet)*
- [`a8d9001`](https://github.com/roedoejet/EveryVoice/commit/a8d9001f086d7fd2c56d8e2b338adcc3755d7a0b) - quick hacky way to run fs2's unittests *(commit by SamuelLarkin)*
- [`969e02a`](https://github.com/roedoejet/EveryVoice/commit/969e02a2dc3c15a6cbbeb1310d4efbc94d4347f8) - adding fs2's unittests *(commit by SamuelLarkin)*
- [`b4fbace`](https://github.com/roedoejet/EveryVoice/commit/b4fbaced881c3db1358eb4f67f2577ea4aee4e59) - added a typte to SUITE *(commit by SamuelLarkin)*
- [`d5a4710`](https://github.com/roedoejet/EveryVoice/commit/d5a471054f2cdf3972b010132be20d13b9d6ac0f) - added stubs for matplotlib & tqdm *(commit by SamuelLarkin)*
- [`c0dce38`](https://github.com/roedoejet/EveryVoice/commit/c0dce380e4f14896bf025a42b60f05ded80b69ca) - python-3.10 type notation *(commit by SamuelLarkin)*
- [`d08808e`](https://github.com/roedoejet/EveryVoice/commit/d08808e34859133abb392211b141267ec760db5c) - using annotated to validate PossiblyRelativePath *(commit by SamuelLarkin)*
- [`d7c7f44`](https://github.com/roedoejet/EveryVoice/commit/d7c7f4402cf4a8697b5356231d0135901d398453) - add contact information requirement *(commit by roedoejet)*
- [`e3dd343`](https://github.com/roedoejet/EveryVoice/commit/e3dd343fd5abe40ff7d2d32ee65e695d1e785f8c) - Display an error message when the user provides the wrong config file *(commit by SamuelLarkin)*
- [`2681f40`](https://github.com/roedoejet/EveryVoice/commit/2681f40b4949557a74161305411ce44bde288a39) - trimming white spaces in answers *(PR #344 by SamuelLarkin)*
- [`5bc4b87`](https://github.com/roedoejet/EveryVoice/commit/5bc4b879abde79b800fe3d4654c82e89599d8cdc) - added unittest if the user provides invalid enum values *(commit by SamuelLarkin)*
- [`2b66c49`](https://github.com/roedoejet/EveryVoice/commit/2b66c49d67d1c92911d2352be05a0487ba3bc73f) - ci to publish to pypi *(commit by SamuelLarkin)*
- [`84f19ac`](https://github.com/roedoejet/EveryVoice/commit/84f19ac2588c7a56616a1375b1845f4af03b9472) - create necessary changes for alpha release *(commit by roedoejet)*
- [`1a3221b`](https://github.com/roedoejet/EveryVoice/commit/1a3221b1d83252642cab3e760ec6992209f26bec) - publish to pypi *(commit by SamuelLarkin)*

:bug: Bug Fixes
- [`6e9dde1`](https://github.com/roedoejet/EveryVoice/commit/6e9dde1b64f42ee414720f498739ea7295d50df6) - **docs**: fix macro *(commit by roedoejet)*
- [`7dd78f5`](https://github.com/roedoejet/EveryVoice/commit/7dd78f51be655175c492dffd022f78f86e702c24) - Changing path to absolute for missing members *(commit by SamuelLarkin)*
- [`4c429c9`](https://github.com/roedoejet/EveryVoice/commit/4c429c90f9eac1f325b80dd49e2f8a2244c2ac07) - don't duplicate the CSV header line, and warn when it's not there *(commit by joanise)*
- [`5cfbd53`](https://github.com/roedoejet/EveryVoice/commit/5cfbd53a3b5b825b6f67164ad16109be72c46df1) - skip short audios at the start to avoid errors with loudness *(commit by davidguzmanr)*
- [`4f751cb`](https://github.com/roedoejet/EveryVoice/commit/4f751cb51cf6176f972eb7c6c4572187db06e7e8) - change number of nodes to int *(commit by roedoejet)*
- [`c2decdd`](https://github.com/roedoejet/EveryVoice/commit/c2decddc8a80834c04d49adece86e72bd082a720) - automatically remove a .wav extension from filenames *(commit by marctessier)*
- [`a009014`](https://github.com/roedoejet/EveryVoice/commit/a0090149518282094dca4d1d61293255ee0ded92) - Relative paths for wavs issue #127 *(commit by SamuelLarkin)*
- [`3709e46`](https://github.com/roedoejet/EveryVoice/commit/3709e46c4b1fa116625f4ff8b30e3293335a8dd1) - **tests**: add other configs to e2e config to fix logger save dir bug *(commit by roedoejet)*
- [`4c5063d`](https://github.com/roedoejet/EveryVoice/commit/4c5063d869fff6a575a5ca22637d28c9517a359d) - Removed index.md from navigation *(commit by SamuelLarkin)*
- [`a035dbb`](https://github.com/roedoejet/EveryVoice/commit/a035dbb8a7f16c3c3eac70f0c4861eb78bd659ba) - **reqs**: bump to cuda 11.8 *(commit by roedoejet)*
- [`e402b83`](https://github.com/roedoejet/EveryVoice/commit/e402b8302cd3f2cadddcea7f3fb6eccf71b622d3) - remove kaldi pitch detection *(commit by roedoejet)*
- [`631e77b`](https://github.com/roedoejet/EveryVoice/commit/631e77bdb4df350e1ef7481cead6094b79ba5394) - add sox to install for github actions *(commit by roedoejet)*
- [`416a9b5`](https://github.com/roedoejet/EveryVoice/commit/416a9b5fa6d643abc058dd1918928bcd4907571b) - only load audio as a string not path *(commit by roedoejet)*
- [`5763ee2`](https://github.com/roedoejet/EveryVoice/commit/5763ee2b295d5f8a30f11452602b0e8fc3b2123e) - remove MMS model due to privacy concerns *(commit by roedoejet)*
- [`39980b8`](https://github.com/roedoejet/EveryVoice/commit/39980b8b1834ed19494a4ad5635254492f4622ea) - add fix for hyphen and pipe in text *(commit by roedoejet)*
- [`2004a45`](https://github.com/roedoejet/EveryVoice/commit/2004a45ef04478a8a4d7210d6bd1ad6ea1951dcd) - remove trailing and leading silence *(commit by roedoejet)*
- [`2356b83`](https://github.com/roedoejet/EveryVoice/commit/2356b839057cf73b253422c871650fa90e825b23) - make 'no' the default option in wizard *(commit by roedoejet)*
- [`c9758f8`](https://github.com/roedoejet/EveryVoice/commit/c9758f849911325084e5c64ae4f8623ced6d8b87) - add training loss back to progress bar *(commit by roedoejet)*
- [`bc45a59`](https://github.com/roedoejet/EveryVoice/commit/bc45a59e469076ff2c3cadb2b8d8dd3ef50a8478) - fix tests for wizard *(commit by roedoejet)*
- [`8763bca`](https://github.com/roedoejet/EveryVoice/commit/8763bcab61ace4718f7088d35e28702a6d573838) - **fp**: fix feature prediction scheduler *(commit by roedoejet)*
- [`a86a6b2`](https://github.com/roedoejet/EveryVoice/commit/a86a6b25d5c0414aa2e5d3fa545056aea6ecdaeb) - **docs**: add index file again *(commit by roedoejet)*
- [`34d985e`](https://github.com/roedoejet/EveryVoice/commit/34d985e2beee0ff446342a47adb3fbae5c53eb3b) - if cuda 11.8 is now required, make that the fresh env default *(commit by joanise)*
- [`70994a1`](https://github.com/roedoejet/EveryVoice/commit/70994a19ba15c109f21b99895e20f750bae3f6c2) - **reqs**: pin g2p to 2.0 dev version until release *(commit by roedoejet)*
- [`cf99430`](https://github.com/roedoejet/EveryVoice/commit/cf99430c9b4db5b62c81519013a741bb4c927e4b) - fix memory pinning bug *(commit by roedoejet)*
- [`493bb6b`](https://github.com/roedoejet/EveryVoice/commit/493bb6b0da4b57a3bc9fc3c7d38f8d2a57ae704e) - add missing fields in config files and fix synthesis on CPU *(commit by davidguzmanr)*
- [`230c6bf`](https://github.com/roedoejet/EveryVoice/commit/230c6bf02f6e71b1aeba5e3b1d04a3112e2e982e) - speed up everyvoice -h by updating wav2vec2aligner submodule *(commit by joanise)*
- [`28f5c33`](https://github.com/roedoejet/EveryVoice/commit/28f5c3302ea499a44c8a006c371f8c2492554750) - previously processed files are skipped but not ignored *(commit by joanise)*
- [`0492207`](https://github.com/roedoejet/EveryVoice/commit/049220730a5e51ecc0d6c3e3565ed1174a3b7467) - exit early when the filtered filelist is empty *(commit by joanise)*
- [`92b83d6`](https://github.com/roedoejet/EveryVoice/commit/92b83d69ee5732c5f524a9ca0e360a036682a561) - **config**: fixes extra preprocessing and logs folders from being created *(commit by roedoejet)*
- [`c28e736`](https://github.com/roedoejet/EveryVoice/commit/c28e736fdf89ce5ed616a07e4fea1533ad70b208) - in case of error, let's sys.exit with a non-zero status *(commit by joanise)*
- [`3b8204a`](https://github.com/roedoejet/EveryVoice/commit/3b8204af6589ae4bc4183ae2a3a2f152fc1b9d35) - ModelCheckpoint's every_n_train_steps & every_n_epochs should be mutually exclusive *(commit by SamuelLarkin)*
- [`b9e7a52`](https://github.com/roedoejet/EveryVoice/commit/b9e7a5293a625f244ddfb95219b13c7ee0068ec8) - please watch your expensive imports *(commit by joanise)*
- [`4844191`](https://github.com/roedoejet/EveryVoice/commit/48441915dbcbb0fdf280d84f007d56c1cd61b885) - Deprecated feature in v2.X *(commit by SamuelLarkin)*
- [`181331f`](https://github.com/roedoejet/EveryVoice/commit/181331f7bb31248c1a7e27838642822cc9b50609) - **ckpt**: use serialized checkpoint *(commit by roedoejet)*
- [`742798c`](https://github.com/roedoejet/EveryVoice/commit/742798ca3895231a46d1dec23a38e07387c7820e) - Excluding sub_dir_callable when creating a TensorBoardLogger *(commit by SamuelLarkin)*
- [`d50f303`](https://github.com/roedoejet/EveryVoice/commit/d50f30368dd67c44e4e26604bcb7e33b9b5d74ca) - explicit the dependency of test_dataloader on test_preprocessing *(commit by joanise)*
- [`a87bf85`](https://github.com/roedoejet/EveryVoice/commit/a87bf856492ec747b64281c9e22b733164754f9e) - **test**: test_absolute_path should work even with TMPDIR=. *(commit by joanise)*
- [`d166c12`](https://github.com/roedoejet/EveryVoice/commit/d166c12b79b1e4e47a9fb53656629b067a81d76b) - gracefully handle running out of columns *(commit by joanise)*
- [`7469559`](https://github.com/roedoejet/EveryVoice/commit/746955993e35b2e61d6e75f1a5f3690931a31c5a) - ensure all models are json serializable *(commit by roedoejet)*
- [`85d77ac`](https://github.com/roedoejet/EveryVoice/commit/85d77ac65d3e7185340938e9388b5f7d48153a3c) - do not create unnecessary directories during inference *(commit by roedoejet)*
- [`f4874f1`](https://github.com/roedoejet/EveryVoice/commit/f4874f122774ad1231ebb6575d314fdbe9d9c9c1) - preprocess always needs to recalculate pitch and energy *(commit by joanise)*
- [`ebc8545`](https://github.com/roedoejet/EveryVoice/commit/ebc8545672f5dc6665ee85e903c3c1a2a1146838) - correct license for third party file, and bump year *(commit by joanise)*
- [`e210c06`](https://github.com/roedoejet/EveryVoice/commit/e210c065baa2f976c6dce80bc0ea3f37e66bfce3) - **checkpoint**: allow fine-tuning again for checkpoints without paths *(commit by roedoejet)*
- [`c44e6ef`](https://github.com/roedoejet/EveryVoice/commit/c44e6ef862f30898b99cde2d75aa677823d1038d) - **resume**: resume checkpoint training from a mocked, temporary checkpoint *(commit by roedoejet)*
- [`ede6297`](https://github.com/roedoejet/EveryVoice/commit/ede629701a2482d5a8f24b900ab8a3514f895563) - wizard config for multispeaker/lingual when relevant columns are found *(commit by joanise)*
- [`4118d8a`](https://github.com/roedoejet/EveryVoice/commit/4118d8a25a05b8943632a9efde4fa31e91751b77) - **cpu**: remove -inf padding which caused nans on cpu *(commit by roedoejet)*
- [`1155fb5`](https://github.com/roedoejet/EveryVoice/commit/1155fb5fb64d13300621930a71f23afc2848cf9c) - **reqs**: mac-specific installation of torch and torchaudio *(commit by roedoejet)*
- [`536d75f`](https://github.com/roedoejet/EveryVoice/commit/536d75f7acbab0dc8db904e8b151aad607b5734d) - **synthesis**: fix synthesis on mac with multiple changes *(commit by roedoejet)*
- [`cea3905`](https://github.com/roedoejet/EveryVoice/commit/cea3905a715d082f43ed7c9288108f7c6ae2d3c1) - **test**: set specific seed for synthesize test *(commit by roedoejet)*
- [`f1746a2`](https://github.com/roedoejet/EveryVoice/commit/f1746a206978799fb6e7b5e851a9461e7d7a2d46) - **test**: remove test_synthesize to pass ci *(commit by roedoejet)*
- [`f82b19b`](https://github.com/roedoejet/EveryVoice/commit/f82b19bd8ffa206603de48b11341d9c92dcb1e82) - make the pandas version compatible with the matplotlib-stubs version *(commit by joanise)*
- [`ebd78a1`](https://github.com/roedoejet/EveryVoice/commit/ebd78a1d424ba25cbdb003c867ed4f5f4daa71bf) - relative vocoder path *(commit by SamuelLarkin)*
- [`2fd9354`](https://github.com/roedoejet/EveryVoice/commit/2fd9354e57663bc0e920f408912dabd8743ccae7) - finetune_checkpoint needs to be converted to absolute *(commit by SamuelLarkin)*
- [`e4e4b5d`](https://github.com/roedoejet/EveryVoice/commit/e4e4b5d47fc947300f2d83c56aa258aa47f0aa13) - annotation errors *(commit by SamuelLarkin)*
- [`2c0c8b0`](https://github.com/roedoejet/EveryVoice/commit/2c0c8b0a89481560c3c0715df8b32350c0201dd5) - missing member *(commit by SamuelLarkin)*
- [`095aeb3`](https://github.com/roedoejet/EveryVoice/commit/095aeb3d61452cc48bca704b570ca5dfabd532b3) - resuming from a gpu model on cpu or vice versa *(commit by SamuelLarkin)*
- [`9c3f670`](https://github.com/roedoejet/EveryVoice/commit/9c3f6705b2b9fb001dd7d6a956721d0109573e68) - apply review fixes *(commit by roedoejet)*
- [`37c857c`](https://github.com/roedoejet/EveryVoice/commit/37c857cf7254a4df7734b34dd18f6d08cb7660da) - only accept dirs for where the audio files are *(commit by joanise)*
- [`0045c6c`](https://github.com/roedoejet/EveryVoice/commit/0045c6c3592a3bcba43d7e9fefaaa022c211f3d7) - patch autocompletion of file args and opts *(commit by joanise)*
- [`0bfed5a`](https://github.com/roedoejet/EveryVoice/commit/0bfed5aed56752d37aebbcb96c0a541cf4c27d2a) - update submodules to patch file autocompletion *(commit by joanise)*
- [`1f625f8`](https://github.com/roedoejet/EveryVoice/commit/1f625f84bd1f49b4f3a05b9e146af9c34d490997) - **optim**: update optimizer values to scale losses and increase learning rate *(commit by roedoejet)*
- [`05cdd09`](https://github.com/roedoejet/EveryVoice/commit/05cdd09beb1266a3d0b8f9d6b2287776c10aa84f) - add doc fixes and config/train fixes *(commit by roedoejet)*
- [`ec25471`](https://github.com/roedoejet/EveryVoice/commit/ec254717a006a27091686e47c1040ae7c7b9c1fa) - setup supported OS classifier *(commit by roedoejet)*
- [`e475ba2`](https://github.com/roedoejet/EveryVoice/commit/e475ba2a5645ca3528544313f873379a2c7eddf4) - **setup**: include submodules in setup tools *(commit by roedoejet)*
- [`6ae37f2`](https://github.com/roedoejet/EveryVoice/commit/6ae37f2271bcca739b1966a44707e521d9de222a) - missing space after question for contact info *(commit by SamuelLarkin)*
- [`29b78cc`](https://github.com/roedoejet/EveryVoice/commit/29b78cc801818fe68c31e566157fbea69172c4d9) - aligner config checking and tensorboard arguments *(commit by MENGZHEGENG)*
- [`52a9e46`](https://github.com/roedoejet/EveryVoice/commit/52a9e46eededb346533e3b9e3849dcdd1e21d1c2) - extra preprocessed/ and logs_and_checkpoints/ *(PR #311 by SamuelLarkin)*
- [`11803e9`](https://github.com/roedoejet/EveryVoice/commit/11803e91847d314e8affdbfa1c4b940656bdb6b6) - **pitch**: allow audio to have no pitch *(commit by roedoejet)*
- [`ffa450e`](https://github.com/roedoejet/EveryVoice/commit/ffa450e4518a70f0a5abb8367c987ca24b8e8bd0) - change silence trimming *(commit by roedoejet)*
- [`5f6c4d9`](https://github.com/roedoejet/EveryVoice/commit/5f6c4d9b45876456e58933598d7f8e93bf17da01) - update submodule to fix g2p imports *(commit by joanise)*
- [`71652a4`](https://github.com/roedoejet/EveryVoice/commit/71652a484f4ea47f55e79c023881201d1fc6973e) - use_effects is true *(commit by roedoejet)*
- [`df44ccb`](https://github.com/roedoejet/EveryVoice/commit/df44ccb4a564b30839834e44e921161b010162d5) - **style**: bump black to 24.3.0 to fix black's first CVE *(commit by joanise)*
- [`6244eb0`](https://github.com/roedoejet/EveryVoice/commit/6244eb0b1dc9175572becd267aff2869ffe0354d) - sox_effects in preprocessing *(commit by MENGZHEGENG)*
- [`286e24d`](https://github.com/roedoejet/EveryVoice/commit/286e24dba5b52796edf27987104e5f1da19ae128) - test_update_schema fails when we bump the version *(commit by joanise)*
- [`f99c8e7`](https://github.com/roedoejet/EveryVoice/commit/f99c8e7fff7d2ca5d23f0d96c3383d12c0219476) - **cli**: update schemas should only save files based on maj/min *(commit by roedoejet)*
- [`2fa6097`](https://github.com/roedoejet/EveryVoice/commit/2fa609760108ac6467cd17b90948be05f7e42adb) - **fs2**: bump black to 24.3.0 to fix black's first CVE *(PR #377 by MENGZHEGENG)*
- [`fd5ab98`](https://github.com/roedoejet/EveryVoice/commit/fd5ab98f051abbea08774d2eb0c7610fd2416bfa) - no need to publish to test pypi *(commit by roedoejet)*

:zap: Performance Improvements
- [`7556912`](https://github.com/roedoejet/EveryVoice/commit/7556912c9019ce5537bf5a7a834ab65a0b248b5d) - update submodules to get their CLI loading speed-ups *(commit by joanise)*
- [`86d6bfb`](https://github.com/roedoejet/EveryVoice/commit/86d6bfbfa8bb8eb074accc0b4087ff92df4a1936) - defer imports to make CLI help lightning fast *(commit by joanise)*
- [`c0cb6af`](https://github.com/roedoejet/EveryVoice/commit/c0cb6af77fece521f2aeada3bfeb75e2eeba8169) - I guess it is going to be hard to keep help fast... *(commit by joanise)*
- [`5cdabda`](https://github.com/roedoejet/EveryVoice/commit/5cdabdad7b8b994543224d19192e4251464d1bf4) - There is no need to load all of pandas just to build a simple lookup table. *(PR #202 by SamuelLarkin)*

:recycle: Refactors
- [`66ec197`](https://github.com/roedoejet/EveryVoice/commit/66ec1971a25a8660861538bc490fe7f946d61a95) - upgrade to lightning 2 *(commit by roedoejet)*
- [`de7d4f5`](https://github.com/roedoejet/EveryVoice/commit/de7d4f529a1236b55ca0f7b86c1b5e5e87c9ead5) - remove output optional argument to preprocess step *(commit by roedoejet)*
- [`00eb658`](https://github.com/roedoejet/EveryVoice/commit/00eb658c41be1be98be8481b0b862a14848dabe3) - use set instead of list *(commit by roedoejet)*
- [`1201d26`](https://github.com/roedoejet/EveryVoice/commit/1201d26b94e4f93252551fa412c9eeb396ab72d5) - **cli**: change new-dataset command to new-project *(commit by roedoejet)*
- [`1d8862d`](https://github.com/roedoejet/EveryVoice/commit/1d8862dc59c9eb142b95eff0ffc0daa1bb190e6a) - remove dead code, add documentatino and doctests for utils *(commit by joanise)*
- [`05ada20`](https://github.com/roedoejet/EveryVoice/commit/05ada201391293128182e9415ad92c52d743a10e) - update submodule to import _flatten at the source there too *(commit by joanise)*
- [`3efc443`](https://github.com/roedoejet/EveryVoice/commit/3efc44306cc4f07e9c210893be12bcdae76df59a) - **env**: rename make-fresh-env.sh -> make-everyvoice-env *(commit by joanise)*
- [`4f22dc4`](https://github.com/roedoejet/EveryVoice/commit/4f22dc4306b023ae41907590aa90e73389e58329) - **cli**: I removed the yaml export of the config as we're not exporting a proper EV config *(commit by roedoejet)*
- [`f86d50e`](https://github.com/roedoejet/EveryVoice/commit/f86d50e479b53ba1b3060675def08cafcf74165e) - Changed capture_stdout() to use redirect_stdout *(commit by SamuelLarkin)*
- [`838b854`](https://github.com/roedoejet/EveryVoice/commit/838b854ee6b1a3cb2dea9950ea21b425a1764bc9) - revamp how we load test suites to make it DRY *(commit by joanise)*
- [`504b7ff`](https://github.com/roedoejet/EveryVoice/commit/504b7ff1f43ce3482ea8bcabf1750940b2748845) - address a whole bunch of mypy-raised issues *(commit by joanise)*
- [`de38166`](https://github.com/roedoejet/EveryVoice/commit/de381667eb557747f6dc91c49d947f51e71269b3) - move preprocessor helpers to helpers.py *(commit by joanise)*
- [`477614e`](https://github.com/roedoejet/EveryVoice/commit/477614e3a99f8ec7e7670e687ca05d4a3a60a86f) - move class Preprocessor to preprocessor.py *(commit by joanise)*
- [`8c73385`](https://github.com/roedoejet/EveryVoice/commit/8c7338593d63ff860934590ea6eba794a45883a9) - use built-in model_checkpoint_dump method *(commit by roedoejet)*
- [`c76123b`](https://github.com/roedoejet/EveryVoice/commit/c76123bc85a3a08342f089f9b4613b30a6c11f9e) - change synthesize api to only specify the inputs (i.e. text or spec) *(commit by roedoejet)*
- [`66d943d`](https://github.com/roedoejet/EveryVoice/commit/66d943dac8c9561bc919ed3ae6d8f7a595720cd7) - unify two slugify/path sanitization commands *(commit by roedoejet)*
- [`295b088`](https://github.com/roedoejet/EveryVoice/commit/295b08876b9467e1f1a4d7db43906b55f2e7c4fe) - **test**: explicitly call PreprocessingTest.preprocess() where needed *(commit by joanise)*
- [`801f7cc`](https://github.com/roedoejet/EveryVoice/commit/801f7ccc13de7a389173b13dd1aa5175346108ca) - python 3.10 style for files I am touching *(commit by joanise)*
- [`ca7b9bd`](https://github.com/roedoejet/EveryVoice/commit/ca7b9bdfebde1e4472e95ebcff208b966a107301) - move length trimming *(commit by roedoejet)*
- [`4dcf00c`](https://github.com/roedoejet/EveryVoice/commit/4dcf00c92a1bad8718b42220a8fc7ddc9ec3552f) - **fs2l**: split subcommands into their own file *(commit by SamuelLarkin)*

:white_check_mark: Tests
- [`88ef6e5`](https://github.com/roedoejet/EveryVoice/commit/88ef6e5fa6a691e38098403a94c302e5f147f0a2) - update tests for header patch and make them quieter *(commit by joanise)*
- [`e8496f2`](https://github.com/roedoejet/EveryVoice/commit/e8496f268919e7b4dd9c2b16abf021d69ac0ad44) - exercise incremental file processing *(commit by joanise)*
- [`047b8c3`](https://github.com/roedoejet/EveryVoice/commit/047b8c38be12a81ad37b63ecaa9127b180b2da3c) - doh, forgot to add the new test data file *(commit by joanise)*
- [`d1690c4`](https://github.com/roedoejet/EveryVoice/commit/d1690c4f24626d580db9e537c9644486e15cdff4) - exercise incremental attn too *(commit by joanise)*
- [`1154668`](https://github.com/roedoejet/EveryVoice/commit/115466829078b72fd127dee7940846ec7e85aaa0) - minor improvements to test suites *(commit by joanise)*
- [`fb149d2`](https://github.com/roedoejet/EveryVoice/commit/fb149d2a9434636706c4aebb10e4f7ce1ba0ea20) - quiet the test_preprocessing.py test suite *(commit by joanise)*
- [`804d676`](https://github.com/roedoejet/EveryVoice/commit/804d676e9d015dc072ba6a3f35f7b87e1cd5e37e) - add the --describe option to run_tests.py *(commit by joanise)*
- [`fb52313`](https://github.com/roedoejet/EveryVoice/commit/fb5231358937abcde71923cb47f873c6777d1fbb) - enable running "everyvoice test fs2" *(commit by joanise)*
- [`8ec6b4f`](https://github.com/roedoejet/EveryVoice/commit/8ec6b4f6eaf236c14c52641bd01c81a518779e64) - test for the multispeaker/language effect on config files *(commit by joanise)*
- [`8e9a563`](https://github.com/roedoejet/EveryVoice/commit/8e9a5637ef1b0bc4b8bd8f01b0ff955ddec3638f) - minimal test case exercising imbalanced_sampler *(commit by joanise)*
- [`b1996bf`](https://github.com/roedoejet/EveryVoice/commit/b1996bff812f6279fbc075ab9e67b97cfc47db35) - add silence removal test to remove leading and trailing silence *(commit by roedoejet)*
- [`3af47ae`](https://github.com/roedoejet/EveryVoice/commit/3af47ae8f1a4e8c38bf46901cf31f4db9c3927b9) - ensure version is pep440 compliant *(commit by roedoejet)*

:wrench: Chores
- [`341d3f0`](https://github.com/roedoejet/EveryVoice/commit/341d3f08abd9b07241133705f4fccdfd4e329fc2) - point to pre-commit checked submodules *(commit by roedoejet)*
- [`ab2cf96`](https://github.com/roedoejet/EveryVoice/commit/ab2cf96f230609dc2cc2605248770df0c8e91317) - update submodules *(commit by roedoejet)*
- [`8deefd1`](https://github.com/roedoejet/EveryVoice/commit/8deefd1b3cf4d01ebe44e8bf0597b2489e959a94) - update submodule *(commit by roedoejet)*
- [`c0a75d8`](https://github.com/roedoejet/EveryVoice/commit/c0a75d8ac520c5ce2853f8da0da0717c7a5e2169) - update submodule *(commit by roedoejet)*
- [`4890588`](https://github.com/roedoejet/EveryVoice/commit/4890588050f3f73a447ae260d74f768260f6e060) - update submodule *(commit by roedoejet)*
- [`7dd79b1`](https://github.com/roedoejet/EveryVoice/commit/7dd79b10c89ab1a08a4535c18a41a16742db2c3b) - update submodule *(commit by joanise)*
- [`bb06431`](https://github.com/roedoejet/EveryVoice/commit/bb06431cb0b8a7ea530a1aa5ac2005d904d7637d) - update submodules *(commit by roedoejet)*
- [`b7e9915`](https://github.com/roedoejet/EveryVoice/commit/b7e9915a092774bfeb3868007584cc19a1d24c9e) - update submodule to get their mypy issue fixes *(commit by joanise)*
- [`a3dce66`](https://github.com/roedoejet/EveryVoice/commit/a3dce66403f559ef4309ef980b2ea97d55ee1a59) - update submodule *(commit by roedoejet)*
- [`45f1287`](https://github.com/roedoejet/EveryVoice/commit/45f1287a272bd4e9eeaa9472e45211c545356ac1) - update submodule *(commit by roedoejet)*
- [`71239db`](https://github.com/roedoejet/EveryVoice/commit/71239dbe35e459444765279b7e0646c6878d9903) - allow prefactor commit type for partial refactoring work *(commit by joanise)*
- [`ccd01e8`](https://github.com/roedoejet/EveryVoice/commit/ccd01e80ab6baf38fed7f8e8d97f8c9fbe47e66a) - update submodule *(commit by roedoejet)*
- [`09ab796`](https://github.com/roedoejet/EveryVoice/commit/09ab7965ce90f4e24ef803aecdc6af1331614902) - update submodules *(commit by joanise)*
- [`a046900`](https://github.com/roedoejet/EveryVoice/commit/a046900ab4ac047da0471826a603ddad66f6b4e3) - update fs2's submodule *(commit by SamuelLarkin)*
- [`5930b54`](https://github.com/roedoejet/EveryVoice/commit/5930b5494ea1d68e335050fc39bfc993d27f3c8c) - update submodules *(commit by joanise)*
- [`03eb27c`](https://github.com/roedoejet/EveryVoice/commit/03eb27c629899c09effae590291a84346f486a30) - update submodule *(commit by roedoejet)*
- [`c72227e`](https://github.com/roedoejet/EveryVoice/commit/c72227e899f1d7731ec8617a63b724f9949cfb71) - submodule update *(commit by SamuelLarkin)*
- [`d000814`](https://github.com/roedoejet/EveryVoice/commit/d00081420e81c6fd4d1bad41cfc6f781165834f9) - submodule update *(commit by SamuelLarkin)*
- [`725f19e`](https://github.com/roedoejet/EveryVoice/commit/725f19e061f903d1cc33b8185f83f097364b9f69) - submodule update *(commit by SamuelLarkin)*
- [`685a980`](https://github.com/roedoejet/EveryVoice/commit/685a98068d63eae84c45afa8af76155469ddcf2e) - update submodule *(commit by joanise)*
- [`3538b8a`](https://github.com/roedoejet/EveryVoice/commit/3538b8a3a1f7ac5a7c13463ecd7f285eb8f53810) - update submodule *(commit by joanise)*
- [`8ff018c`](https://github.com/roedoejet/EveryVoice/commit/8ff018c0fc72672fe8b5d57314d8e53e3defaca6) - update submodule *(commit by SamuelLarkin)*
- [`c0f10c7`](https://github.com/roedoejet/EveryVoice/commit/c0f10c7ee75feda17f2be23fb92cb126d9524e7b) - submodule update *(commit by SamuelLarkin)*
- [`8c149f9`](https://github.com/roedoejet/EveryVoice/commit/8c149f94d29b7da37c6960d431bc947f73383735) - submodule update *(commit by SamuelLarkin)*
- [`0510daf`](https://github.com/roedoejet/EveryVoice/commit/0510dafd6befd40f7756179d7e75d1f6687d145e) - submodule update *(commit by joanise)*
- [`c441643`](https://github.com/roedoejet/EveryVoice/commit/c441643cb3ceda04eefc92ff3c291ece1df068e7) - submodule update *(commit by SamuelLarkin)*
- [`75ca553`](https://github.com/roedoejet/EveryVoice/commit/75ca5530f5995fce62f7d8e1c1c7abc1d056ea25) - update submodules *(commit by joanise)*
- [`e6421c1`](https://github.com/roedoejet/EveryVoice/commit/e6421c12fed6facd3a9c00b282300c2fa098f0b4) - update submodules *(commit by roedoejet)*
- [`3be6198`](https://github.com/roedoejet/EveryVoice/commit/3be61989125920436c2b5472ba71217d83fa078a) - remove unused filelists *(commit by roedoejet)*
- [`6efaf73`](https://github.com/roedoejet/EveryVoice/commit/6efaf737f186845e196c1a68476a701a636ee5e1) - **fs2**: submodule update *(commit by SamuelLarkin)*
- [`74cd34e`](https://github.com/roedoejet/EveryVoice/commit/74cd34e4a9f653d84d751326ac718c3ebb837557) - **HiFiGAN**: submodule update *(commit by SamuelLarkin)*
- [`85d1490`](https://github.com/roedoejet/EveryVoice/commit/85d149064d052f6720dba2482219eac5f68babbc) - **fs2**: submodule update *(commit by SamuelLarkin)*
- [`1be0482`](https://github.com/roedoejet/EveryVoice/commit/1be04829db5a529b4216ef5fc0df5d9741d28002) - update submodules to apply black bump *(commit by joanise)*
- [`c9c7c2f`](https://github.com/roedoejet/EveryVoice/commit/c9c7c2f262941c70ed70ff60b142841e64dab609) - bump version to v0.1.0a0.dev0 *(commit by roedoejet)*