Fms-hf-tuning

What's Changed
* fix: check for wte.weight along with embed_tokens.weight by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/356


**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v2.0.0-rc.1...v2.0.0-rc.2

What's Changed
* fix: do not resize embedding layer by default by kmehant in https://github.com/foundation-model-stack/fms-hf-tuning/pull/310
* fix: logger is unbound error by HarikrishnanBalagopal in https://github.com/foundation-model-stack/fms-hf-tuning/pull/308
* feat: Enable JSON dataset compatibility by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/297
* doc: How to tune LoRA lm_head by aluu317 in https://github.com/foundation-model-stack/fms-hf-tuning/pull/305
* docs: Add findings from exploration into model tuning performance degradation by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/315
* fix: warnings about casing when building the Docker image by HarikrishnanBalagopal in https://github.com/foundation-model-stack/fms-hf-tuning/pull/318
* fix: need to pass skip_prepare_dataset for pretokenized dataset due to breaking change in HF SFTTrainer by HarikrishnanBalagopal in https://github.com/foundation-model-stack/fms-hf-tuning/pull/326
* feat: install fms-acceleration to enable qlora by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/284
* feat: Migrating the trainer controller to python logger by seshapad in https://github.com/foundation-model-stack/fms-hf-tuning/pull/309
* fix: remove fire ported from Hari's PR 303 by HarikrishnanBalagopal in https://github.com/foundation-model-stack/fms-hf-tuning/pull/324
* dep: cap transformers version due to FSDP bug by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/335
* deps: Add protobuf to support aLLaM models by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/336
* fix: add enable_aim build args in all stages needed by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/337
* fix: remove lm_head post processing by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/333
* doc: Add qLoRA README by aluu317 in https://github.com/foundation-model-stack/fms-hf-tuning/pull/322
* feat: Add deps to evaluate qLora tuned model by aluu317 in https://github.com/foundation-model-stack/fms-hf-tuning/pull/312
* feat: Add support for smoothly resuming training from a saved checkpoint by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/300
* ci: add a github workflow to label pull requests based on their title by HarikrishnanBalagopal in https://github.com/foundation-model-stack/fms-hf-tuning/pull/298
* fix: Addition of default pad token in tokenizer when EOS and PAD token are equal by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/343
* feat: Add DataClass Arguments to Activate Padding-Free and MultiPack Plugin and FastKernels by achew010 in https://github.com/foundation-model-stack/fms-hf-tuning/pull/280
* fix: cap transformers at v4.44 by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/349
* fix: utilities to post process checkpoint for LoRA by Ssukriti in https://github.com/foundation-model-stack/fms-hf-tuning/pull/338
* feat: Add post processing logic to accelerate launch by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/351
* build: install additional fms-acceleration plugins by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/350
* fix: unable to find output_dir in multi-GPU during resume_from_checkpoint check by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/352

New Contributors
* achew010 made their first contribution in https://github.com/foundation-model-stack/fms-hf-tuning/pull/280

**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v1.2.1...v2.0.0-rc.1

What's Changed
* deps: Add protobuf to support ALLaM models by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/328
* deps: set previous versions for accelerate and trl for patch release by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/329


**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v1.2.1...v1.2.2

What's Changed
* fix: setting log level in save() by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/304


**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v1.2.0...v1.2.1

What's Changed
* fix: setting log level in save() by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/304


**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v1.2.0...v1.2.1-rc.1

Dependency Updates
1. Update packaging requirement from less than 23.2 to a max of 24 to less than 23.2 to max of 25

API/Interface Changes
1. Add optional save_model_dir where final checkpoint is saved. See https://github.com/foundation-model-stack/fms-hf-tuning/blob/main/README.md#saving-checkpoints-while-training

Full List of What's Changed
* Add config_utils tests by aluu317 in https://github.com/foundation-model-stack/fms-hf-tuning/pull/262
* bug: On save event added to callback by seshapad in https://github.com/foundation-model-stack/fms-hf-tuning/pull/256
* feat: All metric handling changes by seshapad in https://github.com/foundation-model-stack/fms-hf-tuning/pull/263
* feat: Configuration to set logging level for trigger log by seshapad in https://github.com/foundation-model-stack/fms-hf-tuning/pull/241
* Data custom collator by Ssukriti in https://github.com/foundation-model-stack/fms-hf-tuning/pull/260
* feat: per process state metric by HarikrishnanBalagopal in https://github.com/foundation-model-stack/fms-hf-tuning/pull/239
* feat: Add a dockerfile argument to enable aimstack by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/261
* Set default value of target_modules to be None in LoraConfig by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/269
* feat: Support pretokenized by kmehant in https://github.com/foundation-model-stack/fms-hf-tuning/pull/272
* Update packaging requirement from <24,>=23.2 to >=23.2,<25 by dependabot in https://github.com/foundation-model-stack/fms-hf-tuning/pull/212
* Enabling tests for prompt tuning by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/278
* fix: do not add special tokens for custom tokenizer by kmehant in https://github.com/foundation-model-stack/fms-hf-tuning/pull/279
* fix: bug where the logger was not being used properly by HarikrishnanBalagopal in https://github.com/foundation-model-stack/fms-hf-tuning/pull/286
* Add functionality to free disk space from Github Actions by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/287
* Add unit test to verify target_modules defaults correctly by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/281
* docs: Add documentation on experiment tracking. by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/257
* Ensure additional metadata to trackers don't throw error in happy case. by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/290
* fix: multiple runid creation bug with distributed training by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/268
* feat: logging control operation by seshapad in https://github.com/foundation-model-stack/fms-hf-tuning/pull/264
* fix run evaluation to get base model path by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/273
* Fix: Removal of transformers logger and addition of python native logger by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/270
* feat: Added additional events such as on_step_begin, on_optimizer_step, on_substep_end by seshapad in https://github.com/foundation-model-stack/fms-hf-tuning/pull/293
* Always update setuptools to latest by jbusche in https://github.com/foundation-model-stack/fms-hf-tuning/pull/288
* Rename all fixtures with correct .jsonl extension by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/295
* feat: add save_model_dir flag where final checkpoint saved by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/291
* feat: Example log controller yaml with training state by seshapad in https://github.com/foundation-model-stack/fms-hf-tuning/pull/296

New Contributors
* aluu317 made their first contribution in https://github.com/foundation-model-stack/fms-hf-tuning/pull/262
* willmj made their first contribution in https://github.com/foundation-model-stack/fms-hf-tuning/pull/269

**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v1.1.0...v1.2.0