Fms-hf-tuning

What's Changed
* fix: broken README.md link by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/429
* feat: Allow hf dataset id to be passed via training_data_path by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/431
* feat: dataclass args for accelerated MoE tuning by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/390
* feat: allow for padding free plugin to be used without response template by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/430
* fix: function name from `requires_agumentation` to `requires_augmentation` by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/434
* fix: Add pad_token to special_tokens_dict when pad_token == eos_token by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/436
* chore(deps): upgrade fms-acceleration to >= 0.6 by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/440
* docs: update granite3 model support by anhuong in https://github.com/foundation-model-stack/fms-hf-tuning/pull/441


**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v2.3.0...v2.4.0-rc.2

New feature updates around data handling and preprocessing:

- Enable loading of Parquet and Arrow Dataset files.
- Dataset mixing via sampling probabilities in data config.
- New additional_data_handlers arg in train function to be registered with the data preprocessor.
- Support multiple files, directories, pattern-based paths, HF Dataset IDs, and their combinations via `data_config`.
- New support for both multi-turn and single-turn chat interactions.

New tracker:
- New MLFlow tracker

Additional Changes
- Refactor test artifacts into tests/artifacts , adding new data types, datasets, and predefined data configs for new unit tests.
- Resolve issues with deprecated training arguments.

Full list of Changes
* feat: Add support to handle Parquet Dataset files via data config by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/401
* test: add arrow datasets and arrow unit tests by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/403
* feat: Perform dataset mixing via sampling probabilities in data config by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/408
* feat: Expose additional data handlers as an argument in train by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/409
* fix: Move deprecated positional arguments from SFTTrainer to SFTConfig by Luka-D in https://github.com/foundation-model-stack/fms-hf-tuning/pull/399
* fix: update dataclass objects directly instead of creating new variables by kmehant in https://github.com/foundation-model-stack/fms-hf-tuning/pull/418
* test: Add unit tests to test multiple files in single dataset by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/412
* feat: Add multi and single turn chat support by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/415
* feat: Integrate MLflow tracker by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/425
* feat: Handle passing of multiple files, multiple folders, path with patterns, HF Dataset and combination by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/424
* docs: Add documentation for data preprocessor release by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/423

New Contributors
* Luka-D made their first contribution in https://github.com/foundation-model-stack/fms-hf-tuning/pull/399

**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v2.2.0...v2.3.1

Release missing the right README docs, please see [v2.3.1](https://github.com/foundation-model-stack/fms-hf-tuning/releases/tag/v2.3.1) for the complete Release Changelog.

What's Changed
* feat: Add support to handle Parquet Dataset files via data config by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/401
* test: add arrow datasets and arrow unit tests by willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/403
* feat: Perform dataset mixing via sampling probabilities in data config by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/408
* feat: Expose additional data handlers as an argument in train by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/409
* fix: Move deprecated positional arguments from SFTTrainer to SFTConfig by Luka-D in https://github.com/foundation-model-stack/fms-hf-tuning/pull/399
* fix: update dataclass objects directly instead of creating new variables by kmehant in https://github.com/foundation-model-stack/fms-hf-tuning/pull/418
* test: Add unit tests to test multiple files in single dataset by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/412
* feat: Add multi and single turn chat support by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/415
* feat: Integrate MLflow tracker by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/425
* feat: Handle passing of multiple files, multiple folders, path with patterns, HF Dataset and combination by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/424

New Contributors
* Luka-D made their first contribution in https://github.com/foundation-model-stack/fms-hf-tuning/pull/399

**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v2.2.1...v2.3.0

Foundational Updates
* Addition of new data preprocessor framework as a base code for future enhancements, while maintaining full compatibility with existing features.

Additional Changes
* Added a Data Preprocessor ADR.
* Moved test datasets from `tests/data` to `tests/artifacts/testdata`.

Full list of Changes
* docs: Data Preprocessor ADR by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/374
* fix: bad name in generic tracker ADR by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/394
* fix: Move test datasets to tests/artifacts/testdata instead of tests/data by dushyantbehl in https://github.com/foundation-model-stack/fms-hf-tuning/pull/398
* feat: DataProcessor v1 by dushyantbehl Abhishek-TAMU willmj in https://github.com/foundation-model-stack/fms-hf-tuning/pull/381
* chore: Release v2.2.0 by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/404
* fix: Limit trl version to <0.12 by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/406
* chore: Release v2.2.0 after limiting TRL version by Abhishek-TAMU in https://github.com/foundation-model-stack/fms-hf-tuning/pull/407


**Full Changelog**: https://github.com/foundation-model-stack/fms-hf-tuning/compare/v2.1.2...v2.2.1