Hyfi

Fix

* **workflow:** Add auto_populate property to WorkflowConfig class, remove project parameter from task run method ([`f5e5f4d`](https://github.com/entelecheia/hyfi/commit/f5e5f4d4c463d3442503aa2ef316b726156c910e))
* **task:** Add BatchPathConfig and TaskPathConfig ([`0081f91`](https://github.com/entelecheia/hyfi/commit/0081f91ce2ce0b46be563996d33334b562f5304d))
* **project:** Update path handling and add get_path method ([`26a2d48`](https://github.com/entelecheia/hyfi/commit/26a2d48e4864d38a996379cfaafd587766243bbc))
* **project:** Add ProjectPathConfig ([`e6180a5`](https://github.com/entelecheia/hyfi/commit/e6180a5a868d63b1c5459b0a096fc23377025c15))
* **task:** Use global defaults for task name and root, add properties for project directory and project workspace directory, change task root derivation logic ([`a98dbf0`](https://github.com/entelecheia/hyfi/commit/a98dbf07a0c4002e937cef25bffdf96fa558f859))
* **project:** Add home directory support and enforce absolute paths ([`a948d3a`](https://github.com/entelecheia/hyfi/commit/a948d3a118ee558c274f48cfdc7496b6eda3c3ce))

Feature

* **datasets/utils:** Add DSUtils class with static utility methods ([`c3271e1`](https://github.com/entelecheia/hyfi/commit/c3271e18b1ed6f93fbd78e55733ff06c66ed6a02))
* **hyfi/utils/datasets:** Add types for various datasets ([`407b73a`](https://github.com/entelecheia/hyfi/commit/407b73a55f94cf6393167c9bd35fe2c7e8d358f6))
* **datasets:** Add new transform class for handling datasets ([`f144aec`](https://github.com/entelecheia/hyfi/commit/f144aecfe5e45a35b1335eb04b5cf28d42486b49))
* **datasets:** Add new DSProcess class in process.py ([`2ee478e`](https://github.com/entelecheia/hyfi/commit/2ee478e1b0e15f7a8fbb5433c482492f86ae3d50))
* **datasets:** Add DSSave class with save_dataframes and save_dataset_to_disk methods ([`ce373b6`](https://github.com/entelecheia/hyfi/commit/ce373b697f004cf476d207345b54689cfa32c0d4))
* **DSLoad:** Add methods to load data from various formats and sources ([`5a1d5d0`](https://github.com/entelecheia/hyfi/commit/5a1d5d0387c1440ac2808fd21df10458b14eacbe))
* **hyfi/utils/datasets/filter.py:** Add functionality to filter and sample datasets ([`b498ac3`](https://github.com/entelecheia/hyfi/commit/b498ac3fcd13cf5d01a7fef1b26784cd6ee61ce4))
* **datasets:** Add new modules (DSFilter, DSLoad, DSProcess, DSSave, DSTransform, types and utils) under datasets directory. remove deprecated datasets.py file. ([`6567dbe`](https://github.com/entelecheia/hyfi/commit/6567dbe51e350ec75eded2b757861f67546f9628))

Fix

* **composer:** Streamline override addition process ([`1943f4a`](https://github.com/entelecheia/hyfi/commit/1943f4a9bdcc6f1763f34820d27d83c4ca84a806))

Feature

* **pipe:** Add sample_data.yaml configuration ([`446f815`](https://github.com/entelecheia/hyfi/commit/446f815067cec2d41980f92df1d3d47074dadf36))
* **hyfi/conf/pipe:** Add load_dataframe.yaml configuration ([`edc629e`](https://github.com/entelecheia/hyfi/commit/edc629e7342fedc9cc536d8495d0c4fe7f059771))
* **hyfi/conf/pipe:** Add new filter_data_by_queries configuration file, add new run configuration for filter_data_by_queries ([`8da5d8c`](https://github.com/entelecheia/hyfi/commit/8da5d8cfc552c09f854d5f7e0a1b2b7ad3585911))
* **hyfi/conf/pipe:** Add filter_and_sample_data.yaml configuration file ([`008a1d5`](https://github.com/entelecheia/hyfi/commit/008a1d5f30509970dad8157f8781179ce35b2d23))
* **hyfi/conf/pipe:** Add dataset_to_pandas configuration ([`1386bdd`](https://github.com/entelecheia/hyfi/commit/1386bdd7fc3715ee47c234a247e2cc6d151ecd07))
* **datasets:** Improve sampling logic, add data filtering and sampling methods, add query-based data filter, rename num_samples to sample_size and random_seed to sample_seed ([`e350738`](https://github.com/entelecheia/hyfi/commit/e350738ced664d74421153cabd494bdfca57c7ce))

Fix

* **runner:** BaseRunner now inherits from TaskConfig instead of BaseModel ([`d025731`](https://github.com/entelecheia/hyfi/commit/d0257312542e70c625d40b65910931c055c96cda))

Fix

* **pipeline/config:** Add optional name to PipelineConfig ([`fba13db`](https://github.com/entelecheia/hyfi/commit/fba13db4d805164656618a113f627c8aaa1c3289))
* **pipeline:** Add dryrun option to run_task and run_workflow methods ([`5459f71`](https://github.com/entelecheia/hyfi/commit/5459f71268b0ed9f0cda63c3dd0a76abed477b2d))
* **HyFI:** Integrate dryrun option into function calls ([`fc5af14`](https://github.com/entelecheia/hyfi/commit/fc5af14f95bd3965a4ef91f1f97deaa5588f1a3d))
* **hydra:** Add verbosity check to logging statements ([`7edb914`](https://github.com/entelecheia/hyfi/commit/7edb914f716f96d50974b09062a4a47a2e8fa4b3))
* **core:** Add verbosity level property ([`6bedfb0`](https://github.com/entelecheia/hyfi/commit/6bedfb0e02853c16c67125a5d62772b08b86a2b4))
* **composer-model:** Enhance debug logs with verbosity checks ([`08b582c`](https://github.com/entelecheia/hyfi/commit/08b582cc5e603e361045297e94dba1fe22886450))
* **runner:** Modify _config_group_ path ([`5040bce`](https://github.com/entelecheia/hyfi/commit/5040bce812da8cff4ebc71e8f4411be046e897f7))
* **task:** Add _config_name_ attribute to TaskPathConfig class ([`95364b1`](https://github.com/entelecheia/hyfi/commit/95364b179cb16665e562a9d9a8800eef55396fa7))

Documentation

* Add new files for composer and runner configs, extend content in path, pipe, run configs ([`aa9ea8f`](https://github.com/entelecheia/hyfi/commit/aa9ea8f4ad179d2011e76c6d37369b678abbce38))