Ddeutil-workflow

:sparkles: Features

- :dart: feat: add remove prefix map in hook stage support special param name. (_2024-08-15_)
- :dart: feat: pipeline execute can run parallel job that not need deps. (_2024-08-15_)
- :dart: feat: add job_execute method on pipeline object. (_2024-08-15_)
- :dart: feat: implement fail-fast for job strategy executor. (_2024-08-15_)
- :dart: feat: add muti-processing when job startegy make more than one. (_2024-08-14_)
- :dart: feat: add strategy execution for support parallel job execution. (_2024-08-14_)
- :dart: feat: add fastapi app for handler pipeline schedule. (_2024-08-14_)
- :dart: feat: add poke and release methods on pipeline object. (_2024-08-13_)
- :dart: feat: add search env to param2template utils function. (_2024-08-13_)
- :dart: feat: implement passing arguments to custom filter function. (_2024-08-13_)
- :dart: feat: add post-filter on regex caller that extract from template value. (_2024-08-13_)
- :dart: feat: add post-filter value on caller regex. (_2024-08-13_)
- :dart: feat: change exception on utils to sub-exception class of workflow class. (_2024-08-12_)

:black_nib: Code Changes

- :test_tube: tests: config python logging and coverage omit files. (_2024-08-13_)

:card_file_box: Documents

- :page_facing_up: docs: init and update example docs. (_2024-08-12_)
- :page_facing_up: docs: update config value of this package on readme. (_2024-08-12_)
- :page_facing_up: docs: update readme for add hook function example. (_2024-08-12_)

:sparkles: Features

- :dart: feat: change output of any execution from dict to result dataclass. (_2024-08-12_)
- :dart: feat: add default stage id that was generated from stage name. (_2024-08-12_)
- :dart: feat: add result context for job execution process. (_2024-08-12_)
- :dart: feat: add finditer on the param2template util func support multi replace. (_2024-08-11_)
- :dart: feat: add set output method calling step to job execution process. (_2024-08-11_)
- :dart: feat: add result context to each execution dependency. (_2024-08-11_)
- :dart: feat: add is_skip method on stage and parameterize on pipeline. (_2024-08-10_)
- :dart: feat: add template class variable for dynamic templating params. (_2024-08-09_)
- :dart: feat: add default empty job and change validate condition of strategy. (_2024-08-09_)
- :dart: feat: add dash2underscore on utils func. (_2024-08-09_)
- :dart: feat: add trigger stage to pipeline model. (_2024-08-09_)
- :dart: feat: add ignore content for diagram backup file. (_2024-08-08_)
- :dart: feat: add on in pipeline model. (_2024-08-07_)
- :dart: feat: add dynamic import registry object from list of module path. (_2024-08-07_)
- :dart: feat: remove workflow config file and use env var instend. (_2024-08-07_)

:black_nib: Code Changes

- :construction: refactored: change shell stage to bash stage. (_2024-08-10_)
- :construction: refactored: change task stage to hook stage. (_2024-08-10_)
- :test_tube: tests: change name of config name that use for test. (_2024-08-09_)
- :construction: refactored: deprecate make_strategy method from job to strategy model. (_2024-08-09_)
- :art: style: change code format on the on model. (_2024-08-09_)
- :construction: refactored: move validate on key in pipeline to classmethod. (_2024-08-08_)
- :test_tube: tests: add testcase for pipeine on and desc. (_2024-08-07_)
- :construction: refactored: change schedule object name to On and merge code regex file. (_2024-08-07_)
- :test_tube: tests: uncomment schedule testcase. (_2024-08-06_)

:card_file_box: Documents

- :page_facing_up: docs: update readme for installation with app. (_2024-08-11_)
- :page_facing_up: docs: update readme for deployment topic. (_2024-08-10_)
- :page_facing_up: docs: delete backup diagram file that already add to repo. (_2024-08-08_)
- :page_facing_up: docs: update readme for config content and remove license. (_2024-08-07_)
- :page_facing_up: docs: update readme file for deprecated feature. (_2024-08-07_)

:bug: Fix Bugs

- :gear: fixed: revert change timezone on github action. (_2024-08-08_)
- :gear: fixed: change logic of timezone value that pass to cron runner. (_2024-08-08_)
- :gear: fixed: fix cronjob validate does not valid. (_2024-08-08_)
- :gear: fixed: move conf path on testcase. (_2024-08-07_)

:package: Build & Workflow

- :toolbox: build: remove change timezone on tests action. (_2024-08-08_)

:postbox: Dependencies

- :pushpin: deps: remove schedule package from this project. (_2024-08-07_)

:sparkles: Features

- :dart: feat: add unit dataclass on scheduler. (_2024-06-15_)
- :dart: feat: add on and desc fields on pipeline model. (_2024-06-12_)
- :dart: feat: add env variables for shell stage executor. (_2024-06-11_)

:black_nib: Code Changes

- :test_tube: tests: update testcase that was remove polars package. (_2024-08-06_)
- :construction: refactored: 📦 bump pyarrow from 16.1.0 to 17.0.0 (_2024-08-01_)
- :construction: refactored: 📦 bump boto3 from 1.34.136 to 1.34.151 (_2024-08-01_)
- :construction: refactored: ⬆ bump pypa/gh-action-pypi-publish from 1.8.14 to 1.9.0 (_2024-07-01_)
- :construction: refactored: 📦 bump boto3 from 1.34.117 to 1.34.136 (_2024-07-01_)
- :construction: refactored: 📦 bump fsspec from 2024.5.0 to 2024.6.1 (_2024-07-01_)
- :construction: refactored: 📦 bump sqlalchemy from 2.0.30 to 2.0.31 (_2024-07-01_)
- :construction: refactored: __schedule module to scheduler. (_2024-06-14_)
- :construction: refactored: merge run example conf file together. (_2024-06-11_)

:card_file_box: Documents

- :page_facing_up: docs: update docs string on workflow objects. (_2024-08-06_)
- :page_facing_up: docs: update readme for little detail. (_2024-07-29_)
- :page_facing_up: docs: add license shield on readme. (_2024-06-15_)
- :page_facing_up: docs: add docs-string on loader add merge schedule object. (_2024-06-13_)

:bug: Fix Bugs

- :gear: fixed: remove all vendors to ddeutil-vendors project. (_2024-08-06_)
- :gear: fixed: fix generate crontab value use dow when interval is monthly. (_2024-06-12_)

:postbox: Dependencies

- :pushpin: deps: add schedule deps and rename schedule to on. (_2024-06-12_)

:sparkles: Features

- :dart: feat: add executable function for shell file. (_2024-06-11_)
- :dart: feat: add prepare shell script on the shell stage. (_2024-06-10_)

:black_nib: Code Changes

- :test_tube: tests: add logging on test-case. (_2024-06-10_)
- :test_tube: tests: add test-case for shell script execution. (_2024-06-10_)

:bug: Fix Bugs

- :gear: fixed: change shell flag on subprocess for shell stage. (_2024-06-11_)
- :gear: fixed: add debug logging for test shell stage executor. (_2024-06-11_)
- :gear: fixed: remove shabang and dynamic cmd. (_2024-06-11_)
- :gear: fixed: shell stage does not return the same result. (_2024-06-10_)

:sparkles: Features

- :dart: feat: add prepare params before passing to pipeline. (_2024-06-09_)
- :dart: feat: change some model obj from pydantic to msgspec. (_2024-06-09_)
- :dart: feat: add queue for handle needs job if before that do not run. (_2024-06-09_)
- :dart: feat: add exclude and include logic to matrix feat. (_2024-06-08_)
- :dart: feat: add matrix value on job model. (_2024-06-07_)
- :dart: feat: rename scdl to schedule. (_2024-06-06_)

:black_nib: Code Changes

- :construction: refactored: move connection and dataset to vendors. (_2024-06-09_)
- :construction: refactored: change noted docs and prepare params output. (_2024-06-08_)
- :art: style: change print statement to logging and add pytest conf. (_2024-06-08_)

:card_file_box: Documents

- :page_facing_up: docs: update docs-string on pipeline model objs. (_2024-06-10_)
- :page_facing_up: docs: add noted docs on needs job process. (_2024-06-09_)
- :page_facing_up: docs: add try-except for checking polars deps. (_2024-06-08_)

:bug: Fix Bugs

- :gear: fixed: remove Params from ddeutil-io and use own params instead. (_2024-06-09_)
- :gear: fixed: revert moving connection to vendors. (_2024-06-09_)
- :gear: fixed: remove legacy dir on pyproject. (_2024-06-06_)

:sparkles: Features

- :dart: feat: add from_dict cls method to connection. (_2024-05-30_)
- :dart: feat: add spark docker compose for test pyspark dataframew. (_2024-05-29_)
- :dart: feat: add scan for getting lazy frame on polars tasks. (_2024-05-28_)
- :dart: feat: add Params model on pipeline for validate context. (_2024-05-27_)
- :dart: feat: change name of map_caller to map_params. (_2024-05-27_)
- :dart: feat: remove manual registry and use tag decorator function instead. (_2024-05-27_)

:black_nib: Code Changes

- :construction: refactored: 📦 bump polars from 0.20.26 to 0.20.31 (_2024-06-03_)
- :construction: refactored: 📦 bump boto3 from 1.34.109 to 1.34.117 (_2024-06-01_)
- :construction: refactored: change key name and some values on example yml file. (_2024-05-30_)
- :construction: refactored: clear unuse function from loader from register. (_2024-05-28_)
- :construction: refactored: change type hint and add BaseStage model. (_2024-05-27_)

:postbox: Dependencies

- :pushpin: deps: update ddeutil-io package version that merge models. (_2024-06-03_)