Spark-on-k8s

What's Changed

Significant Changes
* chore: remove support for Python 3.8 by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/96

Bug Fixes:
* fix(chart): add missing config to spark-history deployment by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/104
* fix(doc): fix failed mkdocs and remove warnings by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/111
* fix(webserver): fix broken apps endpoint by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/117
* fix(python-client): truncate driver pod name and fix app name/id truncation by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/119

New Features:
* feat(airflow): add on_finish_action to decide what to do when the job finishes by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/100
* feat(python-client): add more config for dynamic allocation by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/102
* feat(cli): add more config for dynamic allocation by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/103
* feat(airflow): create `SparkSqlOnK8SOperator` to execute Spark SQL commands by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/109
* feat(python-client): Support for init containers in driver pod by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/121
* feat(python-client): Support for host aliases in driver pod by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/122

Misc
* chore(airflow): create an enum for app_waiter by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/101
* chore(spark-history): update spark-history image to jdk 17 and spark 3.5.3 by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/105
* chore: update spark version in java example by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/107
* chore: user StrEnum instead of str, Enum by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/108
* chore(doc): add some examples for `SparkSqlOnK8SOperator` operator by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/112
* chore: add sqlfluff to lint spark sql queries by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/113
* chore(doc): add some examples for driver configuration by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/125

**Full Changelog**: https://github.com/hussein-awala/spark-on-k8s/compare/0.10.1...0.11.0

What's Changed
* fix(airflow): load namespace and pod_name from trigger event by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/89


**Full Changelog**: https://github.com/hussein-awala/spark-on-k8s/compare/0.10.0...0.10.1

What's Changed
* security: bump zipp to avoid CVE-2024-5569 by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/81
* security: bump apache-airflow to avoid CVE-2024-39863 and CVE-2024-39877 by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/82
* security: update setuptools to avoid CVE-2024-6345 by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/83
* fix: propagate service account + test by rivamarco in https://github.com/hussein-awala/spark-on-k8s/pull/88
* feat(python-client, airflow): support startup_timeout for pending state waiting by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/84

New Contributors
* rivamarco made their first contribution in https://github.com/hussein-awala/spark-on-k8s/pull/88

**Full Changelog**: https://github.com/hussein-awala/spark-on-k8s/compare/0.9.1...0.10.0

What's Changed
* fix(airflow): fix xcom pull in _try_to_adopt_job by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/80


**Full Changelog**: https://github.com/hussein-awala/spark-on-k8s/compare/0.9.0...0.9.1

What's Changed
* feat(api): support pagination on list_apps route by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/77
* feat: add support for packages param by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/79


**Full Changelog**: https://github.com/hussein-awala/spark-on-k8s/compare/0.8.0...0.9.0

What's Changed
* feat(python-client): support creating and mounting an ephemeral configmap to the driver by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/74
* feat(airflow): support driver_ephemeral_configmaps_volumes by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/75
* security: update urllib3 to avoid CVE-2024-37891 by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/69
* security: bump apache-airflow to avoid CVE-2024-32077 by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/70
* security: update requests to avoid CVE-2024-35195 by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/71
* security: bump certifi to avoid CVE-2024-39689 by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/76
* docs: update python example to explain how to use custom modules by hussein-awala in https://github.com/hussein-awala/spark-on-k8s/pull/73

**Full Changelog**: https://github.com/hussein-awala/spark-on-k8s/compare/0.7.2...0.8.0