Luigi

Added
luigi
* Improve control over dynamic requirements 3179
* Can pass a JSON schema to DictParameter and ListParameter 3217
* support Python 3.10 3140

Fixed
luigi
* Update random seed for python 3.11 compatibility 3204
* Fix md5 hash error for FIPS in python 3.9 3209
* Catch io.UnsupportedOperation exception 3215
* Fix schema validation and add custom validators 3220

Added
luigi

* Add worker config to cache task completion results. (3178)

Fixed
luigi

* Close requests.Socket in RemoteScheduler before exiting (3173) (3175)
* Use int-parameters for random.randrange() (3177)
* Alternate (probably more correct) fix for 3182 (supercedes 3183) 3185

Added
luigi
* Documentation guidance around release version increments 3074
* Add support for naming tasks in `requires` 3077
* Add `traceback_max_length` parameter for error email notifications 3086
* Document cause of `Unfulfilled dependency` error 3105
* Add additional `OptionalParameter` datatype options 3079
* UI: Add rerun command snippet on "show error" modal 3117
* Add support for updating default config parser after loading luigi 3135
* Allow `batch_email.email_interval` to be set in config as `email-internal-minutes` 3125
* Allow `TimeDeltaParameter` to accept input as "seconds" 3125
* Add `EnumListParameter` to top-level attribute imports 3144
* Enable `metrics_custom_import` for `MetricCollectors` 3146
* Improve warning when a parameter is not consumed by a task 3170

luigi.contrib
* Add `configure_job` BigQuery property 3098
* Add parquet support to BigQuery 3099
* Add network retry logic to BigQuery 3088
* Add `run_task_kwargs` property to ECS 3083
* Add `pickle_protocol` attribute and configuration option to Spark 3001
* Add `pg8000` driver support to Postgres 3142


Fixed
luigi
* Fix default value for `task.disable_window` 3081
* Fix deconstructor of `LocalTarget` when `is_tmp` attribute dne 3085
* Improved documentation reference to `luigi.format.Nop` import 3047
* Fix Python 3.10 deprecation warnings 3150
* Remove unnecessary extra call to `cls.get_task_namespace()` 3129
* Fix documentation typo in `notifications_test.py` 3151
* Fix docs ci 3158
* Fix task history rendering 3153
* Move `max_shown_tasks` and `max_graph_nodes` documentation to correct section 3156
* Fix ability to subclass `Task`'s `Register` metaclass 3154
* Replace legacy TravicCI readme badge with GithubActions 3159

luigi.contrib
* Fix apache ci
* 3091
* 3113
* Fix documentation typo in sqla 3110
* Fix spark cluster mode error for missing path 3111
* Fix connection object passed to `rdbms.CopyToTable`'s `_add_metadata_columns()` 3011


Removed
luigi
* Remove `Tarrasch` from codeowners 3127


Changed
luigi
* Update license copyright year 3108
* Improve error message on parsing default parameter value 3115
* Group tasks by task class in svg graph 3122
* Upgrade `tenacity` version 3147
* Enable task search to be case insensitive 3157

luigi.contrib
* Update ExternalPythonProgramTask parameters to `OptionalParameter` 3130
* Allow newer versions of `prometheus-client` package 3163

Added:

luigi
* Adding retry on _obj_exists 3022
* don't use absolute path in redirect for visualizer 2785

luigi.contrib
* kubernetes: labels are applied to pod 3007

Fixed:

luigi
* Flush stream_for_searching_tracking_url 3000

luigi.contrib
* Fix azureblob tests: use json instead of numpy 3032

Changed:

luigi
* replace naive retry with tenacity 3026

Fixed:
luigi

* Garbage collect task result queue when worker context exits 2973
* Fixing problem with ListParameter and Dynamic Dependencies 2970

Changed:

luigi

* Drop Python 3.3 and 3.4 support 2978

luigi.contrib

* Use updated uri for gcs batch reqs 2998

Added:
luigi
- Worker_timeout can be 0. 2968
- Return bq job id from biquery.run_job() 2957
- Documentation for check_complete_on_run config 2961