Luigi

Added:
luigi
* Add BaseTIS to the company list 2607
* Add Hopper to the company list 2614
* give a few default values to opts when setting up logging 2612
* Add range functionality for monthly cadence. 2601

luigi.contrib
* Added port to PostgresTarget 2615
* Support for Azure Blob Storage Target 2585
* Add Datadog contrib for monitoring purpose 2434


Fixed:
luigi
* Docs: Fixed a mistake with inherits syntax in luigi/util.py 2613
* Check type of column before migrating schemas for task db history for postgres dialect (fixes 2563) 2564

luigi.contrib
* S3: Fix call to message from TypeError not working with Python 3.6 2617
* Use proper API call in bigtable.py's make_dataset 2618
* Sqla: Fix the table name when reflect is True in sqla.CopyToTable (fixes 2604) 2605


Changed:
luigi.contrib
* Changed to buffered reads when using GCSTarget 2588

* fix logging setup in Python 2.7 (2593)

**Note: Broken** due to a runtime error in LuigiConfigParser. See https://github.com/spotify/luigi/issues/2592.

Added:
luigi
* Add some docs to interface.run 2582
* Configure logging via TOML config 2483

luigi.contrib
* Added port property to CopyToTable 2561
* Make it so we can do from luigi.contrib.hdfs import HdfsFlagTarget 2594
* contrib: Add ExternalDailySnapshot 2591

Fixed:
luigi
* (docstring) Update task.py 2589
* Docs: Fixed "Github" to fit to the rest of the doc 2596
* Fix inspect.getargspec() DeprecationWarning in PY3 2579

luigi.contrib
* Fix Travis Moto Test Failures 2586
* Reduce TravisCI Test Runtime 2541

Changed:
luigi
* Make Worker parameter task_process_context an OptionalParameter 2574

luigi.contrib
* S3Client improvements 2569

This is a minor version bump, due to:

* Dropping Python 3.4 and 3.5 from CI, which means no automated tests to ensure compatibility for those versions
* [Security Patch] CORS being disabled by default. A new section of configuration [cors] is introduced to enable custom settings. For details, refer to user group topic: https://groups.google.com/forum/#!topic/luigi-user/ZgfRTpBsVUY

Added
luigi:
* Add Python 3.7 compatibility (2466)
This also drops 3.4 and 3.5 from CI.
* Interpolate environment variables in .cfg config files (2527)

luigi.contrib:
* Add CopyToTable task for MySQL (2553)
* Add HdfsFlagTarget (2559)

luigi.contrib:

Fixed
luigi:
* Fix ReadTheDocs build (2546)
* Make capture_output non-positional in ExternalProgramTask (2547)
luigi.contrib:
* Fix S3Client's _path_to_bucket_and_key to support keys with question marks (2534)
* Fix S3Client.remove - add max batch size (2529)
* Small fix to logging in contrib/ecs.py (2556)
* FIX HdfsAtomicWriteDirPipe.close() when using snakebite and the file do not exist. (2549)

Changed:
luigi:
* [ImgBot] optimizes images (2555)

luigi.contrib:

* Remove s3 bucket validation prior to file upload (2528)
* Refactor s3 copy into sub-methods (2508)

Added
luigi.contrib:
* Added optional choice for hdfs clients (2487)
* s3client check for deprecated host keyword and raise error with the details (2493)
* Add a "capture_output" parameter to ExternalProgramTask (2430)

Fixed
luigi:
* Fix exception when toml lib is not installed (2506)
* Replace direct attribute accessing by using built-n function getattr (2509)
* set upper bound of python-daemon (2536)
luigi.contrib:
* Fix S3Client.copy return value consistency (2488)
* Update MockTarget mode to accept r* or w* (2519)

* revert tornado upgrade (2504)
Upgrading tornado unfortunately breaks older version of Python