Law

Updates and features

- Add logger property to all tasks. (590d5694)
- Streamline interative task output. (0efd55b3)
- Add MultiCSVParameter. (31d0fa86, 004801c9)
- Add cleaner API to util.readable_popen. (d6204d6f)
- Add helper to workflows to get chunks of branches. (0f48f424)
- Add range_expand and range_join functions to util. (258d93fc)
- Add mechanism to require abstract workflow methods. (7cd17b4f)
- Unify common methods across remote workflows, update repr_params. (a2eaec12)
- Add mechanism to further control excluded parameters in tasks. (5c1767b2)
- Remove only_missing parameter from remote workflow, improve task skipping. (d76fa846)
- Update python and boost versions in docker files. (bc4243db)


Improvements and fixes

- Fix parsing of empty CSVParameter. (adbefb80)
- Fix tar gz compression flag in tar formatter, add lzma support. (d226ede4, 0f719e78, 9c09b735)
- Improve interactive output fetching. (f74f26a1)
- Fix remote job shuffling, add option to append retry jobs to the end. (1a35a99f)
- Fix opening uncached remote targets, fix 105. (732950b4)
- Fix interactive python shells in docker images. (6b6da61e)

- Fix sphinx version for docs. (0bc91c4a)
- Refactor docker setup, add 39 image. (1d15b415)
- Mark empty values in cached_workflow_property. (09bc5581)
- Add DotDict to util and use it in workflow requirements and outputs. (1428afef)
- Enable branch map resetting in workflows. (b1614662, 42fc2892)
- Allow progress publishing with precision > 1. (382a4306)
- Optimize interactive task outputs. (76aa8968)
- Fix file touching for remote targets with empty content. (0da0e170)
- Show job log files in polling loop on failures. (fdac7a69)
- Disable job dir cleanup by default for htcondor and lsf jobs. (80df7d7b)
- Fix parsing of global command line arguments. (01c55435)
- Move Proxy command to task.proxy, use also in workflows for gathering task parameters. (a3f92f34)
- Add ProxyCommand helper for sandboxes. (398ee8d4)
- Improve handling of cli args. (c709f4c5)
- Add min_len and max_len options to CSVParameter. (eb8d03a7)
- Support bundles in tf.keras and keras formatters. (c7f846c0)

Fixes

- Add requirements_docs.txt to releases. (10fdb6d9)

Features and updates

- Add unique flag to CSVParameter. (ec151e1a)
- Add profiling contrib package with profile_by_line decorator. (335f870d)
- Add deregister to BaseTask. (0a76c562)
- Add available_packages to law.contrib. (872aab9a)
- Add is_iterable and make_unique to util. (9ab2a7f3)
- Add get_cmdline_arg to parser, update flag_to_bool util. (718ff758)
- Add ipython base task. (fecfaa54)
- Require luigi>=2.8.2. (51d0092d)
- Add interrupt_callback and kill_timeout to util.interruptable_popen. (6f3e7d72)

Improvements and fixes

- Identify IPython output stream as tty handler. (ce250881)
- Refactor handling of local-scheduler flag in docker and singularity sandboxes. (9c3bb2f5)
- Add flag to remote file system for using caching. (a4bf0035)
- Add scheduler flag to publish_message method. (3414fa07)
- Forward keyboard interrupts to docker sandboxes. (8cb0092f)
- Fix syntax of replacing directories when forwarding volumes into sandboxes. (fb2e135f)
- Disable pip caching in docker images. (e3913a43)
- More verbose error on failing imports in law run. (6208c0bc)
- Disentangle docs requirements. (33635cfa)
- Consistent handling of target directory creation. (dcefd945)

- Pin correct luigi version in requirements. (8ec4761c)

Improvements and fixes

- Fix completeness check of local workflow and requiring branches. (31d45dfa)
- Fix negative delays in delay decorator. (a5d1cf1a)
- Ensure lists in util.multi_match. (fcb9d754)
- Refactor all interactive task methods. (26202a20)
- Refactor remove_task_output, handle collections interactively. (afe2b6ff)
- Print output structure information in print_task_status. (bd147293)
- Improve keras model formatters, add weight file formatters. (6f288500, 3b9d0b91)
- Refactor job argument handling (97). (6f1136a5)
- Refactor util.flatten, configure types to be flattened. (31f264c7)
- Handle KeyboardInterrupt in decorator errors and util.join_generators. (62718dd7)


Features and updates

- Cleanup patches, standardize names. (4817a227, 415a901b)
- Patch luigi interface logging. (549d9e2d)
- A contrib module rich logging (98). (7e4b4ff4)
- Add common_task_params to util. (7f036adc)
- Make file modes in localize decorator configurable. (8dba9321)
- Make number of parallel jobs in remote workflow dynamic via scheduler messages. (680dc991, cac6ef65)
- Add ForestMerge to contrib tasks, deprecate CascadeMerge. (1070c447)
- Add complete_on_success decorator to RunOnceTask in tasks contrib. (73159c9c)
- Add from_directory factory function to SiblingFileCollection. (cc08be99)
- Add docker image for examples, close 68. (6933cdba)
- Add %ilaw magic in ipython contrib. (7bb43932)
- Add law_run util. (0604d938)
- Update python and boost versions in docker images. (a85e12e9)