Dl1-data-handler

Upgrade to MARS v2-20-1 superstar files
Aligned MAGIC files with ctapipe conventions to share the same CTLearn config

Major Features And Improvements

Bug Fixes and Other Changes
* code clean up 112


Known Issues

* Increase of RAM usage in the DL1DataReaderSTAGE1, when the DL1 files are split by tel_id. Issue 104. At the moment it is recommended to use the DL1 files, where the telescope tables are split by tel_types.

Bug fix for stage1 datasets (split by tel_types)

Major Features And Improvements

Bug Fixes and Other Changes
* fix the tel id select option for stage1 datasets (split by tel_types) 111


Known Issues

* Increase of RAM usage in the DL1DataReaderSTAGE1, when the DL1 files are split by tel_id. Issue 104. At the moment it is recommended to use the DL1 files, where the telescope tables are split by tel_types.

Update of dependencies 110

Major Features And Improvements

Bug Fixes and Other Changes
* Fix hyperlinks in README for pypi upload

Known Issues

* Increase of RAM usage in the DL1DataReaderSTAGE1, when the DL1 files are split by tel_id. Issue 104. At the moment it is recommended to use the DL1 files, where the telescope tables are split by tel_types.

Support latest official CTA DL1 data model v2.1.0 (still supporting Prod5 files with v1.1.0)

Numerous bugfixes and improvements.
DLEventSource for MAGIC calibrated files by sahilyadav27.
DLEventSource for MAGIC superstar files.
Expansion of the data format with image parameters by LucaRomanato.
Compatibility with ctapipe v0.9.1.

Major Features And Improvements

* Updated DL1DataWriter to ctapipe v0.9.1 and expand the data format with image parameters.
* Make ctapipe's image_extractor and gain_selector configurable in the config.
* Added multiple parameter tables for different cleaning settings. Use MARS default ones for MAGIC superstar files.
* Added ability to only store selected tels (by tel_id).
* Updated example notebook (also for MAGIC data).
* Updated conda package build files and setup.py dependencies.

Bug Fixes and Other Changes


Known Issues

* The image parameters can't be read by the current DL1DataReader. This is planned for the next release DL1DH v0.9.1.
* Calling file.close() in the destructor of CTAMLDataDumper causes a KeyError on some data files due to an empty NodeManager registry. The cause of this exception is unclear. The exception resulting from the call is currently being caught and ignored.