Imap-processing

This is the October 2024 release.

Highlights
* Instrument Processing
* Improvements/additions to Ultra processing
* Added spatial and energy binning equations
* Added exposure time and pointing frame
* Updates to L1B Annotated products
* Added PSET spacecraft frame and PSET helio frame exposure times
* Improvements/additions to I-ALiRT processing
* Added HIT algorithm lambda
* Improvements/additions to GLOWS processing
* Updates to L1 CDF dtypes for outputs
* Added validation tests for L1A and L1B
* Improvements/additions to MAG processing
* L1a compression fixes
* Improvements/additions to Lo processing
* Updates to use new decompression tables
* Refactored L1A direct event data class to function
* Combined segmented direct event data
* Improvements/additions to Hi processing
* Added extract method for generating L1B direct event DataArrays
* Populated L1A direct event CDF files with simulated data
* Updated product definition esa_step
* Added computation of `coincidence_type` and time deltas
* Added computation of HAE lattitude and longitude
* Added logical source parser
* Improvements/additions to SWAPI processing
* Updated tests and validation data
* Updated L2 variable names
* Updated L1 to store other housekeeping variables
* Improvements/additions to SWE processing
* Improvements to L1 for L2 processing
* Added L1A CDF validation
* Added conversion of counts to phase space density
* Improvements/additions to HIT processing
* Refactored L1A processing to use `packet_file_to_datasets` function
* Misc
* Updated Poetry documentation
* Added SPICE directory to the documentation build
* Added epoch to J2000 seconds function for SPICE
* Added calculations for instrument spin phase for SPICE
* Upgraded `cdflib` version
* Upgraded `space_packet_parser` version
* Bug Fixes
* Fixed bug in I-ALiRT deployment
* Fixed bug in Lo unpacking scheme definitions
* Fixed bug in SPICE function `get_spacecraft_spin_phase` to avoid returning all `nan`s


What's Changed
* calculate partical energy by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/888
* SWAPI new test and validation data by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/891
* 913 hi l1a update hi product definition esa step by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/914
* Fixed Lo DE unpacking scheme by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/901
* GLOWS L1 updates by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/889
* 795 spice instrument pointing at specified time by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/903
* Fixing histogram attrs missed in last PR by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/919
* Add Ultra spatial and energy binning equations. by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/875
* Ultra: Added exposure time for pointing frame by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/967
* Updated New Lo Histogram Decompression Tables by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/921
* Extract L1B DE function for better code modularization by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/969
* SWE L1 Improvement to store acquisition time of each measurement by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/881
* Lo L1A Direct Event Refactor by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/971
* MNT: Cdflib update by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/991
* 864 hi l1b compute coincidence type and time deltas by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/995
* Add spice module to documentation by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1010
* 1020 bug get spacecraft spin phase always returns nans by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1021
* 1019 calculate instrument spin phase by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1022
* Update to poetry docs by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1027
* Add function to convert j2000ns to j2000s by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1025
* Poetry doc update by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1029
* MNT: space_packet_parser update by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1007
* 867 hi l1b compute hae latitude and longitude by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1032
* swe l1a validation data by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1038
* SWAPI: rename CDF variable names to match algorithm document by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1042
* Lo DE Segmented Packets by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1016
* bugfix for apid by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1046
* Ultra PSET Spacecraft Frame + PSET Helio Frame Exposure Times by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1040
* Update Ultra l1b Annotated by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/989
* 1026 logical source parser by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1044
* SWE: calculate phase space density by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1041
* SWAPI: Add additional support data to SWAPI L1 and L2 by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1043
* 1045 hi l1b modify processing workflow to use xarraydatasetupdate by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1054
* Mag l1a compression fixes by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/1082


**Full Changelog**: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.6.0...v0.7.0

This is the September 2024 release.

Highlights
* Data Access API
* Added query parameter for returning files acquired in the last 24 hours
* Added query parameter for returning files acquired in the last `N `days
* Improvements to query parameter validation and handling of 502 errors
* Instrument Processing
* Improvements to CoDICE L1a processing:
* Updated XTCE definitions
* Implemented `packet_file_to_datasets` utility function, which simplifies the processing algorithm
* Added support for variable length packet data
* Updating CDF variable/attribute names to match expected nomenclature
* Added `CATDESC` and `FIELDNAM` descriptions to housekeeping attributes
* Refactored pipeline to allow more flexibility in configuring the 18 different CoDICE L1 data products
*Improvements to Ultra L1 processing:
* Created Ultra pset energy bins
* Implemented Ultra L1b extended ssd and extended energy
* Implemented Ultra particle velocity and SSD TOF
* Improvements to Lo L1 processing:
* Improved Lo L1a CDF YAML definitions
* Updated Lo L1a dependency table
* Refactored`packet_file_to_datasets` utility function for Lo
* Improvements to HIT L1 processing:
* Now using raw L0 file as a single L1a dependency
* Implemented unpacing of L0 count rates data
* Now grouping L0 science packets into science frames
* Updated L0 dependency table
* Updated sci deom to group packets and parse count rates
* Implemented `packet_file_to_datasets` utility function, which simplifies the processing algorithm
* Improvements to SWAPI processing:
* Updated L1 quality flags to work with numpy v2.0+
* Added quality flags for L2 algorithm
* Added L3 levels to list of valid levels
* Updated L2 dependency table
* Improvements to SPICE:
* Implemented SPICE frame transform function
* Implemented some SPICE infrastructure and simple geometry function
* Implemented spin phase query utils function, using spin start and spin rate data
* Implemented spin phase calculation using spin data
* IDEX L1 processing is now split into L1a and L1b processing/data products
* Implemented `packet_file_to_datasets` utility function for SWE pipeline, which simplifies the processing algorithm
* Implemented HIT CCSDS packet generation for I-ALiRT
* Updated `met_to_j200ns` function
* Updated Hi product definition to have int64 data instead of uint64
* Misc
* Refactored AWS infrastructure to use Constructs instead of Stacks
* Initial set of materials sent to web team for initial implementation of SDC website
* Added AWS stack to handle website deployment
* Added `Parents` attribute to CDF files that indicate parent data products used to create the CDF
* Added wheel build to releases
* Improvements to dependency management documentation
* Now ignoring `conftest.py` modules in Codecov reporting
* Updated EventBridge rule to match new SPICE path in data bucket
* Bug Fixes
* Fixed bug in SPICE batch job
* Fixed bug that was causing SPICE to fail loading metakernel
* Fixed unique constraint for dependency table

Full Changelog
* Ultra l1b extended ssd by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/789
* Docstring, variable name, formatting updates to IDEX L1 by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/799
* Implement packet_file_to_datasets function for CoDICE by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/804
* SPICE geometry enums and IMAP state function by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/791
* SWAPI Quality Flag by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/805
* WIP/MNT: Update SWE to use packet_file_to_datasets by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/802
* Create Ultra pset energy bins by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/811
* Added new tof test data by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/807
* Define spatial bins for pset by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/819
* 689 spice update met to j2000ns by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/818
* Ultra particle velocity and SSD TOF by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/823
* Updated CoDICE XTCE files from imap_xtce tool by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/812
* Updated various CDF attributes/variable names to match expected nomenclature by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/813
* Added FIELDNAMs, LABLAXISs, and CATDESCs for housekeeping attributes by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/816
* I-ALiRT - Test decom for HIT CCSDS by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/757
* Pointing frame updates by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/814
* BUG - fix for time kernels not loading during `imap_cli` command by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/838
* Separate IDEX L1 into L1a and L1b by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/831
* ignore conftest.py files in codecov by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/846
* Dependency documention by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/844
* Test infrastructure for external spice kernels by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/842
* Ultra l1b extended energy by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/825
* Added SWAPI L3 levels to the list of valid levels by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/847
* Lo L1A Histogram packet_to_dataset() Refactor and CDF Creation by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/788
* Spin data and Spin Phase function setup by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/824
* FIX: Update SWAPI quality flags to work with numpy 2+ by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/848
* Mag l1a compression by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/801
* HIT sci decom - group packets & parse count rates by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/815
* Lo L1A CDF YAML Reorganization by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/860
* ENH: Add "Parents" global attribute to datasets by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/858
* MNT: Change default to use raw value in packet_file_to_datasets by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/857
* Refactor hit_l1a.py to use packet_file_to_datasets function by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/828
* CoDICE data product organization refactor by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/826
* Convert all hi instances of uint64 CDF variables to int64 by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/872
* Spin phase calculation using spin data by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/852
* 859 spice frame transform function by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/861
* Ultra l1b species + start to l1b Annotated by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/851
* REL/CI: Add wheel build to release by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/878


**Full Changelog**: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.5.0...v0.6.0

This is the release for August 2024.

Highlights
* Data Access API:
* Improvements to documentation and help menus
* Added demo/examples notebook
* Added support for `filename` query parameter
* Fixed output table formatting
* Instrument Processing:
* Updated CDF attributes for GLOWS
* Implemented proper unpacking and restructuring of data arrays for CoDICE-lo L1 data products
* Updates to global CDF attribute metadata
* Added Ultra Extended L1B lookup tables
* Added support for bitflags
* Added DynamoDB Streams for i-alirt packet ingest
* Added Ultra pulse height calculations
* Added SPICE pointing frame
* Updated Lo and HIT XTCE files
* Created module structure for SPICE functions
* Added SPICE kernel furnishing decorator
* Migrated HI L1a housekeeping to use `CdfAttributeManager`
* Refactored `epoch` attributes
* Initial implementation of SWAPI L2 alrgorithm
* Misc
* Various updates to XTCE generator script and improved documentation
* Enabled support for `numpy` `v2.x`
* Bug Fixes:
* Fixed bug in `--end-date` query parameter in Data Access API
* Fixed bug in `mypy` pre-commit check so now it covers entire code base

Full Changelog
* Refactor epoch attrs by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/718
* MNT/ENH: Add FLOAT and FILL options for spreadsheet dataType by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/701
* MNT: Minimize the datatypes created from space_packet_parser by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/723
* SWAPI l2 Implementation - counts to rate by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/721
* Bitflags by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/694
* MNT: Change to a period separator for XTCE definitions by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/726
* Ultra Extended L1b Lookup tables by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/696
* Data access api by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/720
* packet_file_to_datasets *NOT* in IDEX by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/743
* Define the imap_processing spice structure by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/733
* Mypy Update by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/731
* Glows cdf attrs update by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/725
* MNT: Update global CDF attribute metadata by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/747
* Ultra Extended L1b Front Coordinates by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/730
* Calculate the path length for L1b Ultra by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/749
* Various CoDICE L1 Updates by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/711
* 728 spice kernel furnishing decorator by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/734
* Updated/Combined Lo XTCE by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/754
* MNT: Enable numpy 2+ installs by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/758
* DOC: Update XTCE generator documentation by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/766
* Pointing frame code by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/759
* Add Pulse Height Calculations by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/750
* MNT: Add useful error message when packet to datasets fails by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/763
* FIX: Avoid loss of precision when casting in packet loading (alternative) by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/786
* CoDICE L1 decompression and unpacking data updates by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/762
* ENH: Add Enumeration states to XTCE parser by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/783


**Full Changelog**: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.4.0...v0.5.0

This is the release for (most of) June and July 2024, and the latest release before the IMAP Science Team Meeting on Aug 1st and 2nd.

Highlights
* Added automated `numpydoc` and `mypy` checks to `pre-commit` hooks
* Added `end-date` parameter to CLI script
* Added unit tests for new CDF attribute management code
* All instrument pipelines now return `xarray` `dataset` objects instead of filepaths
* Added support for array-like time conversions
* Updated IDEX, HI, HIT, MAG, and SWAPI pipelines to use new yaml-based CDF attribute management code instead of dataclasses
* Updated citation info
* Updates to XTCE generator script to be instrument-agnostic
* Added generalized dataset creation code

Full Changelog
* FIX: CLI help needs to be strings not tuples by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/646
* Add numpydoc Pre-Commit Hook Pt.1 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/639
* Add numpydoc pre-commit For SWE Pt.2 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/641
* Add numpydoc Pre-Commit For Ultra & Swapi Pt.3 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/643
* Add numpydoc Pre-Commit For Mag & Lo Pt.4 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/644
* Add numpydoc Pre-Commit For ialirt & idex Pt.5 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/647
* Add numpydoc Pre-Commit for Hit & Hi Pt.6 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/651
* Add numpydoc Pre-Commit For Codice & Glows Pt.7 Last One by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/652
* Updates to the CLI to include the end-date by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/658
* Cdf attribute tests by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/637
* Git workflow update by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/650
* MNT: Pass around dataset objects rather than file objects by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/657
* ENH/MNT: Allow array-like time conversion by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/653
* CDF Updates by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/660
* 662 migrate remaining hi products to use cdfattributemanager by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/671
* Fix Hi L1b test marked xfail by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/681
* Update Management of HIT CDF Attributes to use YAMLs by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/679
* XTCE generator scripts by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/680
* Update citation info by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/685
* Add mypy Pre-commit Hook and Fix tools folder Pt.1 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/659
* Add mypy Pre-Commit Hook for files Pt.2 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/661
* Add mypy Pre-Commit For Ultra Pt.3 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/663
* Add mypy Pre-Commit for swe Pt.4 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/666
* Add mypy Pre-commit for swapi Pt.5 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/667
* Add Pre-Commit For mag Pt.6 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/668
* Add mypy Pre-Commit For Lo Pt.7 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/669
* Add mypy Pre-Commit For idex Pt.8 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/670
* Add mypy Pre-Commit For ialirt Pt.9 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/673
* Add mypy Pre-Commit For hi & hit Pt.10 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/674
* Add mypy Pre-Commit for glows Pt.11 by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/676
* Add mypy Pre-Commit for codice Pt.12 Last by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/678
* Improvement to correct numpy update issue for Ultra by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/638
* CLI Type cleanup/standardization by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/692
* Glows l1a cdf by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/688
* Update IDEX by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/695
* Xtce combined by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/654
* ENH/MNT: Add a common initial dataset creation routine by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/687
* 682 imap hi use imapcdfattributes instead of cdfattributemanager by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/684
* Hi test data and fixture refactor by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/709
* switched SWAPI CDF attrs to use YAML by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/704
* Move MAG L1A to CDF attribute manager by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/693
* Cleanup CDF dataclass by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/714


**Full Changelog**: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.3.0...v0.4.0

This release includes updates to be used for the IMAP SDC Software Integration Test 3 (SIT-3). More information can be found in this [galaxy page](https://lasp.colorado.edu/galaxy/display/IMAP/SIT+SDC-3+Test+Plan).

Highlights
* Updated L0 decommutation algorithms for Ultra
* Added unit tests for L0 decommutation for SWAPI
* Added support for L1 processing for several instruments (CoDICE, GLOWS, Hi, HIT, Lo, MAG, SWAPI, SWE, Ultra)
* Moved to YAML-based solution for defining CDF attributes
* Updated cli script for triggering processing for instruments; added support for all instruments; added functionality for downloading dependencies and uploading produced files; added support for `descriptor` field.
* Updated logging in L1 processing pipelines to use module-level logs
* Updated documentation, particularly for CDF attributes and file structure, file naming conventions, and git/GitHub workflow
* Added SPICE examples for Annotated Events
* Added codespell pre-commit check
* Updated version of `space_packet_parser` and `cdflib`
* Added citation information and DOI badge for citing the repository
* Added `load_cdf` helper function
* Added `launch_time` parameter to `cdf.utils.calc_start_time` to allow instruments to define their own launch time.
* Now defining repository version dynamically


Full Changelog
* FIX: Make sphinx-contrib an optional dependency only needed for doc builds by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/333
* FIX: Make sure configurations are synced between packages by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/336
* Fix IDEX and HIT tests by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/337
* Update ruff by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/343
* HIT housekeeping data class by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/342
* Limit bitstring usage by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/344
* Mag cdf by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/340
* Updated naming conventions for CoDICE by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/334
* CLI updates by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/341
* MAG CDF updates by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/349
* L0 Decom Ultra by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/347
* Create l1a cdfs for auxiliary data packet by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/352
* Update CoDICE CDFs to use datetime64 for EPOCH by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/354
* Swapi decom tests by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/355
* update to docker example that is used to build batch job image by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/351
* Update decom for APID 881 due to changes in packet definitions by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/353
* SWE updates to be compliant with new cdflib releases by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/357
* Lo SciDE data class fix - multiple DEs in a packet by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/339
* Updated naming and data product versioning conventions by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/358
* MNT: Cleanup extra file in repository by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/361
* TST: Rely on temp directory for test file cleanup by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/360
* MNT: Use module-level logger by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/362
* Added l1a cdf generation for all apids by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/356
* MNT: Update file naming convention via imap-data-access upgrade by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/363
* Remove Warnings by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/365
* MNT: Rename Epoch to epoch lowercased for variable names by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/366
* hi direct event l1a processing by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/364
* Docs for calibration files by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/367
* Initial CoDICE L1a algorithm for lo-sw-species data by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/300
* Update documentation variable names by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/368
* Various fixes and improvements to CDF documentation by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/372
* Updating mag CDF generation to match new filenames by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/370
* IMAP-Hi L1A DE after Discussion with Paul by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/369
* MNT: Change default display_type to be no_plot by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/375
* MNT: Remove unused extra test file by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/373
* TST: Move codice xfail into a separate test by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/377
* MNT: Change IDEX packet definition to be formatted like others by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/376
* MNT: Remove unused extra file by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/381
* MNT: Add codespell and fix spelling mistakes found by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/382
* Update IMAP-Hi DE CDF attrs by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/374
* Process IMAP-Hi Housekeeping data and create CDF file by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/371
* TST: Avoid xarray.dims deprecation by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/380
* MNT: Remove directory option from write_cdf by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/379
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/385
* Add vmartinez-cu to contributors by allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/388
* docs: add subagonsouth as a contributor for review by allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/389
* Added SPICE examples for Annotated Events by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/386
* Update space_packet_parser version by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/387
* Add citation file by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/392
* Mag l1a processing by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/384
* CDF attrs bug fix by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/393
* CoDICE L1a for lo-sw-species-counts (and improvements to housekeeping) by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/391
* Small updates to the CDF documentation by bryan-harter in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/383
* Added SWAPI science data CDF attribute by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/394
* added SWAPI housekeeping processing and CDF attrs by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/398
* Science Direct Event Decompression Re-write by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/397
* Initial Lo L1A Science DE CDF by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/396
* Lo Star Sensor and Science Counts data classes with bit decompression by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/319
* MAG L1A CDF by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/395
* Remove individual IMAP-Hi packet definition xtce files by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/401
* Updating CLI to fix MAG by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/404
* CoDICE lo-sw-species-counts test data by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/402
* CoDICE L1a lo-nsw-species-counts by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/530
* updates to utils create_dateset function by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/532
* Updates based on SPDF feedback by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/533
* IMAP Hi Histogram L1A processing by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/535
* Initial Codice L1A validation tests by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/534
* docs: add subagonsouth and vmartinez-cu as a contributor for code by allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/539
* MNT: Remove direct bitstring dependency by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/536
* CoDICE L1a lo-sw-priority-counts by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/540
* CoDICE L1a Lo Sunward Angular Counts by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/544
* load_cdf helper function by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/537
* Cleaning up some L1A hist CDF issues found when reviewing output file by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/547
* CI: Add codecov upload token by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/554
* Add launch_time parameter to cdf.utils.calc_start_time by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/552
* Add a DOI badge to the README by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/555
* Refactor imap_processing.cli.ProcessInstrument by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/550
* WIP - Define L0 data class attributes for HIT science packet by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/549
* Removed all non-science data for SWE by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/558
* CoDICE L1a various fixes by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/557
* Updates to SWE based on new test data by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/560
* 203 imap hi l1b processed housekeeping by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/559
* L1A SIT-3 Preparation by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/556
* Update to SWE processing in cli.py by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/561
* Added SWAPI and IDEX to cli.py by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/565
* CI: remove minor/patch version pin from codecov by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/568
* CoDICE L1A cli by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/570
* [WIP] New file defining HIT CDF attributes by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/563
* Codice L1A updates for SIT-3 by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/567
* L1b outline for Ultra by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/566
* Glows l1a cdf first draft by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/546
* SwxSOC cdf investigation by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/564
* MNT: Minimize warnings and prepare for the future by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/572
* ENH/tools: Add metadata helper script to convert excel to yaml by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/562
* Dynamic version by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/571
* Move CoDICE to YAML-based CDF attribute definition by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/582
* Sit 3 Ultra L1b and L1c by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/581
* Create HIT L1A CDF for Housekeeping by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/583
* Created SWE CDF Attrs YAML by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/584
* CoDICE L1a lo-counters-aggregated and lo-counters-singles by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/585
* TST/FIX: cast to datetime64[ns] to avoid warnings by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/598
* docs: add daralynnrhode as a contributor for code, and doc by allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/601
* docs: add anamanica as a contributor for code, and doc by allcontributors in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/602
* MNT/TST: Prepare for cdflib upgrade by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/600
* Adding LABL_PRT_i to 2D or higher Dimension Data Type - SWE by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/603
* Update CLI for HIT L1A by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/590
* Lo L1A processing and CDF For SIT-3 by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/599
* Text update to API doc Explanation by daralynnrhode in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/586
* CDF file requirements example by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/587
* BUGFIX - load_cdf results in added xarray specific attributes by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/597
* Workflow Edits by anamanica in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/596
* Codice L1a hi products for SIT-3 by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/608
* MNT: Docs Updates by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/610
* 205 imap hi l1b annotated direct events by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/604
* Lo L1B CDF Creation for SIT-3 by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/607
* Add back in File_naming_convention to CDF global attribute schema file by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/613
* Glows l1b processing by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/605
* Fix for data_version in file output, using SWE as an example by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/611
* Data version update by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/619
* Codice l1a CDF fixes by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/617
* HIT L1B CDF Creation for SIT-3 by vmartinez-cu in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/616
* Lo L1C CDF Creation for SIT-3 by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/614
* Data version fixes for SWE and SWAPI by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/621
* Data_version updates to Lo L1C by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/625
* Glows l1b cdf by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/618
* REL/CI: Add build job dependency to release process by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/624
* Inital Codice L1b processing (for SIT-3) by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/622
* HIT Data_version fixes by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/626
* Mag L1B/L1C cdf by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/623
* 609 imap hi l1c pointing set cdf by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/627
* 630 final hi updates for sit 3 by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/631
* Glows fixes for deployment by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/629
* Add to SIT-3 data variables by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/589
* Add Hi sensor name to imap_hi_l1b_hk products by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/633
* Mag hotfix by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/636
* Update for Sit 3 by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/635
* MNT: Add optional descriptor field to the cli by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/640
* Add back Lo Data Version input for lo_l1c in cli.py by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/642

**Full Changelog**: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.2.0...v0.3.0

Full Changelog
* Lo L1C CDF Creation for SIT-3 by sdhoyt in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/614
* Data version fixes for SWE and SWAPI by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/621
* Data_version updates to Lo L1C by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/625
* Glows l1b cdf by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/618
* REL/CI: Add build job dependency to release process by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/624
* Inital Codice L1b processing (for SIT-3) by bourque in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/622
* HIT Data_version fixes by tech3371 in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/626
* Mag L1B/L1C cdf by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/623
* 609 imap hi l1c pointing set cdf by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/627
* 630 final hi updates for sit 3 by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/631
* Glows fixes for deployment by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/629
* Add to SIT-3 data variables by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/589
* Add Hi sensor name to imap_hi_l1b_hk products by subagonsouth in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/633
* Mag hotfix by maxinelasp in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/636
* Update for Sit 3 by laspsandoval in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/635
* MNT: Add optional descriptor field to the cli by greglucas in https://github.com/IMAP-Science-Operations-Center/imap_processing/pull/640


**Full Changelog**: https://github.com/IMAP-Science-Operations-Center/imap_processing/compare/v0.3.0rc1...v0.3.0rc2