Eoreader

Breaking Changes

- **BREAKING CHANGES: `footprint`, `extent`, `wgs84_extent` and `crs` properties are converted back to methods in order to prevent side effects of expensive computation when displaying the object when
debugging (rollback before version 0.8.0)**
- **BREAKING CHANGES: `get_all_index` becomes `get_all_indices`**
- **BREAKING CHANGES: `acquisition_datetime` becomes `datetime` and `default_resolution`becomes `resolution` for `CustomProduct` in accepted keywords, and the metadata fields have been renamed
according to the `CustomFields` enum**

Enhancements

- **ENH: Adding spectral indices:**
- Shadow Index (`SI`)
- Global Vegetation Moisture Index (`GVMI`)
- Soil Brightness Index (`SBI`), Soil Cuirass Index (`SCI`)
- Panchromatic mocking Index (`PANI`)
- Green-to-Red ratio Index (`GRI`)
- Soil Adjusted Vegetation Index (`SAVI`)
- Optimized Soil Adjusted Vegetation Index (`OSAVI`)
- Visible Atmospherically Resistant Index (Green) (`VARI`)
- Enhanced Vegetation Index (`EVI`)
- Chlorophyll Index RedEdge VRE_3/VRE_2 (`CI1`)
- Chlorophyll Index RedEdge VRE_2/VRE_1 (`CI2`)
- Normalized Difference Moisture Index (with SWIR_21) (`NDMI21`)
- **ENH: Making SAR attribute `snap_filename` public**
- **ENH: Handling `ICEYE` pure SLC products**
- **ENH: Allowing the user to choose if they want the GRD or SLC image for `ICEYE` products**
- **ENH: Add the possibility to directly load the cloud cover for optical data (and add it in the band attributes) ([28](https://github.com/sertit/eoreader/issues/28))**
- **ENH: Add the possibility to retrieve the quicklook path (if existing) and add the `plot` function allowing the user to plot the quicklook (if
existing) ([28](https://github.com/sertit/eoreader/issues/28))**
- **ENH: Add the possibility to retrieve the orbit direction (and add it in the band attributes) ([28](https://github.com/sertit/eoreader/issues/28))**

Bug Fixes

- FIX: Fixing the inversion between `8` and `8A` bands for `Sentinel-2` and `Sentinel-2 Theia` products
- FIX: Loading every optical band in reflectance (fixed for `Sentinel-2 THEIA`, `Maxar`, `Planet` and `Vision-1` data) ([30](https://github.com/sertit/eoreader/issues/30))
- FIX: Fixing `ReferenceError: weakly-referenced object no longer exists` when deleting an object
- FIX: Do not set sea values to nodata when orthorectifying SAR data with SNAP
- FIX: Handle `Sentinel-2` data with PB < 02.07 as `L2Ap` products
- FIX: Fixing nodata and offset for `Sentinel-2` data with PB > 04.00
- FIX: Handle new `ICEYE` metadata name's nomenclature
- FIX: Fixing harmless regex error when searching for B1 path for `Landsat` products
- FIX: Fixing platform for `Sentinel-2 Theia`

Other

- DOC: Creating a real `base` notebook and renaming the old one to `optical`
- DOC: Better type hints (replacing `XDS_TYPE` by `xr.DataArray`)
- CI: Using `sertit.ci.reduce_verbosity` instead of recreating the function

Bug Fixes

- FIX: Handling `Sentinel-2 L2Ap` data
- FIX: Do not use `--no-binary fiona,rasterio` directly in `requirements.txt` (breaks on Windows)
- FIX: Fixing stacking with string bands
- FIX: Better `__repr__` function
- FIX: Read README as UTF-8 in setup.py

Other

- CI: Adding a tag for choosing the runners
- DOC: Fixing cartopy/GEOS conflicts making the documentation build to fail

Enhancements

- **ENH: Adding the support of `Landsat-9` sensor**
- **ENH: Support Sentinel-2 with missing datatake metadata file(sometimes happens with data downloaded from AWS buckets and converted to .SAFE)**

Bug Fixes

- FIX: Using default SAR resolution from
official [Copernicus Data Access Portfolio (2014-2022)](https://spacedata.copernicus.eu/documents/20126/0/DAP+Release+phase2+V2_8.pdf/82297817-2b96-d3de-c397-776292336434?t=1633508426589) (
Sentinel-2 default
resolution goes to 10.0 m !)
- FIX: Use `--no-binary fiona,rasterio` directly in `requirements.txt`
- FIX: Removing useless `outputComplex` line in GPT graphs that is breaking SNAP on Linux
- FIX: Removing the workarounds caused by some bugs of `cloudpathlib` and enabling retrieval of nested SAR products (TSX, TDX, PAZ, RCM) from S3 compatible storage.
- FIX: Do not process nodata for a band already existing
- FIX: Fixing an error when reading `TIR` bands with Landsat-7
- FIX: Fixing an error when additive/multiplicative coefficients are set to `NULL` for Landsat data
- FIX: Returning sun angles always as float (some `Sentinel-3` angles were returned as `np.array`)

Other

- CI: Do not try to process SAR end to end if GPT cannot be found
- CI: Publishing wheel from GitHub instead of Gitlab
- REPO: Setting GitHub as the main repository and using new Gitlab runners

Enhancements

- **ENH: Adding the support of `Pleiades-Neo`, `Vision-1` and `SAOCOM` sensors**
- **ENH: Adding a keyword to allow passing a specific DEM path in `load`/`stack` (for VHR orthorectification and `DEM` bands)**
- **ENH: Adding the name of the DEM in DEM band (i.e. allow to compute the `HILLSHADE` with a DEM and the `SLOPE` with a DTM)**

Bug Fixes

- FIX: `Sentinel-2` Processing Baseline 04.00: `NARROW_NIR` bands are now loaded correctly
- FIX: `Maxar` products (with `Multi` band ID) are now correctly handled
- FIX: Using `COPDEM-30` (`GLO-30`) by default for SNAP as it appears that the retrieval has been fixed.
- FIX: Fixing the default name for cleaned bands for `Sentinel-3 SLSTR` data (was set on `CLEAN` instead of `NODATA`)
- FIX: Fixing default band for Custom stacks
- FIX: Fixing `get_existing_band_paths` behavior for Custom stacks
- FIX: Remove other never covered lines of code (archived `RCM` products, complex `ICEYE` products, others...)
- FIX: Re-enabling loading str bands (regression)
- FIX: Proper check for empty fields when parsing metadata
- FIX: VHR `_get_dem_path` raises `ValueError` instead of `TypeError`
- FIX: Pre-process SAR bands before despeckling if not existing (was OK in most of the cases, but broke in some cases, especially with CI folder activated and S3 compatible storage)
- FIX: Remove warning `invalid escape sequence \.`, `\w`, `\D` and `\s`
- FIX: Do not set `long_name` for `RAW_CLOUDS` arrays
- FIX: Providing a URL DEM on Windows throws a `OSError` instead of a bare `Exception`

Optimizations

- OPTIM: Do not pre-process existing Sentinel-3 geocoded bands
- OPTIM: Do not look for valid metadata further than a given nested level in product's directory (for extracted products)

Other

- CI: Using another (faster) runner
- CI: Add on disk and end-to-end tests
- CI: Do not write tmp files when running on disk tests
- CI: Coverage:
- Get coverage as HTML
- Remove useless lines from coverage
- Combine coverage of S3 and on disk tests
- DOC: Adding a DEM notebook

Bug Fixes

- FIX: Fixing archived SAR processing
- FIX: Needs extraction for `RS2-SLC` data as SNAP does not handle the product
- FIX: Fixing the default name for cleaned bands for optical data (was set on `CLEAN` instead of `NODATA`)

Bug Fixes

- FIX: Fixing complex and orthorectified products for `SAR` data
- FIX: Fixing `RADARSAT-2` `SLC` product type

Optimizations

- OPTIM: Only preprocessing wanted SAR bands (instead of all existing)
- OPTIM: Do not interpolate nan values by default when writing SAR bands to disk (using a keyword instead)

Other

- DOC: Updating the SAR notebook and documentation