Mintpy

Cut a release for the 2024 EarthScope InSAR short course (ISCE+).

Highlights
* update GMTSAR support with new interferogram stack structure and demo dataset by yunjunz, Xiaohua-Eric-Xu in https://github.com/insarlab/MintPy/pull/1226, https://github.com/insarlab/MintPy/pull/1227, https://github.com/insarlab/MintPy/pull/1229
* support numpy-2.0 by Liuqi2002519 and yunjunz in https://github.com/insarlab/MintPy/pull/1225
* support scipy-1.4 by yunjunz in https://github.com/insarlab/MintPy/pull/1223

Maintenance - bugfixes
* `iono_split_spectrum`: hardwire dset while inverting for iono TS by yunjunz in https://github.com/insarlab/MintPy/pull/1239
* `prep_hyp3`: skip relative_orbit, start/stopUTC for isce2_burst products by yunjunz in https://github.com/insarlab/MintPy/pull/1200
* `readfile.read_snap_dim`: more tolerant exaction on `DATE12` by ssharifi1994 in https://github.com/insarlab/MintPy/pull/1208

Maintenance - dependency, tests and documentation
* `simulation.fractal.py`: optional `pyfftw` import by avalentino in https://github.com/insarlab/MintPy/pull/1191
* `pyproject.toml`: add `readme` to the dynamic metadata list by yunjunz in https://github.com/insarlab/MintPy/pull/1197 and https://github.com/insarlab/MintPy/pull/1201
* `tests/smallbaselineApp` refactoring by yunjunz in https://github.com/insarlab/MintPy/pull/1230
* `tests/requirements.txt`: pin gdal"<=3.8" for circle ci by yunjunz in https://github.com/insarlab/MintPy/pull/1235
* `version`: add `get_version_info_v2()` by yunjunz in https://github.com/insarlab/MintPy/pull/1231
* docs: switch fig links from Yunjun's WordPress to `insarlab/figs` GitHub page by yunjunz in https://github.com/insarlab/MintPy/pull/1234, https://github.com/insarlab/MintPy/pull/1237, https://github.com/insarlab/MintPy/pull/1241

What's Changed
* `save_kmz`: support data in UTM by Alex-Lewandowski in https://github.com/insarlab/MintPy/pull/1210
* `isce_utils`: add `crop_slc()` and `form_ifgram()` by yunjunz in https://github.com/insarlab/MintPy/pull/1221
* `prep_gamma`: support geocoded Gamma products by yunjunz in https://github.com/insarlab/MintPy/pull/1222
* `readfile`: support `Gamma` SLC in complex32 format by yunjunz in https://github.com/insarlab/MintPy/pull/1216
* gnss: rename `JPL-SIDESHOW` to `SIDESHOW` by yunjunz in https://github.com/insarlab/MintPy/pull/1240

New Contributors
* Alex-Lewandowski made their first contribution in https://github.com/insarlab/MintPy/pull/1210
* Liuqi2002519 made their first contribution in https://github.com/insarlab/MintPy/pull/1225
* ssharifi1994 made their first contribution in https://github.com/insarlab/MintPy/pull/1208

**Full Changelog**: https://github.com/insarlab/MintPy/compare/v1.6.0...v1.6.1

Highlights

+ multiple GNSS sources support by rzinke, yunjunz in https://github.com/insarlab/MintPy/pull/1173
- rename GPS to GNSS in all related code/comments/docs
- support the following new GNSS solution sources (in addition to the default UNR), including data downloading and reading, via the `view.py --gnss-source` option
- `ESESES` from JPL/SOPAC
- `JPL-SIDESHOW` from JPL
- `GENERIC` for other undefined source format
- refactor the `objects.gnss.py` into parent/child classes
- behavior changes include:
- default local file dir changed from `GNSS` to `GNSS-{SOURCE}`
- default CSV file changed from `gnss_{COMPONENT}.csv` to `gnss_{COMPONENT}_{SOURCE}.csv`
+ integrate ionospheric correction from isce2 stack processors into `smallbaselineApp` by yunjunz in https://github.com/insarlab/MintPy/pull/1172
- add `iono_split_spectrum` script to invert and correct for the ionosphere in time-series
- add `correct_ionosphere` step in `smallbaselineApp` with the following new template options:
- `mintpy.ionosphericDelay.method`
- `mintpy.ionosphericDelay.excludeDate`
- `mintpy.ionosphericDelay.excludeDate12`
+ `view` and `tsview`: support scatter plot style via `--style` option by falkamelung, yunjunz in https://github.com/insarlab/MintPy/pull/1146, https://github.com/insarlab/MintPy/pull/1157
+ improved UTM coordinate supports:
- support GNSS-related options in `view` by forrestfwilliams in https://github.com/insarlab/MintPy/pull/1153
- add `utils0.epsg_code2utm_zone()` by yunjunz in https://github.com/insarlab/MintPy/pull/1159
- use metadata `LAT/LON_REF1/2/3/4` in UTM by yunjunz in https://github.com/insarlab/MintPy/pull/1161. Now all `*lat/lon*` style metadata represent lat/lon in degree for WGS84 coordinates and northing/easting in meters for UTM coordinates.
- ensure a single output UTM zone in `utils0.latlon2utm()` by yunjunz in https://github.com/insarlab/MintPy/pull/1177

What's Changed

+ `modify_network`: add `--ex-date12` option by yunjunz in https://github.com/insarlab/MintPy/pull/1151
+ add HDF-EOS5 metadata (beam_swath, relative_orbit, startUTC, stopUTC) for HyP3 products by forrestfwilliams in https://github.com/insarlab/MintPy/pull/1180
+ `prep_nisar`: update for changes in NISAR GUNW products by mirzaees in https://github.com/insarlab/MintPy/pull/1158
+ read/load support for `isce2/alos2App` dense offset by yunjunz in https://github.com/insarlab/MintPy/pull/1143
+ `autoPath` for `alosStack`: supp custom multilook number + ionospheric phase/coherence by yunjunz in https://github.com/insarlab/MintPy/pull/1150
+ `utils0.incidence_angle`: read from metadata directly if available for `dimension==0` by taliboliver in https://github.com/insarlab/MintPy/pull/1152
+ `image_stitch`: update `REF_Y/X` after mosaicking in the output file by yunjunz in https://github.com/insarlab/MintPy/pull/1156
+ `objects.sensor`: add orbit_inclination and repeat_cycle for all sensors by yunjunz in https://github.com/insarlab/MintPy/pull/1181

Maintenance

+ update HyP3 example dataset `RidgecrestSenDT71` for the latest metadata from ASF HyP3 system at April 2024 by forrestfwilliams in https://github.com/insarlab/MintPy/pull/1182
+ `tropo_pyaps3`: use local GAM files with larger SNWE if available to further avoid re-downloading yunjunz in https://github.com/insarlab/MintPy/pull/1164
+ bugfix for `coord.lalo2yx()` when lat/lon have diff sizes by yunjunz in https://github.com/insarlab/MintPy/pull/1160
+ bugfix for `dem_error` on the step func initiation by yunjunz in https://github.com/insarlab/MintPy/pull/1186
+ bugfix for `view.py numInvIfgram.py` for `hyp3` products by yunjunz in https://github.com/insarlab/MintPy/pull/1187
+ `objects.conncomp.plot_bridge`: improved memory usage by ehavazli in https://github.com/insarlab/MintPy/pull/1155
+ replace `setup.py` with `pyproject.toml` for code installation by yunjunz in https://github.com/insarlab/MintPy/pull/1129
+ replace `miniconda` with `miniforge` for dev installation note and testing by yunjunz in https://github.com/insarlab/MintPy/pull/1139, https://github.com/insarlab/MintPy/pull/1148
+ fix typo in `generate_mask.py` example usage by mohseniaref in https://github.com/insarlab/MintPy/pull/1144
+ ignore contributions by bots in release notes by yunjunz in https://github.com/insarlab/MintPy/pull/1148

Full Changelog: https://github.com/insarlab/MintPy/compare/v1.5.3...v1.6.0

Highlights

* add `prep_nisar` to load NISAR GUNW products by mirzaees in https://github.com/insarlab/MintPy/pull/1035
* `prep_hyp3`: support burst-wide interferograms from hyp3-isce2 by cirrusasf in https://github.com/insarlab/MintPy/pull/1074
* GMT-like shaded relief illumination via `view.py --dem-blend` by yuankailiu, yunjunz in https://github.com/insarlab/MintPy/pull/1089, https://github.com/insarlab/MintPy/pull/1102
* add `fix_typos.sh` modified from `GDAL` repo to catch spelling errors by scottstanie, yunjunz in https://github.com/insarlab/MintPy/pull/1082, https://github.com/insarlab/MintPy/pull/1120
* support `mintpy.load.autoPath` for `isce2/alosStack` products by yunjunz in https://github.com/insarlab/MintPy/pull/1119
* `sensor`: add LuTan-1 info by yunjunz in https://github.com/insarlab/MintPy/pull/1097

What’s Changed

* `view.prep_slice()`: support quoted lists of characters as inputs by yunjunz in https://github.com/insarlab/MintPy/pull/1077
* `view`: add `--scalebar-linewidth` option by yunjunz in https://github.com/insarlab/MintPy/pull/1111
* `view`: allow unit change when viewing seasonal time functions by bbuzz31 in https://github.com/insarlab/MintPy/pull/1084
* `plot_network`: check nan values of coh/bperp in kept interferograms by yunjunz in https://github.com/insarlab/MintPy/pull/1108
* `mintpy.geocode.laloStep`: support single value input by yunjunz in https://github.com/insarlab/MintPy/pull/1075
* `readfile.read_gdal`: switch back to `gdal` kwargs to leverage its subsetting capability by scottstanie in https://github.com/insarlab/MintPy/pull/1072
* `readfile`: support GDAL `int8` dtype by yunjunz in https://github.com/insarlab/MintPy/pull/1083
* `subset`: support hdf5 <--> binary by yunjunz in https://github.com/insarlab/MintPy/pull/1076
* `utils0.utm2latlon()`: allow coordinates outside of the normal range of a UTM zone by swdmike in https://github.com/insarlab/MintPy/pull/1107

Maintenance - Bugfix

* bugfix for `mintpy.network.aoiYX/LALO` options by yunjunz in https://github.com/insarlab/MintPy/pull/1103
* fix `np.abs(dtype)` bug due to `numpy` behavior change in `simulation/fractal` by yunjunz in https://github.com/insarlab/MintPy/pull/1120

Maintenance - Documentation

* `Installation`: use `brew` solution for the arg-complete setup on mac/bash by yunjunz in https://github.com/insarlab/MintPy/pull/1069
* `CONTRIBUTING`: update comments on `pre-commit` by yunjunz in https://github.com/insarlab/MintPy/pull/1087
* `dir_structure`: ppdate URL for HyP3 sample notebook by hjkristenson in https://github.com/insarlab/MintPy/pull/1113

Maintenance - Dependency

* add `shapely` by yunjunz in https://github.com/insarlab/MintPy/pull/1069
* del obsolete `docs/requirements4rtd.txt` file by yunjunz in https://github.com/insarlab/MintPy/pull/1090
* docker/build: update to new versions by dependabot in https://github.com/insarlab/MintPy/pull/1088, https://github.com/insarlab/MintPy/pull/1091, https://github.com/insarlab/MintPy/pull/1092, https://github.com/insarlab/MintPy/pull/1090
* pre-commit: update to new versions by pre-commit-ci in https://github.com/insarlab/MintPy/pull/1093, https://github.com/insarlab/MintPy/pull/1094, https://github.com/insarlab/MintPy/pull/1099, https://github.com/insarlab/MintPy/pull/1104

New Contributors

* swdmike made their first contribution in https://github.com/insarlab/MintPy/pull/1107
* hjkristenson made their first contribution in https://github.com/insarlab/MintPy/pull/1113

Full Changelog: https://github.com/insarlab/MintPy/compare/v1.5.2...v1.5.3

Cut a release for the 2023 EarthScope InSAR short course (ISCE+).

Highlights

* UTM and lat/lon coordinates conversion support via the `utm` package by yunjunz in https://github.com/insarlab/MintPy/pull/1052, https://github.com/insarlab/MintPy/pull/1053
* `timeseries2velocity`: add `--polyline` option to estimate linear velocity changes by yunjunz in https://github.com/insarlab/MintPy/pull/999
* `diff`: support `unw/offset - timeseries` and `timeseries - velocity` by yunjunz and yuankailiu in https://github.com/insarlab/MintPy/pull/1011, https://github.com/insarlab/MintPy/pull/1018
* `euler_pole`: add PMM plotting functions by yuankailiu in https://github.com/insarlab/MintPy/pull/935
* initial NO_DATA_VALUE support via `readfile.auto_no_data_value()` by yunjunz in https://github.com/insarlab/MintPy/pull/962

What's Changed

* `geocode`: support complex wrapped interferogram by comma-never-coma in https://github.com/insarlab/MintPy/pull/957
* `image_stitch`: support non-hdf5 files by yunjunz in https://github.com/insarlab/MintPy/pull/1021
* `isce_utils`: add `unwrap_icu()` and `filter_goldstein()` by yunjunz in https://github.com/insarlab/MintPy/pull/993 and https://github.com/insarlab/MintPy/pull/1058
* main CLI: add logging control args by yunjunz in https://github.com/insarlab/MintPy/pull/1020
* `multilook`: support GDAL VRT file as input by yunjunz in https://github.com/insarlab/MintPy/pull/959
* `multilook`: generate multilooked geometry files for CPU/GPU `ampcor` products by yunjunz in https://github.com/insarlab/MintPy/pull/963
* `prep_fringe`: load water mask into geometry file via `--water-mask` by bbuzz31 in https://github.com/insarlab/MintPy/pull/983
* `read/write/resample`: improved support for GDAL complex file by yunjunz in https://github.com/insarlab/MintPy/pull/1000
* `save_qgis`: add `--zero-first` option by yunjunz in https://github.com/insarlab/MintPy/pull/1007
* `sensor`: add ICEYE parameters by yunjunz in https://github.com/insarlab/MintPy/pull/974
* `spatial_filter`: use nan-ignoring filter for `lowpass/highpass_gaussian` by yuankailiu and scottstanie in https://github.com/insarlab/MintPy/pull/935 and https://github.com/insarlab/MintPy/pull/1030
* `tsview`: add `--figsize-img` by yunjunz in https://github.com/insarlab/MintPy/pull/1059
* `view`: add `--faultline` and `--interpolation` options by yunjunz and scottstanie in https://github.com/insarlab/MintPy/pull/964, https://github.com/insarlab/MintPy/pull/1062, https://github.com/insarlab/MintPy/pull/1029

Maintenance

* `circleci`: replace miniconda3 with mambaforge with 2X speedup by yunjunz in https://github.com/insarlab/MintPy/pull/996
* `mask`: replace `--threshold` with `--vmin/vmax` by yunjunz in https://github.com/insarlab/MintPy/pull/1009
* `numpy`: replace expired numpy dtype deprecations (cont.) by yjzhenglamarmota in https://github.com/insarlab/MintPy/pull/960
* `resample`: refactor default output step size calculation by yunjunz in https://github.com/insarlab/MintPy/pull/997
* `tsview/plot_tran*/plot_coh*_mat*`: simplify object input args by yunjunz in https://github.com/insarlab/MintPy/pull/982

Maintenance - Bugfixes

* remove the extra half-pixel shift while converting Y/X_FIRST between gdal and mintpy by sssangha in https://github.com/insarlab/MintPy/pull/1034
* `utils0.median_abs_deviation()`: divide by `scale` instead of multiply by yi-chingchen in https://github.com/insarlab/MintPy/pull/946
* `closure_phase_bias`: bring back spatial referencing for ARIA while calc sequential closure phase by yunjunz in https://github.com/insarlab/MintPy/pull/1063
* `cluster.split_box2sub_boxes`: bugfix for tiny last step by yunjunz in https://github.com/insarlab/MintPy/pull/1024
* `gamma`: various bugfixes in `readfile` and `geocode` for `gamma` products by yunjunz in https://github.com/insarlab/MintPy/pull/1044
* `hdfeos5`: calc/write latitude/longitude if missing in geometry file by yunjunz in https://github.com/insarlab/MintPy/pull/1050
* `utils.plot`: fix `_tkinter.TclError` via `plt.switch_backend('Agg')` by falkamelung in https://github.com/insarlab/MintPy/pull/947
* `view`: fix referencing error while read unwrapPhase* in 2D w/ multilook by yunjunz in https://github.com/insarlab/MintPy/pull/956
* `timeseries_rms`: bugfix for `run_or_skip` and `*RMS.deramp = no` by yunjunz in https://github.com/insarlab/MintPy/pull/970
* `isce_utils.get_processor()`: use `*.track.xml` file to identify `alosStack/2App` by yunjunz in https://github.com/insarlab/MintPy/pull/998
* `readfile.read_attribute`: translate DATA_TYPE ci2 to float32 for roipac by yunjunz in https://github.com/insarlab/MintPy/pull/1064
* `save_gdal`: bugfix for boolean type by yunjunz in https://github.com/insarlab/MintPy/pull/1024
* `spatial_filter`: fix the `pad_width` integral type error for `double_difference` option by yunjunz in https://github.com/insarlab/MintPy/pull/1015
* `unwrap_error_phase_closure`: fix `numpy.random.choice` error and zero step size bug by yunjunz in https://github.com/insarlab/MintPy/pull/989, https://github.com/insarlab/MintPy/pull/1067

Maintenance - Documentation

* README/badge: flat-square style + docker status + conda download by yunjunz in https://github.com/insarlab/MintPy/pull/948
* add doc string description for `defaults/objects/simulation/utils` sub-modules by yunjunz in https://github.com/insarlab/MintPy/pull/1005
* installation: add tab completion sub-section by yunjunz in https://github.com/insarlab/MintPy/pull/1065
* typo fixes by bjmarfito in https://github.com/insarlab/MintPy/pull/976, https://github.com/insarlab/MintPy/pull/978

Maintenance - Dependency

* add `argcomplete`
* add `utm`
* delete `environment.yml` file by yunjunz in https://github.com/insarlab/MintPy/pull/958
* unpin scipy<1.10 by yunjunz in https://github.com/insarlab/MintPy/pull/968
* build(deps): bump docker/build-push-action from 3 to 4 by dependabot in https://github.com/insarlab/MintPy/pull/954
* pre-commit(deps): bump isort (from 5.11 to 5.12) and pyupgrade (from 3.3 to 3.10) by pre-commit-ci in https://github.com/insarlab/MintPy/pull/951, https://github.com/insarlab/MintPy/pull/995, https://github.com/insarlab/MintPy/pull/1001, https://github.com/insarlab/MintPy/pull/1022, https://github.com/insarlab/MintPy/pull/1028, https://github.com/insarlab/MintPy/pull/1039, https://github.com/insarlab/MintPy/pull/1043, https://github.com/insarlab/MintPy/pull/1051

New Contributors

* yi-chingchen made their first contribution in https://github.com/insarlab/MintPy/pull/946
* comma-never-coma made their first contribution in https://github.com/insarlab/MintPy/pull/957

Full Changelog: https://github.com/insarlab/MintPy/compare/v1.5.1...v1.5.2

This is a maintenance release for bug fixes.

+ improved `closure_phase_bias`: 1) remove spatial referencing for better physical presentation and robustness; 2) use `wrapPhase` if available to remove the filtering effect (922 by Yujie Zheng)
+ `temporal_filter`: add a median filter from `scipy` via `-f / —filter` option (943)
+ I/O improvements:
- `image_math`: support multiple input files and input file overwrite (936)
- `save_gbis`: support non-velocity dataset from the velocity file (916 by Bryan Marfito)
+ dependency: drop `defusedxml` (915)
+ improved documentation on the installation (923, 939)
+ remove the unused `legacy/los2enu.py` (943)
+ bug and style fixes: including updates for the expired deprecations of `numpy`-1.24 (914, 934, 940, 942, 943)

Contributors

+ Zhang Yunjun
+ Yujie Zheng
+ Bryan Marfito
+ Yuan-Kai Liu

Full Changelog: https://github.com/insarlab/MintPy/compare/v1.5.0...v1.5.1

New Features

+ responsive command line interface (CLI) via lazy imports of the `mintpy.cli` sub-module (828, 854 by A. Valentino & Z. Yunjun). The new `mintpy.cli` sub-module contains all the CLI-related functionality and provides a significant speedup for all command line interactions, e.g. the help message and arguments checking.
+ switch the source code structure to the standard `src/mintpy` layout (903, by Z. Yunjun & S. Staniewicz)
+ `plate_motion` refactoring (851, 858, 868, 906 by Y. K. Liu & Z. Yunjun):
- add `mintpy.objects.euler_pole` for plate motion calculation and conversion.
- drop the dependency on `astropy` and `platemotion`.
- switch the default local coordinate translation from ECEF from sphere to spheroid.
- support azimuth output
- renamed from `bulk_plate_motion` to `plate_motion`
+ `timeseries2velocity`: save `residue` and `intercept` dataset (835)
+ `dem_error`: bugfix on the phase velocity minimization (875, 890, 902, 905, by Z. Yunjun & S. Mirzaee):
- change cutoff `cond` from 1e-15 to 1e-8 in `scipy.linalg.lstsq()` to avoid occasionally abnormal high residue.
- remove the all-zero column in the design matrix, to avoid occasionally high fitting residue.
+ IO & utility:
- `objects.timeseries.read`: auto-switch between array / single indexing to speedup (851)
- `load_data`: support azimuth angle file for ASF HyP3 product (865)
- `readfile.read_attribute`: allow ENVI files created with SUFFIX=ADD (841 by S. Staniewicz)
- `save_hdf5eos`: calculate `data_footprint` for radar-coded dataset (833 by A. Terrero)
- `save_roipac`: support non-velocity dataset from the velocity file (874 by B. Marfito)
- `geocode`: copy dataset units, such as from velocity.h5 file (910)
- `constants`: move from `mintpy.objects` to the root `mintpy` level (911)
+ dependency change:
- add `pre-commit` (873)
- add `rich` (851)
+ bugs fix (842, 843, 849, 851, 853, 860, 864, 871, 879, 883, 888, 901)

Technical Improvements

+ add `pre-commit` hook (852, 856, 866, 881, 907)
+ add `dependabot` to auto-update GitHub Actions (893, 894, 895, 896, 897, 898, 899)
+ enable building distributions for PRs by splitting it from upload to PyPI (893)
+ more unit tests for `dem_error`, `euler_pole`
+ delete obsolete `mintpy/legacy/gui` folder (846)

Contributors

+ Zhang Yunjun
+ Antonio Valentino
+ Yuan-Kai Liu
+ Sara Mirzaee
+ Scott Staniewicz
+ Bryan Marfito
+ Brett Buzzanga
+ Alfredo Terrero
+ Jiawei Li
+ Mohammad Mohseni Aref

Full Changelog: https://github.com/insarlab/MintPy/compare/v1.4.1...v1.5.0