Mintpy

Highlights

* add `prep_nisar` to load NISAR GUNW products by mirzaees in https://github.com/insarlab/MintPy/pull/1035
* `prep_hyp3`: support burst-wide interferograms from hyp3-isce2 by cirrusasf in https://github.com/insarlab/MintPy/pull/1074
* GMT-like shaded relief illumination via `view.py --dem-blend` by yuankailiu, yunjunz in https://github.com/insarlab/MintPy/pull/1089, https://github.com/insarlab/MintPy/pull/1102
* add `fix_typos.sh` modified from `GDAL` repo to catch spelling errors by scottstanie, yunjunz in https://github.com/insarlab/MintPy/pull/1082, https://github.com/insarlab/MintPy/pull/1120
* support `mintpy.load.autoPath` for `isce2/alosStack` products by yunjunz in https://github.com/insarlab/MintPy/pull/1119
* `sensor`: add LuTan-1 info by yunjunz in https://github.com/insarlab/MintPy/pull/1097

What’s Changed

* `view.prep_slice()`: support quoted lists of characters as inputs by yunjunz in https://github.com/insarlab/MintPy/pull/1077
* `view`: add `--scalebar-linewidth` option by yunjunz in https://github.com/insarlab/MintPy/pull/1111
* `view`: allow unit change when viewing seasonal time functions by bbuzz31 in https://github.com/insarlab/MintPy/pull/1084
* `plot_network`: check nan values of coh/bperp in kept interferograms by yunjunz in https://github.com/insarlab/MintPy/pull/1108
* `mintpy.geocode.laloStep`: support single value input by yunjunz in https://github.com/insarlab/MintPy/pull/1075
* `readfile.read_gdal`: switch back to `gdal` kwargs to leverage its subsetting capability by scottstanie in https://github.com/insarlab/MintPy/pull/1072
* `readfile`: support GDAL `int8` dtype by yunjunz in https://github.com/insarlab/MintPy/pull/1083
* `subset`: support hdf5 <--> binary by yunjunz in https://github.com/insarlab/MintPy/pull/1076
* `utils0.utm2latlon()`: allow coordinates outside of the normal range of a UTM zone by swdmike in https://github.com/insarlab/MintPy/pull/1107

Maintenance - Bugfix

* bugfix for `mintpy.network.aoiYX/LALO` options by yunjunz in https://github.com/insarlab/MintPy/pull/1103
* fix `np.abs(dtype)` bug due to `numpy` behavior change in `simulation/fractal` by yunjunz in https://github.com/insarlab/MintPy/pull/1120

Maintenance - Documentation

* `Installation`: use `brew` solution for the arg-complete setup on mac/bash by yunjunz in https://github.com/insarlab/MintPy/pull/1069
* `CONTRIBUTING`: update comments on `pre-commit` by yunjunz in https://github.com/insarlab/MintPy/pull/1087
* `dir_structure`: ppdate URL for HyP3 sample notebook by hjkristenson in https://github.com/insarlab/MintPy/pull/1113

Maintenance - Dependency

* add `shapely` by yunjunz in https://github.com/insarlab/MintPy/pull/1069
* del obsolete `docs/requirements4rtd.txt` file by yunjunz in https://github.com/insarlab/MintPy/pull/1090
* docker/build: update to new versions by dependabot in https://github.com/insarlab/MintPy/pull/1088, https://github.com/insarlab/MintPy/pull/1091, https://github.com/insarlab/MintPy/pull/1092, https://github.com/insarlab/MintPy/pull/1090
* pre-commit: update to new versions by pre-commit-ci in https://github.com/insarlab/MintPy/pull/1093, https://github.com/insarlab/MintPy/pull/1094, https://github.com/insarlab/MintPy/pull/1099, https://github.com/insarlab/MintPy/pull/1104

New Contributors

* swdmike made their first contribution in https://github.com/insarlab/MintPy/pull/1107
* hjkristenson made their first contribution in https://github.com/insarlab/MintPy/pull/1113

Full Changelog: https://github.com/insarlab/MintPy/compare/v1.5.2...v1.5.3

Cut a release for the 2023 EarthScope InSAR short course (ISCE+).

Highlights

* UTM and lat/lon coordinates conversion support via the `utm` package by yunjunz in https://github.com/insarlab/MintPy/pull/1052, https://github.com/insarlab/MintPy/pull/1053
* `timeseries2velocity`: add `--polyline` option to estimate linear velocity changes by yunjunz in https://github.com/insarlab/MintPy/pull/999
* `diff`: support `unw/offset - timeseries` and `timeseries - velocity` by yunjunz and yuankailiu in https://github.com/insarlab/MintPy/pull/1011, https://github.com/insarlab/MintPy/pull/1018
* `euler_pole`: add PMM plotting functions by yuankailiu in https://github.com/insarlab/MintPy/pull/935
* initial NO_DATA_VALUE support via `readfile.auto_no_data_value()` by yunjunz in https://github.com/insarlab/MintPy/pull/962

What's Changed

* `geocode`: support complex wrapped interferogram by comma-never-coma in https://github.com/insarlab/MintPy/pull/957
* `image_stitch`: support non-hdf5 files by yunjunz in https://github.com/insarlab/MintPy/pull/1021
* `isce_utils`: add `unwrap_icu()` and `filter_goldstein()` by yunjunz in https://github.com/insarlab/MintPy/pull/993 and https://github.com/insarlab/MintPy/pull/1058
* main CLI: add logging control args by yunjunz in https://github.com/insarlab/MintPy/pull/1020
* `multilook`: support GDAL VRT file as input by yunjunz in https://github.com/insarlab/MintPy/pull/959
* `multilook`: generate multilooked geometry files for CPU/GPU `ampcor` products by yunjunz in https://github.com/insarlab/MintPy/pull/963
* `prep_fringe`: load water mask into geometry file via `--water-mask` by bbuzz31 in https://github.com/insarlab/MintPy/pull/983
* `read/write/resample`: improved support for GDAL complex file by yunjunz in https://github.com/insarlab/MintPy/pull/1000
* `save_qgis`: add `--zero-first` option by yunjunz in https://github.com/insarlab/MintPy/pull/1007
* `sensor`: add ICEYE parameters by yunjunz in https://github.com/insarlab/MintPy/pull/974
* `spatial_filter`: use nan-ignoring filter for `lowpass/highpass_gaussian` by yuankailiu and scottstanie in https://github.com/insarlab/MintPy/pull/935 and https://github.com/insarlab/MintPy/pull/1030
* `tsview`: add `--figsize-img` by yunjunz in https://github.com/insarlab/MintPy/pull/1059
* `view`: add `--faultline` and `--interpolation` options by yunjunz and scottstanie in https://github.com/insarlab/MintPy/pull/964, https://github.com/insarlab/MintPy/pull/1062, https://github.com/insarlab/MintPy/pull/1029

Maintenance

* `circleci`: replace miniconda3 with mambaforge with 2X speedup by yunjunz in https://github.com/insarlab/MintPy/pull/996
* `mask`: replace `--threshold` with `--vmin/vmax` by yunjunz in https://github.com/insarlab/MintPy/pull/1009
* `numpy`: replace expired numpy dtype deprecations (cont.) by yjzhenglamarmota in https://github.com/insarlab/MintPy/pull/960
* `resample`: refactor default output step size calculation by yunjunz in https://github.com/insarlab/MintPy/pull/997
* `tsview/plot_tran*/plot_coh*_mat*`: simplify object input args by yunjunz in https://github.com/insarlab/MintPy/pull/982

Maintenance - Bugfixes

* remove the extra half-pixel shift while converting Y/X_FIRST between gdal and mintpy by sssangha in https://github.com/insarlab/MintPy/pull/1034
* `utils0.median_abs_deviation()`: divide by `scale` instead of multiply by yi-chingchen in https://github.com/insarlab/MintPy/pull/946
* `closure_phase_bias`: bring back spatial referencing for ARIA while calc sequential closure phase by yunjunz in https://github.com/insarlab/MintPy/pull/1063
* `cluster.split_box2sub_boxes`: bugfix for tiny last step by yunjunz in https://github.com/insarlab/MintPy/pull/1024
* `gamma`: various bugfixes in `readfile` and `geocode` for `gamma` products by yunjunz in https://github.com/insarlab/MintPy/pull/1044
* `hdfeos5`: calc/write latitude/longitude if missing in geometry file by yunjunz in https://github.com/insarlab/MintPy/pull/1050
* `utils.plot`: fix `_tkinter.TclError` via `plt.switch_backend('Agg')` by falkamelung in https://github.com/insarlab/MintPy/pull/947
* `view`: fix referencing error while read unwrapPhase* in 2D w/ multilook by yunjunz in https://github.com/insarlab/MintPy/pull/956
* `timeseries_rms`: bugfix for `run_or_skip` and `*RMS.deramp = no` by yunjunz in https://github.com/insarlab/MintPy/pull/970
* `isce_utils.get_processor()`: use `*.track.xml` file to identify `alosStack/2App` by yunjunz in https://github.com/insarlab/MintPy/pull/998
* `readfile.read_attribute`: translate DATA_TYPE ci2 to float32 for roipac by yunjunz in https://github.com/insarlab/MintPy/pull/1064
* `save_gdal`: bugfix for boolean type by yunjunz in https://github.com/insarlab/MintPy/pull/1024
* `spatial_filter`: fix the `pad_width` integral type error for `double_difference` option by yunjunz in https://github.com/insarlab/MintPy/pull/1015
* `unwrap_error_phase_closure`: fix `numpy.random.choice` error and zero step size bug by yunjunz in https://github.com/insarlab/MintPy/pull/989, https://github.com/insarlab/MintPy/pull/1067

Maintenance - Documentation

* README/badge: flat-square style + docker status + conda download by yunjunz in https://github.com/insarlab/MintPy/pull/948
* add doc string description for `defaults/objects/simulation/utils` sub-modules by yunjunz in https://github.com/insarlab/MintPy/pull/1005
* installation: add tab completion sub-section by yunjunz in https://github.com/insarlab/MintPy/pull/1065
* typo fixes by bjmarfito in https://github.com/insarlab/MintPy/pull/976, https://github.com/insarlab/MintPy/pull/978

Maintenance - Dependency

* add `argcomplete`
* add `utm`
* delete `environment.yml` file by yunjunz in https://github.com/insarlab/MintPy/pull/958
* unpin scipy<1.10 by yunjunz in https://github.com/insarlab/MintPy/pull/968
* build(deps): bump docker/build-push-action from 3 to 4 by dependabot in https://github.com/insarlab/MintPy/pull/954
* pre-commit(deps): bump isort (from 5.11 to 5.12) and pyupgrade (from 3.3 to 3.10) by pre-commit-ci in https://github.com/insarlab/MintPy/pull/951, https://github.com/insarlab/MintPy/pull/995, https://github.com/insarlab/MintPy/pull/1001, https://github.com/insarlab/MintPy/pull/1022, https://github.com/insarlab/MintPy/pull/1028, https://github.com/insarlab/MintPy/pull/1039, https://github.com/insarlab/MintPy/pull/1043, https://github.com/insarlab/MintPy/pull/1051

New Contributors

* yi-chingchen made their first contribution in https://github.com/insarlab/MintPy/pull/946
* comma-never-coma made their first contribution in https://github.com/insarlab/MintPy/pull/957

Full Changelog: https://github.com/insarlab/MintPy/compare/v1.5.1...v1.5.2

This is a maintenance release for bug fixes.

+ improved `closure_phase_bias`: 1) remove spatial referencing for better physical presentation and robustness; 2) use `wrapPhase` if available to remove the filtering effect (922 by Yujie Zheng)
+ `temporal_filter`: add a median filter from `scipy` via `-f / —filter` option (943)
+ I/O improvements:
- `image_math`: support multiple input files and input file overwrite (936)
- `save_gbis`: support non-velocity dataset from the velocity file (916 by Bryan Marfito)
+ dependency: drop `defusedxml` (915)
+ improved documentation on the installation (923, 939)
+ remove the unused `legacy/los2enu.py` (943)
+ bug and style fixes: including updates for the expired deprecations of `numpy`-1.24 (914, 934, 940, 942, 943)

Contributors

+ Zhang Yunjun
+ Yujie Zheng
+ Bryan Marfito
+ Yuan-Kai Liu

Full Changelog: https://github.com/insarlab/MintPy/compare/v1.5.0...v1.5.1

New Features

+ responsive command line interface (CLI) via lazy imports of the `mintpy.cli` sub-module (828, 854 by A. Valentino & Z. Yunjun). The new `mintpy.cli` sub-module contains all the CLI-related functionality and provides a significant speedup for all command line interactions, e.g. the help message and arguments checking.
+ switch the source code structure to the standard `src/mintpy` layout (903, by Z. Yunjun & S. Staniewicz)
+ `plate_motion` refactoring (851, 858, 868, 906 by Y. K. Liu & Z. Yunjun):
- add `mintpy.objects.euler_pole` for plate motion calculation and conversion.
- drop the dependency on `astropy` and `platemotion`.
- switch the default local coordinate translation from ECEF from sphere to spheroid.
- support azimuth output
- renamed from `bulk_plate_motion` to `plate_motion`
+ `timeseries2velocity`: save `residue` and `intercept` dataset (835)
+ `dem_error`: bugfix on the phase velocity minimization (875, 890, 902, 905, by Z. Yunjun & S. Mirzaee):
- change cutoff `cond` from 1e-15 to 1e-8 in `scipy.linalg.lstsq()` to avoid occasionally abnormal high residue.
- remove the all-zero column in the design matrix, to avoid occasionally high fitting residue.
+ IO & utility:
- `objects.timeseries.read`: auto-switch between array / single indexing to speedup (851)
- `load_data`: support azimuth angle file for ASF HyP3 product (865)
- `readfile.read_attribute`: allow ENVI files created with SUFFIX=ADD (841 by S. Staniewicz)
- `save_hdf5eos`: calculate `data_footprint` for radar-coded dataset (833 by A. Terrero)
- `save_roipac`: support non-velocity dataset from the velocity file (874 by B. Marfito)
- `geocode`: copy dataset units, such as from velocity.h5 file (910)
- `constants`: move from `mintpy.objects` to the root `mintpy` level (911)
+ dependency change:
- add `pre-commit` (873)
- add `rich` (851)
+ bugs fix (842, 843, 849, 851, 853, 860, 864, 871, 879, 883, 888, 901)

Technical Improvements

+ add `pre-commit` hook (852, 856, 866, 881, 907)
+ add `dependabot` to auto-update GitHub Actions (893, 894, 895, 896, 897, 898, 899)
+ enable building distributions for PRs by splitting it from upload to PyPI (893)
+ more unit tests for `dem_error`, `euler_pole`
+ delete obsolete `mintpy/legacy/gui` folder (846)

Contributors

+ Zhang Yunjun
+ Antonio Valentino
+ Yuan-Kai Liu
+ Sara Mirzaee
+ Scott Staniewicz
+ Bryan Marfito
+ Brett Buzzanga
+ Alfredo Terrero
+ Jiawei Li
+ Mohammad Mohseni Aref

Full Changelog: https://github.com/insarlab/MintPy/compare/v1.4.1...v1.5.0

This is a maintenance release to fix bugs found after version 1.4.0.

Technical Improvements

+ automate the `PyPI` publishing with GitHub Actions (827)
+ remove `openmp` from the dependency list (825)
+ bugfixes (825, 826, 829)

Contributors

+ Zhang Yunjun

Cut a release for the [2022 UNAVCO InSAR short course (ISCE+)](https://www.unavco.org/event/2022-short-course-insar-processing-analysis-isce/).

New Features

+ `closure_phase_bias`: add the phase non-closure induced bias estimation for small baseline approaches (Zheng et al., 2022) (765 by Y. Zheng, Z. Yunjun).
+ add `bulk_plate_motion` to estimate the tectonic plate motion in ENU/LOS direction from plate motion models (Stephenson et al., 2022, under review) (769, 808 by Y. K. Liu, Z. Yunjun).
+ `smallbaselineApp`: integrate complex time functions and uncertainty quantification into the routine workflow (795) via:
- mintpy.timeFunc.polynomial
- mintpy.timeFunc.periodic
- mintpy.timeFunc.stepDate
- mintpy.timeFunc.exp/log
- mintpy.timeFunc.uncertaintyQuantification
- mintpy.timeFunc.timeSeriesCovFile
+ `load_data`: load ionosphere stack from `isce2/topsStack` into `ionStack.h5` file with auto-resize (780, 796 by Y. K. Liu, Z. Yunjun) via:
- mintpy.load.ionUnwFile
- mintpy.load.ionCorFile
- mintpy.load.ionConnCompFile
+ `load_data`: support `mean` and `median` interpolation while loading stacks of observations (797 by Y. K. Liu) via:
- mintpy.multilook.x/ystep [renamed from mintpy.load.x/ystep]
- mintpy.multilook.method
+ add the single entry point with sub-commands via `mintpy.__main__` (823 by A. Valentino)
+ add `s1ab_range_bias.py` for the S1A/B range bias correction for range offset (Yunjun et al., 2022) (787).

Technical Improvements

+ auto build the `latest` and `develop` docker image and push to the [GitHub container registry](https://github.com/insarlab/MintPy/pkgs/container/mintpy) (#696 by J. Kennedy).
+ add `mintpy` to the [Debian ecosystem](https://tracker.debian.org/pkg/mintpy) with `apt install` support (#812 by A. Valentino).
+ add `mintpy.objects.ionex` for IONEX file download/read, to replace part of `mintpy.simulation.iono` (794).
+ `tsview`: switch to a new narrower slider and to use `fig.canvas.draw_idel/flush_events()` (764)
+ repo structure change:
- move the `requirements.txt` file to the root level (772)
- move shell scripts to the root level as `scripts` (785 by A. Valentino)
- spin-off `utils.map` module from `utils.plot` for lat/lon labels and scalebar (794)
+ reduced test data size for `SanFranSenDT42` and `WCapeSenAT29` (799)
+ various bugs fix

Contributors

+ Zhang Yunjun
+ Yuan-Kai Liu
+ Yujie Zheng
+ Antonio Valentino
+ Joseph Kennedy
+ Brett Buzzanga
+ Scott Staniewicz
+ Falk Amelung
+ Kang Liang
+ Bryan Marfito