Rastervision

------------------

This release brings exciting new functionality and major usability improvements to Raster Vision.

Highlights
~~~~~~~~~~

- **Easier installation:** Raster Vision no longer requires exact versions of dependencies, which means it can more easily be installed alongside other packages!
- **AWS SageMaker support:** you can now run Raster Vision jobs on SageMaker via

.. code-block:: python

rastervision run sagemaker ...

You can even run training over multiple instances with multiple GPUs! See :ref:`aws sagemaker setup` for more details.
- **Distributed training support:** Raster Vision ``Learners`` now support distributed training (both multi-node and multi-GPU) via `PyTorch DDP <https://pytorch.org/docs/stable/notes/ddp.html>`__. If your machine has multiple GPUs, Raster Vision will now automatically use them all during training.
- **New CLI command**, :ref:`cli predict_scene`, that allows greater configurability than the ``predict`` command.

.. code-block:: python

rastervision predict_scene <model_bundle_uri> <scene_config_uri> [--predict_options_uri <predict_options_uri>]
- **New tutorial:** :doc:`usage/tutorials/onnx_inference`.

API changes
~~~~~~~~~~~

This release makes a number of breaking changes; however, it should still be backward compatible with older model-bundles. See the :doc:`migration guide <migration/v0-21_to_v0-30>` for more details.

Full changelog
~~~~~~~~~~~~~~

Features
^^^^^^^^

* Add AWS SageMaker support via new ``rastervision_aws_sagemaker`` module. (`1968 <https://github.com/azavea/raster-vision/pull/1968>`__, `#1986 <https://github.com/azavea/raster-vision/pull/1986>`__, `#2031 <https://github.com/azavea/raster-vision/pull/2031>`__, `#2098 <https://github.com/azavea/raster-vision/pull/2098>`__)
* Add a ``predict_scene`` CLI command that makes predictions on a scene specified by a SceneConfig (`1979 <https://github.com/azavea/raster-vision/pull/1979>`__)
* Add ``XarraySourceConfig`` to allow specifying an ``XarraySource`` from STAC Items (`1980 <https://github.com/azavea/raster-vision/pull/1980>`__)
* Add Apple Silicon GPU Acceleration (`1985 <https://github.com/azavea/raster-vision/pull/1985>`__)
* Add support for distributed training (multi-node and multi-GPU) via PyTorch DDP (`2018 <https://github.com/azavea/raster-vision/pull/2018>`__, `#2028 <https://github.com/azavea/raster-vision/pull/2028>`__)
* Allow specifying class probability thresholds for semantic segmentation vectorization (`2057 <https://github.com/azavea/raster-vision/pull/2057>`__)
* Allow reading GeoJSONs with non-epsg:4326 CRS's (`2101 <https://github.com/azavea/raster-vision/pull/2101>`__)
* Add ``within_aoi`` arg to ``GeoDataset`` (`2088 <https://github.com/azavea/raster-vision/pull/2088>`__)
* Add ``class_name_mapping`` to ``ClassInferenceTransformer`` (`2088 <https://github.com/azavea/raster-vision/pull/2088>`__)
* Add ``Config.deserialize()`` method for instantiating ``Configs`` from a file or dict (`2088 <https://github.com/azavea/raster-vision/pull/2088>`__)
* Add a ``.run_command()`` method to ``Runners`` (`1981 <https://github.com/azavea/raster-vision/pull/1981>`__)
* Allow ``Visualizers`` to plot predictions without ground truth (`1987 <https://github.com/azavea/raster-vision/pull/1987>`__)
* Allow ``ChipClassificationLabelSource`` to load scores, if available, when reading labels (`1988 <https://github.com/azavea/raster-vision/pull/1988>`__)
* Allow passing ``out_size`` param to ``SlidingWindowGeoDataset`` (`2099 <https://github.com/azavea/raster-vision/pull/2099>`__)
* Define ``XarraySource.from_stac()`` for more convenient creation of an ``XarraySource`` from a STAC ``Item`` or ``ItemCollection`` (`2061 <https://github.com/azavea/raster-vision/pull/2061>`__)

Refactoring
^^^^^^^^^^^

* Allow setting some Learner-related params via environment variables (or other Everett config options) (`1978 <https://github.com/azavea/raster-vision/pull/1978>`__)
* Refactor ``DataConfig`` and implement ``DataConfig.build_dataset()`` (`2023 <https://github.com/azavea/raster-vision/pull/2023>`__)
* Reconcile chip-sampling functionality in ``RVPipelines`` with ``GeoDatasets`` (1496) (`2040 <https://github.com/azavea/raster-vision/pull/2040>`__)
* Consolidate prediction options into ``PredictOptions`` for all tasks (`2055 <https://github.com/azavea/raster-vision/pull/2055>`__)
* Simplify inference with ONNX models (`2060 <https://github.com/azavea/raster-vision/pull/2060>`__)

Docs
^^^^

* Misc. minor docs fixes (`1993 <https://github.com/azavea/raster-vision/pull/1993>`__)
* Fix typos in notebook (`1967 <https://github.com/azavea/raster-vision/pull/1967>`__)
* Add a tutorial notebook for ONNX inference (`2062 <https://github.com/azavea/raster-vision/pull/2062>`__)

Maintenance/bug fixes
^^^^^^^^^^^^^^^^^^^^^
* Fix formatting in CONTRIBUTING.rst (`1965 <https://github.com/azavea/raster-vision/pull/1965>`__)
* Improve unit test coverage of CLI and Runners (`1966 <https://github.com/azavea/raster-vision/pull/1966>`__)
* Update PR template (`1982 <https://github.com/azavea/raster-vision/pull/1982>`__)
* Remove the ``typing_extensions`` dependency (`1992 <https://github.com/azavea/raster-vision/pull/1992>`__)
* Remove legacy test, overfit, and predict modes from Learner (`2024 <https://github.com/azavea/raster-vision/pull/2024>`__)
* Misc. minor fixes and improvements to examples (`2033 <https://github.com/azavea/raster-vision/pull/2033>`__)
* Bug fix: use correct transforms for val & test sets in ``GeoDataConfig._build_datasets()`` (`2039 <https://github.com/azavea/raster-vision/pull/2039>`__)
* Remove ``LearnerPipeline`` and ``LearnerPipelineConfig`` (`2056 <https://github.com/azavea/raster-vision/pull/2056>`__)
* Fix handing of some edge cases when reading chips from ``XarraySource`` (`2058 <https://github.com/azavea/raster-vision/pull/2058>`__)
* Fix circular import problems (`2059 <https://github.com/azavea/raster-vision/pull/2059>`__)
* Ignore version constraints in setup.py's (`2065 <https://github.com/azavea/raster-vision/pull/2065>`__)
* Add ``THIRD_PARTY_LICENSES.txt`` (`2072 <https://github.com/azavea/raster-vision/pull/2072>`__)
* Misc. docker fixes (`2085 <https://github.com/azavea/raster-vision/pull/2085>`__)
* Misc. minor fixes (`1984 <https://github.com/azavea/raster-vision/pull/1984>`__, `#1994 <https://github.com/azavea/raster-vision/pull/1994>`__, `#2053 <https://github.com/azavea/raster-vision/pull/2053>`__, `#2088 <https://github.com/azavea/raster-vision/pull/2088>`__)
* Make ``DataConfig`` take a ``ClassConfig`` instead of ``class_names`` and ``class_colors`` separately (`2100 <https://github.com/azavea/raster-vision/pull/2100>`__)
* Pre-release fixes (`2105 <https://github.com/azavea/raster-vision/pull/2105>`__)

----

--------------------

* Features:

* Allow reading pre-chipped datasets with non-RGB TIFF chips (`1932 <https://github.com/azavea/raster-vision/pull/1932>`__)

* Fixes:

* Normalize pixel values in the Spacenet Vegas examples (`1930 <https://github.com/azavea/raster-vision/pull/1930>`__)
* Account for ``bbox`` when saving predictions (`1931 <https://github.com/azavea/raster-vision/pull/1931>`__)
* Ensure SS datasets always return label array with correct ``dtype`` (`1954 <https://github.com/azavea/raster-vision/pull/1954>`__)
* Fix bug in ``Visualizer`` when plotting temporal data w/ batch size 1 (`1958 <https://github.com/azavea/raster-vision/pull/1958>`__)
* Allow specifying ``chip_sz`` in ``StatsTransform.from_raster_sources()`` (`1933 <https://github.com/azavea/raster-vision/pull/1933>`__)
* Misc. minor fixes (`1933 <https://github.com/azavea/raster-vision/pull/1933>`__)
* Docs:

* Update release instructions to simplify patch release process (`1934 <https://github.com/azavea/raster-vision/pull/1934>`__)
* Maintenance:

* Bump pillow to address CVE-2023-4863 (`1952 <https://github.com/azavea/raster-vision/pull/1952>`__)
* Update CI and release workflows to free up disk space before building docker image (`1953 <https://github.com/azavea/raster-vision/pull/1953>`__, `#1959 <https://github.com/azavea/raster-vision/pull/1959>`__)

----

--------------------

* Features:

* Save model weights for each epoch 1720 (`1921 <https://github.com/azavea/raster-vision/pull/1921>`__)

* Bug fixes:

* Do not require every plugin recorded in the model bundle to be installed when using it (`1916 <https://github.com/azavea/raster-vision/pull/1916>`__)
* Fix ``rastervision.core`` dependencies (`1920 <https://github.com/azavea/raster-vision/pull/1920>`__)
* Docs:

* Document config upgrader mechanism (`1917 <https://github.com/azavea/raster-vision/pull/1917>`__)
* Maintenance:

* Update GitHub actions' versions (`1913 <https://github.com/azavea/raster-vision/pull/1913>`__, `#1926 <https://github.com/azavea/raster-vision/pull/1926>`__)
* Add scripts for building packages and publishing them to PyPi (`1915 <https://github.com/azavea/raster-vision/pull/1915>`__)
* Add unit tests for ``VsiFileSystem`` (`1918 <https://github.com/azavea/raster-vision/pull/1918>`__)

----

--------------------

* Bug fixes:

* Chipping: Try hard to return a window, but fail gracefully if not (`1898 <https://github.com/azavea/raster-vision/pull/1898>`__)
* Fix inconsistent handling of RasterSourceConfig.bbox's type (`1899 <https://github.com/azavea/raster-vision/pull/1899>`__)
* Refactoring:

* log.warn -> log.warning (`1901 <https://github.com/azavea/raster-vision/pull/1901>`__)
* Dependencies:

* Bump pycocotools from 2.0.6 to 2.0.7 in /rastervision_pytorch_learner (`1893 <https://github.com/azavea/raster-vision/pull/1893>`__)
* Docs:

* Misc. fixes and improvements (`1875 <https://github.com/azavea/raster-vision/pull/1875>`__, `#1902 <https://github.com/azavea/raster-vision/pull/1902>`__, `#1903 <https://github.com/azavea/raster-vision/pull/1903>`__, `#1904 <https://github.com/azavea/raster-vision/pull/1904>`__)
* Docker:

* Update Docker build to improve caching and image size (`1866 <https://github.com/azavea/raster-vision/pull/1866>`__, `#1897 <https://github.com/azavea/raster-vision/pull/1897>`__)
* Replace miniconda with micromamba in the Docker image (`1870 <https://github.com/azavea/raster-vision/pull/1870>`__, `#1897 <https://github.com/azavea/raster-vision/pull/1897>`__)
* CI:

* Split CI tests into smaller pieces ; prune docker (`1873 <https://github.com/azavea/raster-vision/pull/1873>`__, `#1874 <https://github.com/azavea/raster-vision/pull/1874>`__)


----

------------------

This release brings some exciting new functionality to Raster Vision.

Highlights:

- Raster Vision can now consume imagery from STAC APIs via the newly-added :class:`.XarraySource` (see tutorial: :doc:`usage/tutorials/stac_plus_osm`).
- Raster Vision can now consume temporal data i.e. time series of images via :class:`.TemporalMultiRasterSource` and :class:`.XarraySource` (see tutorial: :doc:`usage/tutorials/temporal`).
- The model-bundles produced by now additionally include the model exported in the ONNX format and Raster Vision will use an ONNX runtime to make predictions if ``RASTERVISION_USE_ONNX=1`` is set.

API changes:

- To crop the extent of a :class:`.RasterSource` (or :class:`.LabelSource`), you now have to specify ``bbox`` instead of ``extent``. The term "extent", as used in the codebase, has also been redefined to always be the box ``Box(0, 0, height, width)``, where ``height`` and ``width`` are the height and width of the ``bbox``.
- :class:`.GeoJSONVectorSource` can now take a list of URIs, allowing geometries to be read from multiple files.
- :class:`.VectorOutputConfig` (and subclasses) no longer require ``uri`` to be specified.

Features
~~~~~~~~

- Add ``XarraySource`` to make it easier to consume imagery fetched from a STAC API (`1764 <https://github.com/azavea/raster-vision/pull/1764>`__)
- Add experimental ONNX support (`1792 <https://github.com/azavea/raster-vision/pull/1792>`__)
- Add support for temporal data (`1803 <https://github.com/azavea/raster-vision/pull/1803>`__, `#1815 <https://github.com/azavea/raster-vision/pull/1815>`__)


Fixes/minor improvements/refactoring
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

- Improve efficiency of positive-window sampling in ``ObjectDetectionRandomWindowGeoDataset`` by filtering labels by AOI (`1705 <https://github.com/azavea/raster-vision/pull/1705>`__)
- Misc object detection fixes and improvements (`1711 <https://github.com/azavea/raster-vision/pull/1711>`__)
- Allow ``GeoJSONVectorSource`` to accept multiple URIs (`1712 <https://github.com/azavea/raster-vision/pull/1712>`__)
- Allow specifying extra args for default model in ``ModelConfig`` (`1713 <https://github.com/azavea/raster-vision/pull/1713>`__)
- Ensure ``RasterSource`` and ``LabelSource`` extents match up in ``Scene`` (`1740 <https://github.com/azavea/raster-vision/pull/1740>`__)
- Allow all constituent object detection losses to be logged (`1716 <https://github.com/azavea/raster-vision/pull/1716>`__)
- Remove the ``uri`` field from ``VectorOutputConfig`` (`1762 <https://github.com/azavea/raster-vision/pull/1762>`__)
- Fix bugs related to extent-cropping (`1774 <https://github.com/azavea/raster-vision/pull/1774>`__, `#1786 <https://github.com/azavea/raster-vision/pull/1786>`__, `#1793 <https://github.com/azavea/raster-vision/pull/1793>`__)
- Fix legend placement in ``SemanticSegmentationVisualizer`` plots (`1783 <https://github.com/azavea/raster-vision/pull/1783>`__)
- Misc. refactoring and fixes (`1838 <https://github.com/azavea/raster-vision/pull/1838>`__)
- Update tutorial notebooks + misc. minor changes (`1839 <https://github.com/azavea/raster-vision/pull/1839>`__)
- Improve geometry-related validation in ``Scene`` and ``GeoJSONVectorSource`` and fix a bug in ``AoiSampler`` (`1856 <https://github.com/azavea/raster-vision/pull/1856>`__)

Development/maintenance
~~~~~~~~~~~~~~~~~~~~~~~

- Disable PDF build of docs (`1714 <https://github.com/azavea/raster-vision/pull/1714>`__)
- Improve Codecov exclusion settings, add some more unit tests, and add a unit test README (`1717 <https://github.com/azavea/raster-vision/pull/1717>`__)
- Fix CI errors (`1763 <https://github.com/azavea/raster-vision/pull/1763>`__)
- Factor out numpy-like array indexing implementation and add unit tests (`1765 <https://github.com/azavea/raster-vision/pull/1765>`__)
- Remove deprecated ``codecov`` dependency (`1775 <https://github.com/azavea/raster-vision/pull/1775>`__)
- Add ``CITATION.cff`` (`1789 <https://github.com/azavea/raster-vision/pull/1789>`__, `#1790 <https://github.com/azavea/raster-vision/pull/1790>`__)
- Minor refactoring of ``learner.py`` for readability (`1791 <https://github.com/azavea/raster-vision/pull/1791>`__)
- Conform to new torchvision API for specifying pretrained weights (`1794 <https://github.com/azavea/raster-vision/pull/1794>`__)
- Use more concise cross-referencing syntax in docs (`1809 <https://github.com/azavea/raster-vision/pull/1809>`__)
- Misc. documentation improvements (`1840 <https://github.com/azavea/raster-vision/pull/1840>`__)
- Update dependencies (`1749 <https://github.com/azavea/raster-vision/pull/1749>`__, `#1756 <https://github.com/azavea/raster-vision/pull/1756>`__, `#1760 <https://github.com/azavea/raster-vision/pull/1760>`__, `#1761 <https://github.com/azavea/raster-vision/pull/1761>`__, `#1797 <https://github.com/azavea/raster-vision/pull/1797>`__, `#1798 <https://github.com/azavea/raster-vision/pull/1798>`__, `#1799 <https://github.com/azavea/raster-vision/pull/1799>`__, `#1805 <https://github.com/azavea/raster-vision/pull/1805>`__, `#1811 <https://github.com/azavea/raster-vision/pull/1811>`__)
- Pre-release fixes and improvements (`1857 <https://github.com/azavea/raster-vision/pull/1857>`__)

----

--------------------

* Bump ``triangle`` from version ``20200424`` to ``20220202`` in ``rastervision_pytorch_learner`` (`1580 <https://github.com/azavea/raster-vision/pull/1580>`__)
* Update example plugin ``__init__.py`` files to include ``registry.set_plugin_version()`` calls (`1665 <https://github.com/azavea/raster-vision/pull/1665>`__)
* Add error handling for empty ``DataLoader`` in ``Visualizer.get_batch()`` (`1672 <https://github.com/azavea/raster-vision/pull/1672>`__)
* Only set default stride if stride value is missing in ``GeoDataWindowConfig`` (`1674 <https://github.com/azavea/raster-vision/pull/1674>`__)
* Minor doc and type-hint fixes and refactoring for OD (`1675 <https://github.com/azavea/raster-vision/pull/1675>`__, `#1676 <https://github.com/azavea/raster-vision/pull/1676>`__)

----