Geofileops

Bugs fixed

- For `dissolve`, `agg_columns` aggregations sometimes give wrong results (541)

Deprecations and compatibility notes

- Set the default value of `keep_empty_geoms` to `False` for all standard operations.
This changes the default for `make_valid` and in some cases for `simplify`. The only
exception is `select`, where the default stays `True`. (472, 499)
- Up to now, geofileops always tried to create spatial indexes on output files. For some
formats this has disadvantages thought. Hence, and for consistency, from now on the
default behaviour regarding spatial index creation of GDAL will be followed. E.g.
default a spatial index for "GPKG", but no index for "ESRI Shapefile". (511)
- The default filter clause for `export_by_location` is now "intersects is True" while
in previous versions it was "intersects is True and touches is False", to be in line with `join_by_location`, other libraries and use for non-polygon data. (508)
- When `join_by_location` was applied, a column "spatial_relation" with the spatial
relation between the geometries was added. This is no longer the case. (475)

Improvements

- Add support for self-overlays in overlay operations (468)
- Add support for a spatial query in `export_by_location` (508)
- Improve `dissolve_within_distance` results (494)
- Improve performance of `join_by_location` for relation "intersects is True" and for
complex polygon features in layer to compare with (502, 519)
- Improve handling of queries evaluating to True for disjoint features in
`join_by_location` (509)
- Make fiona an optional depencency (301)
- Add configuration option GFO_REMOVE_TEMP_FILES that can be used to avoid temp files
being removed for debugging purposes (480)
- Add a context manager, TempEnv, to set temporary env variables (481)
- Don't copy both input files if only one is not spatialite based in two layer
operations (247)
- If an output_dir doesn't exist yet, avoid processing being done before an error is
raised. (518)
- Small changes to support geopandas 1.0 (529)
- Linting improvements: ruff version to 0.4.4 + apply import sorting (531)

Improvements

- Small changes to support gdal 3.9 (528)
- Several improvements to documentation: new FAQ, improved user guide,...
(465, 469, 474)
- Linting improvements: use mypy + use ruff-format instead of black for formatting
(478, 479)

Bugs fixed

- Fix crash when using e.g. `erase` with `gridsize <> 0.0` specified on input file
containing an EMPTY geometry (470)
- Fix `dissolve` possibly having EMPTY geometries as output if `gridsize <> 0.0` (473)
- Fix wrong results from `join_by_location` if ran on result of `join_by_location`
with `column_prefixes=""` (475)
- Fix error in two layer operations if equal column aliases used based on a constant or
a function result (477)
- Fix `erase` (and depending two layer operations like `union`,...) giving wrong results
if `subdivide_coords` < 1 (489)
- Fix two-layer operations with `gridsize` sometimes outputting NULL geometries (495)

Bugs fixed

- Fix error in `erase` if `erase_path` countains multiple layers (451)
- Fix error in `dissolve` on polygon input if a pass that is not the last one has 0
onborder polygons in its result (459, 461)
- Fix `groupby` parameter becoming case sensitive in `dissolve` when `agg_columns` is
also specified (462)

Improvements

- Add support to read/add/remove embedded layer styles in gpkg (263)
- Add `gridsize` parameter to most spatial operations (261, 407, 413)
- Add `keep_empty_geoms` and `where_post` parameters to many single layer spatial operations
(262, 398)
- Add `where_post` parameter to many two layer spatial operations (312)
- Add `columns`, `sql` and `where` parameters to `copy_layer` and `append_to` (311, 432)
- Add `dissolve_within_distance` operation (409)
- Add support for lang+ algorithm in `simplify` (334)
- Add support to use `select` and `select_two_layers` on attribute tables (= tables
without geometry column) and/or have an attribute table as result (322, 379)
- Add support to process all file types supported by gdal in most general file and layer
operations, e.g. `get_layerinfo`, `read_file`,... (402)
- Add support for files with Z/M dimensions in the general file and layer operations (369)
- Add support for spatialite 5.1 in `join_nearest` (412)
- Improve performance of `makevalid` and `isvalid` (258)
- Improve performance of `intersection`, 30% faster for typical data, up to 4x faster
for large input geometries (340, 358)
- Improve performance of `clip`: 3x faster for typical data (358)
- Improve performance of `export_by_location`, especially when `area_inters_column_name`
and `min_area_intersect` are `None`: a lot faster + 10x less memory usage (370)
- Improve performance of `erase`, `identity`, `symmetric difference` and `union` by
applying on-the-fly subdividing of complex geometries to speed up processing. The new
parameter `subdivide_coords` can be used to control the feature. For files with very
large input geometries, up to 100x faster + 10x less memory usage.
(329, 330, 331, 357, 396, 427, 438, 446)
- Improve performance of spatial operations when only one batch is used (271)
- Improve performance of single layer operations (375)
- Improve performance of some geopandas/shapely based operations (342, 408)
- Add checks that `output_path` must not be equal to the/an `input_path` for geo
operations (246)
- Follow geopandas behaviour of using shapely2 and/or pygeos instead of forcing pygeos
(294)
- Improve handling of "SELECT * ..." style queries in `select` and `select_two_layers`
(283)
- Improve handling + tests regarding empty input layers/NULL geometries (320)
- Improve logging: use geo operation being executed as `logger name` (410)
- Many small improvements to logging, documentation, (gdal)error messages,...
(321, 366, 394, 439,...)
- Use smaller footprint conda packages for tests (use `geopandas-base`, `nomkl`) (377)
- Use ruff instead of flake8 for linting (317)

Bugs fixed

- Fix parameter `index` in `to_file` being ~ ignored (285)
- Fix `fid` column in output having only null values in e.g. `union` (362)
- Fix "json" aggregate column handling in dissolve on line and point input files gives
wrong results (257)
- Fix error in `read_file` when `read_geometry=False` and `columns` specified (393)
- Fix error in `copy_layer`/`convert` with `explodecollections` on some input files
(395)
- Fix dissolve forcing output to wrong geometrytype in some cases (424)

Deprecations and compatibility notes

- Drop support for shapely1 (329, 338)
- Parameter `precision` of `makevalid` is renamed to `gridsize` as this is the typical
terminology in other libraries (273)
- When `join_nearest` is used with spatialite, >= 5.1, two additional mandatory
parameters need to be specified: `distance` and `expand` (412)
- Parameter `area_inters_column_name` in `export_by_location` now defaults to `None`
instead of "area_inters" (370)
- Deprecate `convert` and rename to `copy_layer` (310)
- Deprecate `split` and rename to `identity` (397)
- Deprecate `is_geofile` and `is_geofile_ext` (402)
- Make the `GeofileType` enum private, in preparation of probably removing it later on
(402)
- Remove the long-deprecated functions `get_driver_for_ext`, `to_multi_type` and
`to_generaltypeid` (276)
- Remove the long-deprecated `vector_util`, `geofileops.geofile` and
`geofileops.geofileops` namespaces (276)
- Remove `geometry_util`, `geoseries_util` and `grid_util` (339):
- Most functions were moved to `pygeoops` because they are generally reusable.
- Remaining functions are moved either to `_geometry_util` or `_geoseries_util` to
make it clearer they are not public.

Improvements

- Use [pyogrio](https://github.com/geopandas/pyogrio) for GeoDataFrame io to improve
performance for operations involving GeoDataFrames (64, 217)
- Add possibility to backup the fid in output files when applying operations (114)
- Add support to `to_file` to write empty dataframe + add basic support for
`force_output_geometrytype` (205)
- Add support to `read_file` to execute sql statements (222)
- Add function `get_layer_geometrytypes` to get a list of all geometry types that
are actually in a layer (230)
- Add `fid_as_index` parameter to `read_file` (215)
- Preserve `fid` values in single layer operations when possible ()
- Add `force_output_geometrytype` parameter to `apply` (233)
- Optimize performance of operations when only one batch is used (19)
- Optimize number batches for single layer sql operations (214)
- Add check for select operations that if nb_parallel > 1, {batch_filter} is mandatory
in sql_stmt (208)
- Small improvements/code cleanup (216, 223, 240,...)

Deprecations and compatibility notes

- When a geo operation results in an empty result, gfo now always writes an empty output
file instead of no output. This is also the behaviour of other high level libraries
like in the toolbox of QGIS or ArcGIS. This behaviour needs gdal version >= 3.6.3 to
be applied consistently. (188)
- In `read_file` the columns in the output now reflect the casing used in the parameter
rather than the casing in the source file (229)
- Functions `read_file_sql` and `read_file_nogeom` are deprecated in favour of
`read_file`. Mind: in read_file the sql_dialect default is None, not "SQLITE".
(222, 232, 236)
- The (private) util function `view_angles` is moved to
[pygeoops](https://github.com/pygeoops/pygeoops) (#209)