Feldera

Changed

- dbsp: Major refactoring of the dbsp crate to improve compilation speed of SQL programs ([1516](https://github.com/feldera/feldera/pull/1516))

Added

- SQL: Support for `GROUPING`, `GROUPING_ID`, and `GROUPING SETS` ([1527](https://github.com/feldera/feldera/pull/1527))
- SQL: Support for aggregation functions: `STDDEV`,
`STDDEV_POP`, `STDDEV_SAMP` ([1539](https://github.com/feldera/feldera/pull/1539))
- SQL: support for `SORT_ARRAY` function ([1490](https://github.com/feldera/feldera/pull/1490))
- SQL: support for `ARRAY_REVERSE` function ([1491](https://github.com/feldera/feldera/pull/1491))
- SQL: support for `ARRAY_MAX`, `ARRAY_MIN` functions ([1492](https://github.com/feldera/feldera/pull/1492))
- SQL: support for `ARRAY_COMPACT` function ([1493](https://github.com/feldera/feldera/pull/1493))
- SQL: support for `ARRAY_PREPEND` function ([1496](https://github.com/feldera/feldera/pull/1496))
- adapters: add an input connector for Amazon S3 ([1485](https://github.com/feldera/feldera/pull/1485))
- pipeline-manager: add option to pick a compilation profile ([1513](https://github.com/feldera/feldera/pull/1513))
- SQL: support for `ARRAY_CONTAINS` function ([1499](https://github.com/feldera/feldera/pull/1499))
- SQL: support for `ARRAY_REPEAT` function ([1497](https://github.com/feldera/feldera/pull/1497))
- SQL: support for `ROUND(DOUBLE, digit)`, `TRUNCATE(DOUBLE, digit)` ([1512](https://github.com/feldera/feldera/pull/1512))
- SQL: support for `ARRAY_REMOVE` function ([1498](https://github.com/feldera/feldera/pull/1498))
- SQL: support for `ARRAY_DISTINCT` function ([1515](https://github.com/feldera/feldera/pull/1515))
- Added basic support to ingest and export data in the parquet format ([1510](https://github.com/feldera/feldera/pull/1510))
- WebConsole: Services page, Kafka service edit dialog ([1233](https://github.com/feldera/feldera/pull/1233))
- adapters: add an input connector for Amazon S3 ([1485](https://github.com/feldera/feldera/pull/1485))

Added

- SQL: support for ARRAY_SIZE, ARRAY_LENGTH functions ([1489](https://github.com/feldera/feldera/pull/1489))
- SQL: support for ARRAY_POSITION function ([1480](https://github.com/feldera/feldera/pull/1480))

Fixed

- WebConsole: Fix metrics values depend on polling period
- WebConsole: Improve WebConsole throughput and memory graphs ([491](https://github.com/feldera/feldera/pull/491))

Added

- JDBC sink support via Debezium JDBC sink connector ([1384](https://github.com/feldera/feldera/pull/1384))
- SQL: Allow tables definitions to be retrieved from JDBC data sources ([1416](https://github.com/feldera/feldera/pull/1416))
- SQL: Support for EXP function ([1406](https://github.com/feldera/feldera/pull/1406))
- SQL: Support for ARRAY_APPEND function ([1419](https://github.com/feldera/feldera/pull/1419))
- SQL: support for TUMBLE streaming windows ([1404](https://github.com/feldera/feldera/pull/1404))
- API: endpoint to get a list of demo URLs ([1385](https://github.com/feldera/feldera/pull/1385))
- WebConsole: Add functionality that would enable setting up demos in the sandbox ([1321](https://github.com/feldera/feldera/pull/1321))
- WebConsole: Add Swagger link to navbar, make navbar more compact

Changed

- SQL: Illegal date literals and parsing illegal dates cause runtime
errors instead of producing `NULL` ([1398](https://github.com/feldera/feldera/pull/1398))
- WebConsole: Various design adjustments
- WebConsole: Show the entire generated API key
- WebConsole: Improve login UX with AWS Cognito (redirect to desired page after successful login) ([1364](https://github.com/feldera/feldera/pull/1364))

Added

- Compiler option for handling unquoted identifiers (https://github.com/feldera/feldera/pull/1360)
- SQL: Support for is_inf, is_nan and log methods for double (https://github.com/feldera/feldera/pull/1344)

Changed

- API: name and description are optional for connector PATCH endpoint. OpenAPI documentation for program, connector and service is more consistent. (https://github.com/feldera/feldera/pull/1315)
- SQL: check decimal precision while casting between decimal types (https://github.com/feldera/feldera/pull/1300)
- pipeline-manager: automatically queue programs for compilation (1325)

Removed

- Remove the Python dbsp and feldera-api-client modules. In lieu of Python modules, direct requests to the REST API are now used. (https://github.com/feldera/feldera/pull/1338)

Added

- API: Generalized upsert operation that allows partial modifications to table records ([1296](https://github.com/feldera/feldera/pull/1296))
- SQL: Functions on binary string (octet_length, position, overlay, substring) ([1264](https://github.com/feldera/feldera/pull/1264))
- pipeline-manager: add PUT endpoints for Programs, Pipelines, and Connectors (1248)
- Documentation: Adding a markdown page for videos (1126)
- SQL: Add hyperbolic functions ([1280](https://github.com/feldera/feldera/pull/1280))

Fixed

- pipeline-manager: fix a resource usage problem with http streaming under high load ([1257](https://github.com/feldera/feldera/pull/1257))
- SQL: Changed the semantics of integer arithmetic to match SQL standard ([1247](https://github.com/feldera/feldera/pull/1247))
- WebConsole: Connector name change doesn't reflect in the pipeline builder (1238)
- WebConsole: UI sends HTTP request in an infinite loop (1085)
- pipeline-manager: allow docs website to CORS allowed origins (1285)

Changed

- Python demo and test scripts are standalone as they no longer depend on dbsp python library ([1230](https://github.com/feldera/feldera/pull/1230))
- pipeline-manager: update service endpoints to use names instead of IDs in URLs, and add PUT endpoint ([1263](https://github.com/feldera/feldera/pull/1263))
- SQL: Changed the semantics of integer arithmetic to match SQL standard ([1247](https://github.com/feldera/feldera/pull/1247))
- pipeline-manager: use names instead of IDs in API endpoints (1214)
- WebConsole: use names instead of IDs as an API entity identifier (1214)
- WebConsole: Bearer token expiration now triggers a background token refresh or redirects to a login page (1100)
- Minimal rust version required to build feldera increased to 1.75 (was 1.73).

Added
- WebConsole: Add ability to edit connector configuration as JSON
- SQL: Preliminary support for computations with bounded memory on unbounded
streams ([1197](https://github.com/feldera/feldera/pull/1197))

Fixed
- SQL: Changed semantics of division to match SQL standard
([1201](https://github.com/feldera/feldera/pull/1201))
- WebConsole: display AWS Cognito username in user profile dropdown (1077)