Feldera

Added

- [SQL] Support for user-defined functions implemented in SQL ([1714](https://github.com/feldera/feldera/pull/1714))
- [Kafka] Allow specifying Kafka headers as part of output Kafka connector
config ([1718](https://github.com/feldera/feldera/pull/1718))
- [SQL] Support for `LEAD`/`LAG` window aggregates ([1706](https://github.com/feldera/feldera/pull/1706))
- [SQL] Support for `WATERMARK` table column annotations ([1694](https://github.com/feldera/feldera/pull/1694))
- Added a new config flag `tcp_metrics_exporter` which allows to inspect
the pipeline metrics for debugging purposes with the `metrics-observer`
CLI. ([1710](https://github.com/feldera/feldera/pull/1710))
- Ability to selectively enable storage per-pipeline. ([1692](https://github.com/feldera/feldera/pull/1692))

Changed

- [Docs] Re-organize documentation sections ([1734](https://github.com/feldera/feldera/pull/1734))

Added

- Initial support for Avro as an output format ([1673](https://github.com/feldera/feldera/pull/1673))

Changed

- Fixed a bug where sometimes the wrong profile for compilation is chosen by the manager. ([1696](https://github.com/feldera/feldera/pull/1696))

Added

- [SQL] `ARG_MIN`, `ARG_MAX` aggregation functions
([1619](https://github.com/feldera/feldera/pull/1619))
- SQL: Support for `ARRAYS_OVERLAP` function ([1570](https://github.com/feldera/feldera/pull/1570))
- Connectors: Initial Delta Table output connector support
([1639](https://github.com/feldera/feldera/pull/1639))

Changed

- [SQL]: `ARRAY_CONTAINS`, `ARRAY_POSITION`, `ARRAY_REMOVE` functions
for arguments of different types ([1636](https://github.com/feldera/feldera/pull/1636))

Added

- Output buffering mechanism to consolidate multiple output
updates over time.
([1558](https://github.com/feldera/feldera/pull/1558))
- pipeline-manager: allow programs to be compiled in unoptimized or
optimized modes, which tradeoff compilation speed for runtime speed
([1524](https://github.com/feldera/feldera/pull/1524))
- WebConsole: Support NULL values on Data Inspection and Insertion page (1392)

Changed

- pipeline-manager: connector transport configuration in the API is now
strongly typed, and the transport names have the `_input` and `_output`
suffix added ([1532](https://github.com/feldera/feldera/pull/1532))

Fixed

- WebConsole: State shows InQueue when program is empty (1443)

Changed

- dbsp: Major refactoring of the dbsp crate to improve compilation speed of SQL programs ([1516](https://github.com/feldera/feldera/pull/1516))

Added

- SQL: Support for `GROUPING`, `GROUPING_ID`, and `GROUPING SETS` ([1527](https://github.com/feldera/feldera/pull/1527))
- SQL: Support for aggregation functions: `STDDEV`,
`STDDEV_POP`, `STDDEV_SAMP` ([1539](https://github.com/feldera/feldera/pull/1539))
- SQL: support for `SORT_ARRAY` function ([1490](https://github.com/feldera/feldera/pull/1490))
- SQL: support for `ARRAY_REVERSE` function ([1491](https://github.com/feldera/feldera/pull/1491))
- SQL: support for `ARRAY_MAX`, `ARRAY_MIN` functions ([1492](https://github.com/feldera/feldera/pull/1492))
- SQL: support for `ARRAY_COMPACT` function ([1493](https://github.com/feldera/feldera/pull/1493))
- SQL: support for `ARRAY_PREPEND` function ([1496](https://github.com/feldera/feldera/pull/1496))
- adapters: add an input connector for Amazon S3 ([1485](https://github.com/feldera/feldera/pull/1485))
- pipeline-manager: add option to pick a compilation profile ([1513](https://github.com/feldera/feldera/pull/1513))
- SQL: support for `ARRAY_CONTAINS` function ([1499](https://github.com/feldera/feldera/pull/1499))
- SQL: support for `ARRAY_REPEAT` function ([1497](https://github.com/feldera/feldera/pull/1497))
- SQL: support for `ROUND(DOUBLE, digit)`, `TRUNCATE(DOUBLE, digit)` ([1512](https://github.com/feldera/feldera/pull/1512))
- SQL: support for `ARRAY_REMOVE` function ([1498](https://github.com/feldera/feldera/pull/1498))
- SQL: support for `ARRAY_DISTINCT` function ([1515](https://github.com/feldera/feldera/pull/1515))
- Added basic support to ingest and export data in the parquet format ([1510](https://github.com/feldera/feldera/pull/1510))
- WebConsole: Services page, Kafka service edit dialog ([1233](https://github.com/feldera/feldera/pull/1233))
- adapters: add an input connector for Amazon S3 ([1485](https://github.com/feldera/feldera/pull/1485))

Added

- SQL: support for ARRAY_SIZE, ARRAY_LENGTH functions ([1489](https://github.com/feldera/feldera/pull/1489))
- SQL: support for ARRAY_POSITION function ([1480](https://github.com/feldera/feldera/pull/1480))