Feldera

Read the [Incremental Update for v0.34](https://www.feldera.com/blog/incremental-update-14/) to learn what's new in this release!

What's Changed
* Fix broken link in docs. by gz in https://github.com/feldera/feldera/pull/3229
* docker: point compose file to Feldera version 0.33.0 by gz in https://github.com/feldera/feldera/pull/3228
* py: update arithmetic tests by rivudhk in https://github.com/feldera/feldera/pull/3231
* [SQL] Improve error message for recursive view type mismatch (2977) by mihaibudiu in https://github.com/feldera/feldera/pull/3226
* py: add ROW type tests for COUNT aggregate and tests returning empty by rivudhk in https://github.com/feldera/feldera/pull/3232
* [SQL] Experimental support for mixing SQL and Rust views by mihaibudiu in https://github.com/feldera/feldera/pull/3201
* [SQL] Do not crash when comparing different recursive components by mihaibudiu in https://github.com/feldera/feldera/pull/3236
* [SQL] Optimization to warn/remove unused table columns by mihaibudiu in https://github.com/feldera/feldera/pull/3233
* py: add tests returning empty for ROW and MAP types by rivudhk in https://github.com/feldera/feldera/pull/3238
* [SQL] Use checked arithmetic in the Calcite optimizer by mihaibudiu in https://github.com/feldera/feldera/pull/3209
* py: REAL type tests for MAX and MIN aggregates by rivudhk in https://github.com/feldera/feldera/pull/3239
* Show compilation errors for pipeline in fda. by gz in https://github.com/feldera/feldera/pull/3243
* py: docs: all FP nums are deserialized as Decimal by abhizer in https://github.com/feldera/feldera/pull/3241
* Improve OpenAPI `update_format` docs. by gz in https://github.com/feldera/feldera/pull/3244
* dbsp_adapters: Add comments. by blp in https://github.com/feldera/feldera/pull/3252
* [WebConsole] Fix Change Stream and Ad-Hoc Query tables flicker in Safari by Karakatiza666 in https://github.com/feldera/feldera/pull/3234
* Add a new guide for real-time web apps. by gz in https://github.com/feldera/feldera/pull/3255
* pipeline-manager: reduce monitoring overhead by snkas in https://github.com/feldera/feldera/pull/3260
* [SQL] CalciteException during parsing is not an ICE by mihaibudiu in https://github.com/feldera/feldera/pull/3266
* UI fixes, adjust font size, add a footer by Karakatiza666 in https://github.com/feldera/feldera/pull/3264
* [docs] Improve SQL doc structure. by ryzhyk in https://github.com/feldera/feldera/pull/3269
* [SQL] Improve the implementation of several array functions by mihaibudiu in https://github.com/feldera/feldera/pull/3270
* [docs] Use case: policy engine. by ryzhyk in https://github.com/feldera/feldera/pull/3271
* [adapters] Delta Lake tests + doc improvements. by ryzhyk in https://github.com/feldera/feldera/pull/3268
* [SQL] More lenient type checking for ARRAYS_OVERLAP (3272) by mihaibudiu in https://github.com/feldera/feldera/pull/3274
* Switch to upload-artifact v4. by gz in https://github.com/feldera/feldera/pull/3279
* Revert "Add debug = true to Cargo workspace for pipelines." by gz in https://github.com/feldera/feldera/pull/3276
* [SQL] Distinguish various static types of short intervals by mihaibudiu in https://github.com/feldera/feldera/pull/3237
* [adapters] Fix program schema parser. by ryzhyk in https://github.com/feldera/feldera/pull/3284
* [SQL] IS DISTINCT FROM can have nullable arguments (3278) by mihaibudiu in https://github.com/feldera/feldera/pull/3281
* Improve http ingress performance by gz in https://github.com/feldera/feldera/pull/3185
* release: bump project version to 0.34.0 by gz in https://github.com/feldera/feldera/pull/3288


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.33.0...v0.34.0

Read the [Incremental Update for v0.33](https://www.feldera.com/blog/incremental-update-13/) to learn what's new in this release!

What's Changed
* Revert "[adapters] Workaround for datafusion regression." by ryzhyk in https://github.com/feldera/feldera/pull/3123
* docker: point compose file to Feldera version 0.32.0 by gz in https://github.com/feldera/feldera/pull/3138
* Use types that directly represent files, instead of file handles. by blp in https://github.com/feldera/feldera/pull/3133
* [SQL] Fix/implement functions `DATE_FORMAT`, `ARRAY_CONCAT`, `ARRAY_UNION`,… by mihaibudiu in https://github.com/feldera/feldera/pull/3124
* [DOC] Small SQL documentation fixes by mihaibudiu in https://github.com/feldera/feldera/pull/3142
* [SQL] Three commits fixing three bugs (3125, 3126, 3128). by mihaibudiu in https://github.com/feldera/feldera/pull/3135
* [SQL] Add missing cast functions to variant (3140) by mihaibudiu in https://github.com/feldera/feldera/pull/3141
* pipeline-manager: connector orchestration by snkas in https://github.com/feldera/feldera/pull/3096
* [SQL] Workaround Calcite's inconsistent typing of ROW fields (3119) by mihaibudiu in https://github.com/feldera/feldera/pull/3146
* Improve logging for adapter messages by blp in https://github.com/feldera/feldera/pull/3084
* [SQL] Restrict the kinds of results that can be produced by date subtraction (3132) by mihaibudiu in https://github.com/feldera/feldera/pull/3137
* deploy: fix copy of Cargo.lock by snkas in https://github.com/feldera/feldera/pull/3150
* docs: connector orchestration by snkas in https://github.com/feldera/feldera/pull/3148
* Debug symbols by gz in https://github.com/feldera/feldera/pull/3156
* Fixes deadlocks with input stats RwLock. by gz in https://github.com/feldera/feldera/pull/3155
* Many UI fixes and improvements, mobile and tablet support by Karakatiza666 in https://github.com/feldera/feldera/pull/3037
* [SQL] Correctly optimize initializer functions in ChainAggregate operators (3145) by mihaibudiu in https://github.com/feldera/feldera/pull/3157
* py: ROW type tests for MAX and MIN aggregates by rivudhk in https://github.com/feldera/feldera/pull/3152
* [SQL] Optimization to remove unused fields by mihaibudiu in https://github.com/feldera/feldera/pull/3147
* [SQL] Refine long interval types by mihaibudiu in https://github.com/feldera/feldera/pull/3173
* [SQL] Insert explicit casts for several function arguments by mihaibudiu in https://github.com/feldera/feldera/pull/3168
* docker: remove stale default origins by lalithsuresh in https://github.com/feldera/feldera/pull/3167
* pipeline-manager: pipeline GET selector and allow missing in POST/PUT by snkas in https://github.com/feldera/feldera/pull/3161
* [adapters] Iceberg source connector. by ryzhyk in https://github.com/feldera/feldera/pull/3172
* docs: update helm chart version to latest release by lalithsuresh in https://github.com/feldera/feldera/pull/3191
* [SQL] Vec/Map/ZSet/Variant expressions are not always literals (3164) by mihaibudiu in https://github.com/feldera/feldera/pull/3182
* Support custom CSV delimiters by blp in https://github.com/feldera/feldera/pull/3166
* [SQL] Do not panic when parsing a null string into a nullable integer by mihaibudiu in https://github.com/feldera/feldera/pull/3189
* [py] expose inner pipeline metadata by abhizer in https://github.com/feldera/feldera/pull/3151
* pipeline-manager: revert reuse of reqwest client by snkas in https://github.com/feldera/feldera/pull/3187
* Multiple UI fixes by Karakatiza666 in https://github.com/feldera/feldera/pull/3186
* [SQL] Correctly implement outer joins by mihaibudiu in https://github.com/feldera/feldera/pull/3192
* py: ROW type tests for SOME, EVERY and ARRAY_AGG aggregates by rivudhk in https://github.com/feldera/feldera/pull/3197
* [SQL] For cross-joins outer joins are the same as inner joins by mihaibudiu in https://github.com/feldera/feldera/pull/3194
* [SQL] Do not panic on casting VARIANT to VARCHAR by mihaibudiu in https://github.com/feldera/feldera/pull/3203
* [SQL] Two commits fixing two bugs by mihaibudiu in https://github.com/feldera/feldera/pull/3205
* [py] add support for connector orchestation by abhizer in https://github.com/feldera/feldera/pull/3195
* pipeline-manager: pipeline unreachable status code 503 instead of 500 by snkas in https://github.com/feldera/feldera/pull/3206
* [SQL] Types like VARCHAR cannot have waterlines by mihaibudiu in https://github.com/feldera/feldera/pull/3208
* examples: cleanup pre-packaged demos by lalithsuresh in https://github.com/feldera/feldera/pull/3178
* [SQL] Point to the right column name on foreign key validation failure by mihaibudiu in https://github.com/feldera/feldera/pull/3224
* py: INTERVAL type arithmetic tests by rivudhk in https://github.com/feldera/feldera/pull/3225
* Make sure there is always a tokio runtime for http input. by gz in https://github.com/feldera/feldera/pull/3221
* Multiple UI bugfixes and improvements by Karakatiza666 in https://github.com/feldera/feldera/pull/3223
* release: bump project version to 0.33.0 by gz in https://github.com/feldera/feldera/pull/3227


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.32.0...v0.33.0

Read the [Incremental Update for v0.32](https://www.feldera.com/blog/incremental-update-12/) to learn what's new in this release!

What's Changed
* post release v0.31.2 by lalithsuresh in https://github.com/feldera/feldera/pull/3112
* pipeline-manager: clearer error message when handle is no longer owned by snkas in https://github.com/feldera/feldera/pull/3092
* [adapters] Optimize loading delta tables with lateness by ryzhyk in https://github.com/feldera/feldera/pull/3106
* pipeline-manager: compiler rework tests by snkas in https://github.com/feldera/feldera/pull/3116
* py: MAP type tests for ARG_MAX, ARG_MIN and ARR_AGG aggregates by rivudhk in https://github.com/feldera/feldera/pull/3120
* [SQL] Improved validation for view lateness (3114) by mihaibudiu in https://github.com/feldera/feldera/pull/3122
* [WebConsole] Fix .randomUUID() needlessly required even in unsecure deployments by Karakatiza666 in https://github.com/feldera/feldera/pull/3130
* pipeline-manager: query parameter `code=false` excludes `program_info` by snkas in https://github.com/feldera/feldera/pull/3129
* Use docker.com mirror for redpanda image. by gz in https://github.com/feldera/feldera/pull/3134
* release: bump project version to 0.32.0 by gz in https://github.com/feldera/feldera/pull/3136


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.31.2...v0.32.0

What's Changed
* post release v0.31.1 by lalithsuresh in https://github.com/feldera/feldera/pull/3080
* Update README.md by lalithsuresh in https://github.com/feldera/feldera/pull/3082
* [SQL] Fixes bugs found by SQLancer by mihaibudiu in https://github.com/feldera/feldera/pull/3081
* docs: Document fault tolerance. by blp in https://github.com/feldera/feldera/pull/3077
* [DOCS] Recursion is supported by mihaibudiu in https://github.com/feldera/feldera/pull/3085
* dbsp_adapters: Add support for multiline JSON. by blp in https://github.com/feldera/feldera/pull/3061
* [SQL] Emit extra metadata information in JSON: default value, lateness, watermark by mihaibudiu in https://github.com/feldera/feldera/pull/3068
* python: account for status `SqlCompiled` in program compilation check by snkas in https://github.com/feldera/feldera/pull/3091
* [SQL] Three commmits fixing bugs in the SQL compiler runtime by mihaibudiu in https://github.com/feldera/feldera/pull/3089
* [SQL] Support for PARSE_* functions for time-related types by mihaibudiu in https://github.com/feldera/feldera/pull/3087
* py: ARRAY type tests for ARG_MIN and ARG_MAX aggregates by rivudhk in https://github.com/feldera/feldera/pull/3078
* [fda] fix --recompile and add --version by gz in https://github.com/feldera/feldera/pull/3090
* Fixes 2 bugs found by Sqlancer and 1 bug found by SLT by mihaibudiu in https://github.com/feldera/feldera/pull/3099
* [SQL] Only merge map operators with their input when their input has … by mihaibudiu in https://github.com/feldera/feldera/pull/3097
* py: MAP type tests for MAX and MIN aggregates by rivudhk in https://github.com/feldera/feldera/pull/3079
* [SQL] Introduce a let expression; use it to provide multiple flavors … by mihaibudiu in https://github.com/feldera/feldera/pull/3103
* [SQL] Build compiler based on a branch which does not change accidentally by mihaibudiu in https://github.com/feldera/feldera/pull/3105
* release: bump project version to 0.31.2 by lalithsuresh in https://github.com/feldera/feldera/pull/3111
* [SQL] a function that clones a complex value (e.g. an ARRAY) is still a projection by mihaibudiu in https://github.com/feldera/feldera/pull/3110


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.31.1...v0.31.2

What's Changed
* Post-release v0.31. by gz in https://github.com/feldera/feldera/pull/3054
* Add tests for FileValBatch. by blp in https://github.com/feldera/feldera/pull/3049
* py: ARRAY type tests for ARRAY_AGG aggregate by rivudhk in https://github.com/feldera/feldera/pull/3046
* [SQL] Better validation for default column initializers by mihaibudiu in https://github.com/feldera/feldera/pull/3058
* dbsp: Improved trace compaction by ryzhyk in https://github.com/feldera/feldera/pull/3057
* adapters: Upgrade to datafusion 0.43. by ryzhyk in https://github.com/feldera/feldera/pull/3060
* [SQL] Change 'CREATE RECURSIVE VIEW' to 'DECLARE RECURSIVE VIEW' by mihaibudiu in https://github.com/feldera/feldera/pull/3062
* [SQL] Use UnimplementedException instead of NotImplementedException by mihaibudiu in https://github.com/feldera/feldera/pull/3064
* py: ARRAY type tests for COUNT, EVERY and SOME aggregates by rivudhk in https://github.com/feldera/feldera/pull/3065
* Clippy 1.83 by ryzhyk in https://github.com/feldera/feldera/pull/3066
* [SQL] Support for OVER without ROWS, RANK, or ORDER BY by mihaibudiu in https://github.com/feldera/feldera/pull/3067
* pipeline-manager: compiler server improvements including caching by snkas in https://github.com/feldera/feldera/pull/2992
* [tests] re-enable SQL aggregate tests for decimals by abhizer in https://github.com/feldera/feldera/pull/3069
* release: bump project version to 0.31.1 by lalithsuresh in https://github.com/feldera/feldera/pull/3075


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.31.0...v0.31.1

Read the [Incremental Update for v0.31](https://www.feldera.com/blog/incremental-update-11/) to learn what's new in this release!

What's Changed

* py: BINARY type tests for COUNT, MAX and MIN aggregates by rivudhk in https://github.com/feldera/feldera/pull/2944
* [docs] Trailing comma in JSON in confluent-jdbc.md by ryzhyk in https://github.com/feldera/feldera/pull/2955
* feldera-types: fix serialization of `SqlType` by snkas in https://github.com/feldera/feldera/pull/2948
* [WebConsole] Improve error handling when parsing streams by Karakatiza666 in https://github.com/feldera/feldera/pull/2935
* dbsp_adapters: Add secret resolution to FT Kafka output adapter. by blp in https://github.com/feldera/feldera/pull/2957
* docs: feldera enterprise v0.12.0 by snkas in https://github.com/feldera/feldera/pull/2958
* Three commits fixing 3 different reported bugs by mihaibudiu in https://github.com/feldera/feldera/pull/2950
* py: BINARY type tests for ARG_MAX, ARG_MIN and ARRAY_AGG aggregates by rivudhk in https://github.com/feldera/feldera/pull/2959
* [SQL] Allow users to define new type names for existing types by mihaibudiu in https://github.com/feldera/feldera/pull/2952
* py: BINARY type tests for SOME and EVERY aggregates by rivudhk in https://github.com/feldera/feldera/pull/2960
* [SQL] CalciteException does not signal an internal compiler error by mihaibudiu in https://github.com/feldera/feldera/pull/2953
* [SQL] support for mutually-recursive views by mihaibudiu in https://github.com/feldera/feldera/pull/2674
* Use a Calcite branch that has the expected commit by mihaibudiu in https://github.com/feldera/feldera/pull/2968
* Make sure we run adhoc queries in the dbsp tokio rt. by gz in https://github.com/feldera/feldera/pull/2963
* [WebConsole] Fix a rare crash when opening a page by Karakatiza666 in https://github.com/feldera/feldera/pull/2965
* [SQL] Handle correctly the last SLT test in a file when the test output is empty by mihaibudiu in https://github.com/feldera/feldera/pull/2966
* [SQL] Rebase Calcite on latest main by mihaibudiu in https://github.com/feldera/feldera/pull/2967
* [SQL] support split_part for postgres string by zhuqi-lucas in https://github.com/feldera/feldera/pull/2969
* py: VARBINARY tests for COUNT and ARRAY_AGG aggregates by rivudhk in https://github.com/feldera/feldera/pull/2973
* [SQL] Runtime library support for TIMESTAMP +/- LONG INTERVAL by mihaibudiu in https://github.com/feldera/feldera/pull/2974
* [SQL] Fix 3 bugs related to recursive programs by mihaibudiu in https://github.com/feldera/feldera/pull/2981
* py: INTERVAL type tests for COUNT aggregate by rivudhk in https://github.com/feldera/feldera/pull/2937
* [manager] Quote case-sensitive table names. by ryzhyk in https://github.com/feldera/feldera/pull/2983
* dbsp: Use xxh3 default hasher instead of custom. by blp in https://github.com/feldera/feldera/pull/2982
* [python] detailed error message on start / pause by abhizer in https://github.com/feldera/feldera/pull/2984
* py: VARBINARY type tests for MAX, MIN, EVERY and SOME aggregates by rivudhk in https://github.com/feldera/feldera/pull/2988
* Fault tolerance fixes and improvements by blp in https://github.com/feldera/feldera/pull/2962
* [dbsp] Strongly typed controlled filters. by ryzhyk in https://github.com/feldera/feldera/pull/2995
* py: INTERVAL type tests for MIN, EVERY and SOME aggregates by rivudhk in https://github.com/feldera/feldera/pull/2993
* [SQL] Support for the regexp_replace function by mihaibudiu in https://github.com/feldera/feldera/pull/2996
* Add example for debugging recursion. by gz in https://github.com/feldera/feldera/pull/3000
* [SQL] Fix crash caused by recursive view not declared but not defined by mihaibudiu in https://github.com/feldera/feldera/pull/3003
* Implement the first version of the new UI design and layout by Karakatiza666 in https://github.com/feldera/feldera/pull/2985
* [SQL] Introduce a system view for displaying runtime errors by mihaibudiu in https://github.com/feldera/feldera/pull/3002
* [SQL] Load only implemented functions from Calcite by mihaibudiu in https://github.com/feldera/feldera/pull/3008
* py: VARBINARY type tests for ARG_MAX and ARG_MIN aggregates by rivudhk in https://github.com/feldera/feldera/pull/3013
* [SQL/SLT] SLT tests were broken when the error view was introduced by mihaibudiu in https://github.com/feldera/feldera/pull/3012
* py: INTERVAL type tests for ARG_MAX and ARG_MIN aggregates by rivudhk in https://github.com/feldera/feldera/pull/3014
* [docs] Fix typo in Kafka input connector docs by watfordsuzy in https://github.com/feldera/feldera/pull/3015
* Error handling bug fixes in input adapters by blp in https://github.com/feldera/feldera/pull/3016
* [SQL] Add the predefined non-Calcite functions to the function index by mihaibudiu in https://github.com/feldera/feldera/pull/3018
* [SQL] Reorganize date computations by mihaibudiu in https://github.com/feldera/feldera/pull/3026
* [SQL] Do not insert connector information in the generated Rust code by mihaibudiu in https://github.com/feldera/feldera/pull/3032
* [SQL] Pass distinctness information to DBSP layer by mihaibudiu in https://github.com/feldera/feldera/pull/3027
* [SQL] Implement more arithmetic operations on intervals by mihaibudiu in https://github.com/feldera/feldera/pull/3033
* [WebConsole] Multiple UI fixes by Karakatiza666 in https://github.com/feldera/feldera/pull/3036
* [SQL] strip connector information from table definitions by abhizer in https://github.com/feldera/feldera/pull/3045
* dbsp: Fix tuple builder for FileValBatch. by blp in https://github.com/feldera/feldera/pull/3047
* py: subtraction test for DATE type by rivudhk in https://github.com/feldera/feldera/pull/2987
* [SQL] Fixes several bugs found using SqlLancer. by mihaibudiu in https://github.com/feldera/feldera/pull/3048
* [SQL] implement blackbox function by abhizer in https://github.com/feldera/feldera/pull/3044
* Improve ad-hoc query documentation. by gz in https://github.com/feldera/feldera/pull/3001
* dbsp: Replace recede_to with set_frontier. by ryzhyk in https://github.com/feldera/feldera/pull/3051
* [SQL] Support for map_contains_key function by mihaibudiu in https://github.com/feldera/feldera/pull/3050
* release: bump project version to 0.31.0 by gz in https://github.com/feldera/feldera/pull/3053

New Contributors
* watfordsuzy made their first contribution in https://github.com/feldera/feldera/pull/3015

**Full Changelog**: https://github.com/feldera/feldera/compare/v0.30.0...v0.31.0