Feldera

What's Changed
* docker: point compose file to Feldera version 0.36.0 by gz in https://github.com/feldera/feldera/pull/3415
* Remove ci.yml build from merge_queue trigger. by gz in https://github.com/feldera/feldera/pull/3413
* pipeline-manager: `refresh_version` field by snkas in https://github.com/feldera/feldera/pull/3401
* [SQL] Improved error message for unsupported WINDOW aggregates by mihaibudiu in https://github.com/feldera/feldera/pull/3412
* [SQL] Use Arc for Map implementations by mihaibudiu in https://github.com/feldera/feldera/pull/3408
* [SQL] Give a good error message for joins on struct types by mihaibudiu in https://github.com/feldera/feldera/pull/3399
* [SQL] Quote column names when generating SQL code internally by mihaibudiu in https://github.com/feldera/feldera/pull/3411
* [SQL] Correctly handle temporal filters that return nullable values by mihaibudiu in https://github.com/feldera/feldera/pull/3421
* Code cleanups by blp in https://github.com/feldera/feldera/pull/3420
* [adapters] Ingest zstd-compressed Kafka streams by ryzhyk in https://github.com/feldera/feldera/pull/3424
* [WebConsole] Fix arm64 web-console build by Karakatiza666 in https://github.com/feldera/feldera/pull/3419
* [SQL] Eliminate unnecessary clones from array_agg and map_agg by mihaibudiu in https://github.com/feldera/feldera/pull/3425
* release: bump Enterprise version to v0.18.0 by lalithsuresh in https://github.com/feldera/feldera/pull/3426
* release: bump Enterprise version to v0.19.0 by lalithsuresh in https://github.com/feldera/feldera/pull/3431
* [SQL] Trimming input fields has to preserve the map operator after the input (3427) by mihaibudiu in https://github.com/feldera/feldera/pull/3428
* docker: pin Rust version to 1.82.0 by snkas in https://github.com/feldera/feldera/pull/3430
* pipeline-manager: platform version suffix by snkas in https://github.com/feldera/feldera/pull/3429
* Add support for storage configuration by blp in https://github.com/feldera/feldera/pull/3434
* pipeline-manager: fix cleanup retention of compiler server by snkas in https://github.com/feldera/feldera/pull/3391
* [dbsp] Missing track_caller annotations. by ryzhyk in https://github.com/feldera/feldera/pull/3442
* [CI] Quiet cargo execution by mihaibudiu in https://github.com/feldera/feldera/pull/3441
* [dbsp] Profiling improvements. by ryzhyk in https://github.com/feldera/feldera/pull/3443
* [SQL] Avoid cloning by mihaibudiu in https://github.com/feldera/feldera/pull/3438
* [SQL] Implement ARRAY as Arc<Vec> by mihaibudiu in https://github.com/feldera/feldera/pull/3445
* [SQL] Produce narrower antijoins when implementing outer joins by mihaibudiu in https://github.com/feldera/feldera/pull/3449
* Array postfixes. by ryzhyk in https://github.com/feldera/feldera/pull/3450
* [dbsp] Add user configuration for the storage cache size. by blp in https://github.com/feldera/feldera/pull/3451
* Initial import of PostgreSQL connector. by gz in https://github.com/feldera/feldera/pull/3447
* Caches and Bloom filters by gz in https://github.com/feldera/feldera/pull/3452
* [SQL] use interned strings by mihaibudiu in https://github.com/feldera/feldera/pull/2608
* [SQL] Accept intervals with a + sign in leading position by mihaibudiu in https://github.com/feldera/feldera/pull/3459
* pipeline-manager: improved pipeline and runner error reporting by snkas in https://github.com/feldera/feldera/pull/3432
* pipeline-manager: revision in welcome message and GET `/config` by snkas in https://github.com/feldera/feldera/pull/3454
* [SQL] Fields access in a nullable struct is a nullable result by mihaibudiu in https://github.com/feldera/feldera/pull/3456
* [SQL] unwrap() is a monotone function by mihaibudiu in https://github.com/feldera/feldera/pull/3464
* Performance improvements by blp in https://github.com/feldera/feldera/pull/3466
* [adapters] Raw input format. by ryzhyk in https://github.com/feldera/feldera/pull/3463
* [sqllib] Implement SqlString using arcstr by ryzhyk in https://github.com/feldera/feldera/pull/3467
* Update status badge to follow main by lalithsuresh in https://github.com/feldera/feldera/pull/3470
* [SQL] Allow aggregates to use wider intermediate types by mihaibudiu in https://github.com/feldera/feldera/pull/3460
* [SQL] Move to a newer version of Calcite by mihaibudiu in https://github.com/feldera/feldera/pull/3471
* [adapters] Improve panic message when the Kafka broker is down. by blp in https://github.com/feldera/feldera/pull/3474
* pipeline-manager: custom error message for disconnect during request by snkas in https://github.com/feldera/feldera/pull/3469
* Report cache statistics separately for foreground and background workers by blp in https://github.com/feldera/feldera/pull/3476
* [SQL] Handle correctly + sign for intervals DAY TO SECOND by mihaibudiu in https://github.com/feldera/feldera/pull/3473
* [SQL] Execute multiple MIN/MAX aggregates over append-only collection… by mihaibudiu in https://github.com/feldera/feldera/pull/3475
* pipeline-manager: fix two error log prints by snkas in https://github.com/feldera/feldera/pull/3480
* More merger stats+script by gz in https://github.com/feldera/feldera/pull/3477
* [SQL] Use LazyLock instead of lazy_static; allocate MAP and ARRAY lit… by mihaibudiu in https://github.com/feldera/feldera/pull/3479
* py: DECIMAL type tests for stddev aggregate by rivudhk in https://github.com/feldera/feldera/pull/3481
* [SQL] Fix incorrect casts in outer join code by mihaibudiu in https://github.com/feldera/feldera/pull/3482
* [SQL] Optimize away identity function map and map_index operations by mihaibudiu in https://github.com/feldera/feldera/pull/3483
* [docs] usecase: opentelemetry by abhizer in https://github.com/feldera/feldera/pull/3439
* [adapters] Better Kafka output error reporting. by ryzhyk in https://github.com/feldera/feldera/pull/3436
* [adapters] Experimental CDC mode for DeltaLake. by ryzhyk in https://github.com/feldera/feldera/pull/3484
* [dbsp] Monomorphic version of DBSP API. by ryzhyk in https://github.com/feldera/feldera/pull/3383
* [adapters] Only ingest Delta columns declared in SQL. by ryzhyk in https://github.com/feldera/feldera/pull/3488
* dbsp: use pwritev on any unix, not just linux by lalithsuresh in https://github.com/feldera/feldera/pull/3490
* [adapters] Parse Parquet data using arrow. by ryzhyk in https://github.com/feldera/feldera/pull/3489
* Multiple optimizations for writing to storage by blp in https://github.com/feldera/feldera/pull/3497
* [adapters] Add operation type to raw Avro messages. by ryzhyk in https://github.com/feldera/feldera/pull/3498
* ci: python: set test execution timeout by abhizer in https://github.com/feldera/feldera/pull/3493
* [dbsp] Implement Hash for dyn DataTrait. by ryzhyk in https://github.com/feldera/feldera/pull/3500
* adapters: improve URL connector error reporting by snkas in https://github.com/feldera/feldera/pull/3494
* Shrink btree cursors by blp in https://github.com/feldera/feldera/pull/3505
* [dbsp] Prioritize the longest spines for merging. by blp in https://github.com/feldera/feldera/pull/3504
* Bloom filter fixes by blp in https://github.com/feldera/feldera/pull/3507
* release: bump project version to 0.37.0 by gz in https://github.com/feldera/feldera/pull/3514


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.36.0...v0.37.0

Read the [Incremental Update for v0.36](https://www.feldera.com/blog/incremental-update-16/) to learn what's new in this release!

What's Changed
* docker: point compose file to Feldera version 0.35.0 by gz in https://github.com/feldera/feldera/pull/3359
* pipeline-manager: distinguish two pipeline API categories by snkas in https://github.com/feldera/feldera/pull/3360
* helm: update Enterprise version to v0.16.1 by lalithsuresh in https://github.com/feldera/feldera/pull/3357
* [CI] Fix incorrectly extracting release version for the multi-arch manifest tag by Karakatiza666 in https://github.com/feldera/feldera/pull/3366
* [CI] Fix incorrectly extracting release version for the multi-arch manifest tag by Karakatiza666 in https://github.com/feldera/feldera/pull/3370
* pipeline-manager: reorder action and checkpoint API endpoints by snkas in https://github.com/feldera/feldera/pull/3368
* [dbsp] Fix antijoin for indexed z-sets. by ryzhyk in https://github.com/feldera/feldera/pull/3371
* pipeline-manager: organize endpoints of API by snkas in https://github.com/feldera/feldera/pull/3367
* Fix Ad-hoc UI in WebConsole, enable batch delete of failed pipelines by Karakatiza666 in https://github.com/feldera/feldera/pull/3369
* [adapters] s3: Avoid panic when adapter exits before reading all the … by blp in https://github.com/feldera/feldera/pull/3377
* Print root-cause for input/output errors. by gz in https://github.com/feldera/feldera/pull/3378
* pipeline-manager: remove `main_rust` from API GET endpoints by snkas in https://github.com/feldera/feldera/pull/3382
* [docs] Clarify LATENESS expression type by ryzhyk in https://github.com/feldera/feldera/pull/3386
* [adapters] Reduce serde code. by ryzhyk in https://github.com/feldera/feldera/pull/3385
* py: add uuid tests by rivudhk in https://github.com/feldera/feldera/pull/3376
* py: DECIMAL type tests for COUNT, EVERY and SOME aggregates by rivudhk in https://github.com/feldera/feldera/pull/3381
* [dbsp] Disable io_uring storage by default. by blp in https://github.com/feldera/feldera/pull/3389
* [SQL] Remove unused fields from plans by mihaibudiu in https://github.com/feldera/feldera/pull/3387
* py: modified timestamp tests to include more intervals by rivudhk in https://github.com/feldera/feldera/pull/3335
* [SQL] Share indexes for antijoins and outer joins by mihaibudiu in https://github.com/feldera/feldera/pull/3395
* Multiway merging by gz in https://github.com/feldera/feldera/pull/3392
* [SQL] Add a missing cast function to sqllib by mihaibudiu in https://github.com/feldera/feldera/pull/3397
* [dbsp] Avoid sharding in antijoin. by ryzhyk in https://github.com/feldera/feldera/pull/3393
* [dbsp] The sum of sharded streams is sharded. by ryzhyk in https://github.com/feldera/feldera/pull/3394
* Compression by gz in https://github.com/feldera/feldera/pull/3410
* release: bump project version to 0.36.0 by gz in https://github.com/feldera/feldera/pull/3414


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.35.0...v0.36.0

**Full Changelog**: https://github.com/feldera/feldera/compare/v0.34.1...v0.35.0

This release fixes a potential deadlock in the pipeline-manager that got introduced in `v0.34.0`. If you're running this version it is advisable to upgrade to this bugfix release.

What's Changed
* docker: point compose file to Feldera version 0.34.0 by gz in https://github.com/feldera/feldera/pull/3289
* [SQL] Remove spurious warning; CSE for delta operators by mihaibudiu in https://github.com/feldera/feldera/pull/3283
* [SQL] Fix two bugs in monotone value computation by mihaibudiu in https://github.com/feldera/feldera/pull/3290
* Fix display of datafusion errors. by gz in https://github.com/feldera/feldera/pull/3292
* dbsp: Disable missing documentation warnings for test-only items. by blp in https://github.com/feldera/feldera/pull/3296
* [SQL] Simpler conversion of FP to string by mihaibudiu in https://github.com/feldera/feldera/pull/3295
* [SQL] Better error messages involving string and decimal types (3247) by mihaibudiu in https://github.com/feldera/feldera/pull/3273
* [DOCS] Attempt to use anchors in docusaurus files for functions by mihaibudiu in https://github.com/feldera/feldera/pull/3298
* [SQL] Support for IF function by mihaibudiu in https://github.com/feldera/feldera/pull/3299
* [dbsp] schedule circuits using tokio. by ryzhyk in https://github.com/feldera/feldera/pull/3300
* Correctly GC output of `chain_aggregate`. by ryzhyk in https://github.com/feldera/feldera/pull/3304
* Fixes a RwLock deadlock in manager. by gz in https://github.com/feldera/feldera/pull/3308
* release: bump project version to 0.34.1 by gz in https://github.com/feldera/feldera/pull/3311


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.34.0...v0.34.1

Read the [Incremental Update for v0.34](https://www.feldera.com/blog/incremental-update-14/) to learn what's new in this release!

What's Changed
* Fix broken link in docs. by gz in https://github.com/feldera/feldera/pull/3229
* docker: point compose file to Feldera version 0.33.0 by gz in https://github.com/feldera/feldera/pull/3228
* py: update arithmetic tests by rivudhk in https://github.com/feldera/feldera/pull/3231
* [SQL] Improve error message for recursive view type mismatch (2977) by mihaibudiu in https://github.com/feldera/feldera/pull/3226
* py: add ROW type tests for COUNT aggregate and tests returning empty by rivudhk in https://github.com/feldera/feldera/pull/3232
* [SQL] Experimental support for mixing SQL and Rust views by mihaibudiu in https://github.com/feldera/feldera/pull/3201
* [SQL] Do not crash when comparing different recursive components by mihaibudiu in https://github.com/feldera/feldera/pull/3236
* [SQL] Optimization to warn/remove unused table columns by mihaibudiu in https://github.com/feldera/feldera/pull/3233
* py: add tests returning empty for ROW and MAP types by rivudhk in https://github.com/feldera/feldera/pull/3238
* [SQL] Use checked arithmetic in the Calcite optimizer by mihaibudiu in https://github.com/feldera/feldera/pull/3209
* py: REAL type tests for MAX and MIN aggregates by rivudhk in https://github.com/feldera/feldera/pull/3239
* Show compilation errors for pipeline in fda. by gz in https://github.com/feldera/feldera/pull/3243
* py: docs: all FP nums are deserialized as Decimal by abhizer in https://github.com/feldera/feldera/pull/3241
* Improve OpenAPI `update_format` docs. by gz in https://github.com/feldera/feldera/pull/3244
* dbsp_adapters: Add comments. by blp in https://github.com/feldera/feldera/pull/3252
* [WebConsole] Fix Change Stream and Ad-Hoc Query tables flicker in Safari by Karakatiza666 in https://github.com/feldera/feldera/pull/3234
* Add a new guide for real-time web apps. by gz in https://github.com/feldera/feldera/pull/3255
* pipeline-manager: reduce monitoring overhead by snkas in https://github.com/feldera/feldera/pull/3260
* [SQL] CalciteException during parsing is not an ICE by mihaibudiu in https://github.com/feldera/feldera/pull/3266
* UI fixes, adjust font size, add a footer by Karakatiza666 in https://github.com/feldera/feldera/pull/3264
* [docs] Improve SQL doc structure. by ryzhyk in https://github.com/feldera/feldera/pull/3269
* [SQL] Improve the implementation of several array functions by mihaibudiu in https://github.com/feldera/feldera/pull/3270
* [docs] Use case: policy engine. by ryzhyk in https://github.com/feldera/feldera/pull/3271
* [adapters] Delta Lake tests + doc improvements. by ryzhyk in https://github.com/feldera/feldera/pull/3268
* [SQL] More lenient type checking for ARRAYS_OVERLAP (3272) by mihaibudiu in https://github.com/feldera/feldera/pull/3274
* Switch to upload-artifact v4. by gz in https://github.com/feldera/feldera/pull/3279
* Revert "Add debug = true to Cargo workspace for pipelines." by gz in https://github.com/feldera/feldera/pull/3276
* [SQL] Distinguish various static types of short intervals by mihaibudiu in https://github.com/feldera/feldera/pull/3237
* [adapters] Fix program schema parser. by ryzhyk in https://github.com/feldera/feldera/pull/3284
* [SQL] IS DISTINCT FROM can have nullable arguments (3278) by mihaibudiu in https://github.com/feldera/feldera/pull/3281
* Improve http ingress performance by gz in https://github.com/feldera/feldera/pull/3185
* release: bump project version to 0.34.0 by gz in https://github.com/feldera/feldera/pull/3288


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.33.0...v0.34.0

Read the [Incremental Update for v0.33](https://www.feldera.com/blog/incremental-update-13/) to learn what's new in this release!

What's Changed
* Revert "[adapters] Workaround for datafusion regression." by ryzhyk in https://github.com/feldera/feldera/pull/3123
* docker: point compose file to Feldera version 0.32.0 by gz in https://github.com/feldera/feldera/pull/3138
* Use types that directly represent files, instead of file handles. by blp in https://github.com/feldera/feldera/pull/3133
* [SQL] Fix/implement functions `DATE_FORMAT`, `ARRAY_CONCAT`, `ARRAY_UNION`,… by mihaibudiu in https://github.com/feldera/feldera/pull/3124
* [DOC] Small SQL documentation fixes by mihaibudiu in https://github.com/feldera/feldera/pull/3142
* [SQL] Three commits fixing three bugs (3125, 3126, 3128). by mihaibudiu in https://github.com/feldera/feldera/pull/3135
* [SQL] Add missing cast functions to variant (3140) by mihaibudiu in https://github.com/feldera/feldera/pull/3141
* pipeline-manager: connector orchestration by snkas in https://github.com/feldera/feldera/pull/3096
* [SQL] Workaround Calcite's inconsistent typing of ROW fields (3119) by mihaibudiu in https://github.com/feldera/feldera/pull/3146
* Improve logging for adapter messages by blp in https://github.com/feldera/feldera/pull/3084
* [SQL] Restrict the kinds of results that can be produced by date subtraction (3132) by mihaibudiu in https://github.com/feldera/feldera/pull/3137
* deploy: fix copy of Cargo.lock by snkas in https://github.com/feldera/feldera/pull/3150
* docs: connector orchestration by snkas in https://github.com/feldera/feldera/pull/3148
* Debug symbols by gz in https://github.com/feldera/feldera/pull/3156
* Fixes deadlocks with input stats RwLock. by gz in https://github.com/feldera/feldera/pull/3155
* Many UI fixes and improvements, mobile and tablet support by Karakatiza666 in https://github.com/feldera/feldera/pull/3037
* [SQL] Correctly optimize initializer functions in ChainAggregate operators (3145) by mihaibudiu in https://github.com/feldera/feldera/pull/3157
* py: ROW type tests for MAX and MIN aggregates by rivudhk in https://github.com/feldera/feldera/pull/3152
* [SQL] Optimization to remove unused fields by mihaibudiu in https://github.com/feldera/feldera/pull/3147
* [SQL] Refine long interval types by mihaibudiu in https://github.com/feldera/feldera/pull/3173
* [SQL] Insert explicit casts for several function arguments by mihaibudiu in https://github.com/feldera/feldera/pull/3168
* docker: remove stale default origins by lalithsuresh in https://github.com/feldera/feldera/pull/3167
* pipeline-manager: pipeline GET selector and allow missing in POST/PUT by snkas in https://github.com/feldera/feldera/pull/3161
* [adapters] Iceberg source connector. by ryzhyk in https://github.com/feldera/feldera/pull/3172
* docs: update helm chart version to latest release by lalithsuresh in https://github.com/feldera/feldera/pull/3191
* [SQL] Vec/Map/ZSet/Variant expressions are not always literals (3164) by mihaibudiu in https://github.com/feldera/feldera/pull/3182
* Support custom CSV delimiters by blp in https://github.com/feldera/feldera/pull/3166
* [SQL] Do not panic when parsing a null string into a nullable integer by mihaibudiu in https://github.com/feldera/feldera/pull/3189
* [py] expose inner pipeline metadata by abhizer in https://github.com/feldera/feldera/pull/3151
* pipeline-manager: revert reuse of reqwest client by snkas in https://github.com/feldera/feldera/pull/3187
* Multiple UI fixes by Karakatiza666 in https://github.com/feldera/feldera/pull/3186
* [SQL] Correctly implement outer joins by mihaibudiu in https://github.com/feldera/feldera/pull/3192
* py: ROW type tests for SOME, EVERY and ARRAY_AGG aggregates by rivudhk in https://github.com/feldera/feldera/pull/3197
* [SQL] For cross-joins outer joins are the same as inner joins by mihaibudiu in https://github.com/feldera/feldera/pull/3194
* [SQL] Do not panic on casting VARIANT to VARCHAR by mihaibudiu in https://github.com/feldera/feldera/pull/3203
* [SQL] Two commits fixing two bugs by mihaibudiu in https://github.com/feldera/feldera/pull/3205
* [py] add support for connector orchestation by abhizer in https://github.com/feldera/feldera/pull/3195
* pipeline-manager: pipeline unreachable status code 503 instead of 500 by snkas in https://github.com/feldera/feldera/pull/3206
* [SQL] Types like VARCHAR cannot have waterlines by mihaibudiu in https://github.com/feldera/feldera/pull/3208
* examples: cleanup pre-packaged demos by lalithsuresh in https://github.com/feldera/feldera/pull/3178
* [SQL] Point to the right column name on foreign key validation failure by mihaibudiu in https://github.com/feldera/feldera/pull/3224
* py: INTERVAL type arithmetic tests by rivudhk in https://github.com/feldera/feldera/pull/3225
* Make sure there is always a tokio runtime for http input. by gz in https://github.com/feldera/feldera/pull/3221
* Multiple UI bugfixes and improvements by Karakatiza666 in https://github.com/feldera/feldera/pull/3223
* release: bump project version to 0.33.0 by gz in https://github.com/feldera/feldera/pull/3227


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.32.0...v0.33.0