Feldera

What's Changed
* Add information about source code position to table properties. by mihaibudiu in https://github.com/feldera/feldera/pull/2191
* [SQL] Optimize programs based on foreign-key joins by mihaibudiu in https://github.com/feldera/feldera/pull/2205
* Point to tutorial instead of demo by ryzhyk in https://github.com/feldera/feldera/pull/2209
* Update stale text in the tutorial. by ryzhyk in https://github.com/feldera/feldera/pull/2210
* docker: point compose file to Feldera version 0.23.0 by lalithsuresh in https://github.com/feldera/feldera/pull/2203
* bench: update tiktok benchmark by abhizer in https://github.com/feldera/feldera/pull/2141
* dbsp: Reduce memory use for merges with output smaller than the inputs. by blp in https://github.com/feldera/feldera/pull/2156
* Benchmark by blp in https://github.com/feldera/feldera/pull/2206
* Benchmark by blp in https://github.com/feldera/feldera/pull/2211
* Update the Hopsworks demo for the new API. by ryzhyk in https://github.com/feldera/feldera/pull/2202
* Temporarily disable nexmark Q15 by aehmttw in https://github.com/feldera/feldera/pull/2213
* benchmark: Make output from Feldera SQL runs appear without buffering. by blp in https://github.com/feldera/feldera/pull/2215
* [SQL] waterlines need a delay by mihaibudiu in https://github.com/feldera/feldera/pull/2217
* Increase timeouts in S3 tests by ryzhyk in https://github.com/feldera/feldera/pull/2223
* [SQL] Support functions DATE_TRUNC, TIME_TRUNC, TIMESTAMP_TRUNC by mihaibudiu in https://github.com/feldera/feldera/pull/2227
* [SQL] Nexmark: format_date cannot be gc-ed, use just DATE by mihaibudiu in https://github.com/feldera/feldera/pull/2233
* Datagen bug-fixes by gz in https://github.com/feldera/feldera/pull/2231
* [SQL] Improve key analysis for equijoins by mihaibudiu in https://github.com/feldera/feldera/pull/2232
* [SQL] Specify and enforce the type of elements in arrays, values in m… by mihaibudiu in https://github.com/feldera/feldera/pull/2218
* Improve UX of SQL and Rust compilation status by Karakatiza666 in https://github.com/feldera/feldera/pull/2221
* Fix default change stream behavior not following list end by Karakatiza666 in https://github.com/feldera/feldera/pull/2238
* [DBSP]: Change radix value for radix trees to 2. by ryzhyk in https://github.com/feldera/feldera/pull/2225
* Multiple WebConsole fixes by Karakatiza666 in https://github.com/feldera/feldera/pull/2239
* Minor improvements to profiles by blp in https://github.com/feldera/feldera/pull/2241
* Disable q16 by aehmttw in https://github.com/feldera/feldera/pull/2245
* [SQL] Restrict tumbling window to 'short' SQL intervals by mihaibudiu in https://github.com/feldera/feldera/pull/2247
* [SQL] For the first step use the minimum possible waterline everywhere by mihaibudiu in https://github.com/feldera/feldera/pull/2246
* [SQL] Infer monotonicity from comparisons of the shape `col + constant >= expression` by mihaibudiu in https://github.com/feldera/feldera/pull/2248
* pipeline-manager: less verbose logging at lower level by snkas in https://github.com/feldera/feldera/pull/2252
* Enable creating pipeline with from a preset demo or a custom program via link by Karakatiza666 in https://github.com/feldera/feldera/pull/2255
* Add Nexmark connector by blp in https://github.com/feldera/feldera/pull/2226
* build(deps): bump openssl from 0.10.64 to 0.10.66 by dependabot in https://github.com/feldera/feldera/pull/2079
* dockerfile: copy nexmark crate for compiler by snkas in https://github.com/feldera/feldera/pull/2263
* pipeline-manager: info log level for feldera crates and warn for others by snkas in https://github.com/feldera/feldera/pull/2262
* [adapters] Speed up pausing/unpausing Kafka. by ryzhyk in https://github.com/feldera/feldera/pull/2260
* benchmark: Fix bug in feldera-sql runner for non-Nexmark benchmarks. by blp in https://github.com/feldera/feldera/pull/2264
* Script to build compiler with released/unreleased Calcite by mihaibudiu in https://github.com/feldera/feldera/pull/2265
* [SQL] Give warnings about the 'materialized' property for views by mihaibudiu in https://github.com/feldera/feldera/pull/2256
* benchmark: Make tiktok generation script use default `MAX_EVENTS`. by blp in https://github.com/feldera/feldera/pull/2267
* Add option to collect circuit profile in benchmark by aehmttw in https://github.com/feldera/feldera/pull/2224
* [SQL] Support for ASOF join by mihaibudiu in https://github.com/feldera/feldera/pull/2214
* Fix monitoring command. by gz in https://github.com/feldera/feldera/pull/2259
* [SQL] Add table functions to the SQL TOC by mihaibudiu in https://github.com/feldera/feldera/pull/2269
* scripts: Pass --events to Feldera SQL benchmark. by blp in https://github.com/feldera/feldera/pull/2270
* docker: install git so sql-compiler's build.sh runs by lalithsuresh in https://github.com/feldera/feldera/pull/2272
* release: bump project version to 0.24.0 by gz in https://github.com/feldera/feldera/pull/2273


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.23.0...v0.24.0

We've majorly simplified the REST API to only have `Pipelines` as entities. We've also massively simplified the Web Console around that concept (https://github.com/feldera/feldera/pull/2071). This makes it so that a pipeline is described with a single SQL file that embeds both the program and the connectors. Please check out any of the available examples in the demos/ folder to see how to use the new API.

What's Changed
* docker: point compose file to Feldera version 0.22.0 by gz in https://github.com/feldera/feldera/pull/2139
* Fast(er) datagen by gz in https://github.com/feldera/feldera/pull/2140
* Enable CPU profiler by default. by ryzhyk in https://github.com/feldera/feldera/pull/2137
* Simplify datagen config by gz in https://github.com/feldera/feldera/pull/2148
* py: allow specifying update format in SQLContext.input_json by abhizer in https://github.com/feldera/feldera/pull/2144
* [SQL] Enable 3 more Nexmark queries using SQL user-defined functions by mihaibudiu in https://github.com/feldera/feldera/pull/2152
* Update README.md by lalithsuresh in https://github.com/feldera/feldera/pull/2150
* Update README.md by lalithsuresh in https://github.com/feldera/feldera/pull/2157
* Fix CI error with bench-publish by aehmttw in https://github.com/feldera/feldera/pull/2159
* Update README.md by lalithsuresh in https://github.com/feldera/feldera/pull/2160
* Rework API by snkas in https://github.com/feldera/feldera/pull/2071
* Add basic implementation of visualization of change streams by Karakatiza666 in https://github.com/feldera/feldera/pull/2166
* papers: migrate papers/ folder to feldera/papers repo by lalithsuresh in https://github.com/feldera/feldera/pull/2167
* repo: cleanup top-level folder by lalithsuresh in https://github.com/feldera/feldera/pull/2170
* Reworked debezium postgres demo by ryzhyk in https://github.com/feldera/feldera/pull/2168
* Add instructions to the Postgres Debezium demo. by ryzhyk in https://github.com/feldera/feldera/pull/2172
* build: bring back Earthly caching by lalithsuresh in https://github.com/feldera/feldera/pull/2173
* demo: Update Hopsworks demo for the new API. by ryzhyk in https://github.com/feldera/feldera/pull/2175
* docs: Update tutorial text for WebConsole changes. by ryzhyk in https://github.com/feldera/feldera/pull/2171
* WebConsole: fix eggress query doesn't work with auth disabled by Karakatiza666 in https://github.com/feldera/feldera/pull/2176
* docker: use mold linker for compiler-server by lalithsuresh in https://github.com/feldera/feldera/pull/2180
* docker: fix mold download link by lalithsuresh in https://github.com/feldera/feldera/pull/2181
* web-console: do a pass over wording and status box by lalithsuresh in https://github.com/feldera/feldera/pull/2182
* Improve change stream UI by Karakatiza666 in https://github.com/feldera/feldera/pull/2178
* Pull demos from API on home page reload by Karakatiza666 in https://github.com/feldera/feldera/pull/2183
* Improve demos layout by Karakatiza666 in https://github.com/feldera/feldera/pull/2184
* pipeline-manager: demo title and list sorted by file path by snkas in https://github.com/feldera/feldera/pull/2185
* Added memory tracking for Flink by aehmttw in https://github.com/feldera/feldera/pull/2126
* dbsp_nexmark: Exit without hanging if a DBSP thread panics. by blp in https://github.com/feldera/feldera/pull/2130
* web-console: simplify the examples page by lalithsuresh in https://github.com/feldera/feldera/pull/2192
* Improve program status behavior by Karakatiza666 in https://github.com/feldera/feldera/pull/2194
* Fix login with Google after logout by Karakatiza666 in https://github.com/feldera/feldera/pull/2195
* py: refactor python api to use PipelineBuilder by abhizer in https://github.com/feldera/feldera/pull/2177
* Revert "build: bring back Earthly caching" by lalithsuresh in https://github.com/feldera/feldera/pull/2196
* Fix profile picture not displayed by Karakatiza666 in https://github.com/feldera/feldera/pull/2197
* Add null check by Karakatiza666 in https://github.com/feldera/feldera/pull/2199
* benchmark: Convert SQL benchmarks for Nexmark and Tiktok to new API. by blp in https://github.com/feldera/feldera/pull/2198
* release: bump project version to 0.23.0 by lalithsuresh in https://github.com/feldera/feldera/pull/2200


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.22.0...v0.23.0

What's Changed

* Fix aggregating metrics when multiple connectors per relation by Karakatiza666 in https://github.com/feldera/feldera/pull/2089
* py: add SQLContext.input_json() to send json data by abhizer in https://github.com/feldera/feldera/pull/2088
* [SQL] validate table properties syntax by mihaibudiu in https://github.com/feldera/feldera/pull/2091
* demo: new faster data generator for Hopsworks Tiktok RecSys by abhizer in https://github.com/feldera/feldera/pull/2085
* [SQL] Fix bugs related to SQL UDFs by mihaibudiu in https://github.com/feldera/feldera/pull/2099
* [README] fix broken documentation links by kshuta in https://github.com/feldera/feldera/pull/2109
* Adds a new datagen input adapter for tables. by gz in https://github.com/feldera/feldera/pull/2107
* docs: fix getting started link in README by lalithsuresh in https://github.com/feldera/feldera/pull/2114
* [SQL] FOREIGN KEY validation and metadata construction by mihaibudiu in https://github.com/feldera/feldera/pull/2108
* Connector orchestration by ryzhyk in https://github.com/feldera/feldera/pull/2113
* Debezium Postgres demo. by ryzhyk in https://github.com/feldera/feldera/pull/2116
* [SQL] Document and test TIMESTAMPADD function; improve Calcite optimizer structure by mihaibudiu in https://github.com/feldera/feldera/pull/2118
* Test aggregates by rivudhk in https://github.com/feldera/feldera/pull/2103
* Optimize asynchronous merger by blp in https://github.com/feldera/feldera/pull/2115
* Revert "Test aggregates (2103)" by rivudhk in https://github.com/feldera/feldera/pull/2123
* dbsp: Don't reserve excess capacity for vector merge results. by blp in https://github.com/feldera/feldera/pull/2127
* Merger revert by blp in https://github.com/feldera/feldera/pull/2135
* release: bump project version to 0.22.0 by gz in https://github.com/feldera/feldera/pull/2138

New Contributors
* kshuta made their first contribution in https://github.com/feldera/feldera/pull/2109
* rivudhk made their first contribution in https://github.com/feldera/feldera/pull/2103

**Full Changelog**: https://github.com/feldera/feldera/compare/v0.21.0...v0.22.0

What's Changed

* pipeline-manager: remove service probing by snkas in https://github.com/feldera/feldera/pull/2002
* Add tracing for dbsp steps and general docs for monitoring feldera by gz in https://github.com/feldera/feldera/pull/1999
* [SQL] Improved monotonicity analysis for filter operators by mihaibudiu in https://github.com/feldera/feldera/pull/2006
* DBSP: Asof-join operator. by ryzhyk in https://github.com/feldera/feldera/pull/1998
* Merge new WebConsole layout prototype by Karakatiza666 in https://github.com/feldera/feldera/pull/1994
* Automate Flink testing in CI by aehmttw in https://github.com/feldera/feldera/pull/2005
* dbsp: test using `window` to implement SQL `now`. by ryzhyk in https://github.com/feldera/feldera/pull/2015
* demo: Hopsworks Tiktok RecSys pipeline by abhizer in https://github.com/feldera/feldera/pull/1992
* [SQL] Fix bugs in implementations of LIMIT by mihaibudiu in https://github.com/feldera/feldera/pull/2020
* Add docs for the new WebConsole project by Karakatiza666 in https://github.com/feldera/feldera/pull/2021
* Disable sveltekit build by Karakatiza666 in https://github.com/feldera/feldera/pull/2024
* Re-enable and fix sveltekit build by Karakatiza666 in https://github.com/feldera/feldera/pull/2025
* Disable coloring in maven builds by mihaibudiu in https://github.com/feldera/feldera/pull/2026
* [SQL] Fix bug for primary key fields that need cloning by mihaibudiu in https://github.com/feldera/feldera/pull/2029
* Update README.md by gz in https://github.com/feldera/feldera/pull/2035
* [SQL] Preliminary implementation of the `now()` function by mihaibudiu in https://github.com/feldera/feldera/pull/2019
* WebConsole: Fix pipeline relation metrics not aggregated … by Karakatiza666 in https://github.com/feldera/feldera/pull/2036
* [SQL] Fix bugs in window bound computations for INTERVAL types by mihaibudiu in https://github.com/feldera/feldera/pull/2034
* [SQL] Fix handling of monotonicity for tables with primary keys by mihaibudiu in https://github.com/feldera/feldera/pull/2041
* Make sure dbsp and adapters metrics verison match. by gz in https://github.com/feldera/feldera/pull/2044
* Update grafana_dashboard.json with some storage metrics by gz in https://github.com/feldera/feldera/pull/2046
* [SQL] Correctly handle nullable types in ARG_MAX by mihaibudiu in https://github.com/feldera/feldera/pull/2047
* [SQL] Use waterline and not waterline_monotonic by mihaibudiu in https://github.com/feldera/feldera/pull/2048
* Fix bun build in deploy/Dockerfile by Karakatiza666 in https://github.com/feldera/feldera/pull/2050
* Generalize SQL benchmarks to make it easier to add more by aehmttw in https://github.com/feldera/feldera/pull/2013
* Reset min-storage-bytes to default by aehmttw in https://github.com/feldera/feldera/pull/2053
* [SQL] Have the compiler synthesize the 'NOW' table by mihaibudiu in https://github.com/feldera/feldera/pull/2049
* [SQL] Improved monotonicity analysis for joins followed by filters by mihaibudiu in https://github.com/feldera/feldera/pull/2014
* Make Flink run all queries by aehmttw in https://github.com/feldera/feldera/pull/2054
* TikTok demo: Fixes and refactoring. by ryzhyk in https://github.com/feldera/feldera/pull/2055
* dbsp_adapters: Wait a bit before disconnecting on pause in `url` adapter. by blp in https://github.com/feldera/feldera/pull/2057
* Improve profiling output to make storage performance easier to understand by blp in https://github.com/feldera/feldera/pull/2059
* nexmark: Use same `metrics` version as the rest of the crates. by blp in https://github.com/feldera/feldera/pull/2061
* dbsp: Name background threads so system tools can distinguish them. by blp in https://github.com/feldera/feldera/pull/2062
* Update program.sql by gz in https://github.com/feldera/feldera/pull/2064
* Fix port in documentation. by gz in https://github.com/feldera/feldera/pull/2065
* [SQL] Two optimizations by mihaibudiu in https://github.com/feldera/feldera/pull/2068
* Storage optimizations by blp in https://github.com/feldera/feldera/pull/2066
* Revert "WebConsole: Fix pipeline relation metrics not accumulated when there are multiple connectors per relation" by lalithsuresh in https://github.com/feldera/feldera/pull/2069
* Benchmark with 100M events by aehmttw in https://github.com/feldera/feldera/pull/2077
* Add metric for records dropped due to lateness by mihaibudiu in https://github.com/feldera/feldera/pull/2074
* Read input connector names from SQL by aehmttw in https://github.com/feldera/feldera/pull/2076


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.20.0...v0.21.0

What's Changed
* Post release v0.19.0 by gz in https://github.com/feldera/feldera/pull/1944
* Improve py docs by abhizer in https://github.com/feldera/feldera/pull/1942
* dbsp: Fix build of `galen` benchmark. by blp in https://github.com/feldera/feldera/pull/1928
* py: max_queue_records param to connect_source_kafka by ryzhyk in https://github.com/feldera/feldera/pull/1948
* Improved monotonicity analysis by mihaibudiu in https://github.com/feldera/feldera/pull/1949
* Switch binary download port from 9090 to 8085. by gz in https://github.com/feldera/feldera/pull/1951
* pipeline-manager: SQL MAP type by snkas in https://github.com/feldera/feldera/pull/1941
* benchmark: API key and Kafka option arguments by snkas in https://github.com/feldera/feldera/pull/1954
* [SQL] Do not sort collection after TOP K unless it is needed at the output by mihaibudiu in https://github.com/feldera/feldera/pull/1958
* Fix for numpy regression. by ryzhyk in https://github.com/feldera/feldera/pull/1961
* Update earthly version/install. by gz in https://github.com/feldera/feldera/pull/1960
* build(deps): bump scikit-learn from 1.2.1 to 1.5.0 in /demo/demo_notebooks by dependabot in https://github.com/feldera/feldera/pull/1888
* [SQL] Reorganize compilation stages and fix 3 bugs by mihaibudiu in https://github.com/feldera/feldera/pull/1966
* [SQL] support MATERIALIZED table and views by mihaibudiu in https://github.com/feldera/feldera/pull/1959
* [SQL] Improve monotonicity analysis by mihaibudiu in https://github.com/feldera/feldera/pull/1970
* Do not automatically distinct ouputs. by ryzhyk in https://github.com/feldera/feldera/pull/1972
* Switch from log to tracing. by gz in https://github.com/feldera/feldera/pull/1976
* [SQL] Improve monotonicity for aggregations by mihaibudiu in https://github.com/feldera/feldera/pull/1974
* ci: run python tests by abhizer in https://github.com/feldera/feldera/pull/1873
* Nexmark sql output by blp in https://github.com/feldera/feldera/pull/1979
* Minor profiling-related improvements by ryzhyk in https://github.com/feldera/feldera/pull/1971
* WebConsole: Drop all Data Services functionality by Karakatiza666 in https://github.com/feldera/feldera/pull/1978
* Post-fix for unsuccessful rebase in PR1971. by ryzhyk in https://github.com/feldera/feldera/pull/1981
* Expose dbsp metrics in pipeline metrics endpoint. by gz in https://github.com/feldera/feldera/pull/1969
* Fix docker command by aehmttw in https://github.com/feldera/feldera/pull/1984
* Use a single tokio runtime instead of `n`. by gz in https://github.com/feldera/feldera/pull/1983
* docs: feldera enterprise by snkas in https://github.com/feldera/feldera/pull/1991
* docs: remove deploy from sidebar and fix secret management links by snkas in https://github.com/feldera/feldera/pull/1993
* Improve Kafka input performance for small messages by blp in https://github.com/feldera/feldera/pull/1967
* docs: eks cluster storage class check by snkas in https://github.com/feldera/feldera/pull/1996
* dbsp: Change threshold for spilling to storage from rows to bytes. by blp in https://github.com/feldera/feldera/pull/1917
* Make profiles downloadable via API by blp in https://github.com/feldera/feldera/pull/1988
* benchmark: Make poller threads configurable for SQL benchmarks. by blp in https://github.com/feldera/feldera/pull/1997
* Enable playwright tests by Karakatiza666 in https://github.com/feldera/feldera/pull/1952
* Add script to run flink on CI by aehmttw in https://github.com/feldera/feldera/pull/1985
* [SQL] a few small optimizations: combine join/filter/map and map/mapindex by mihaibudiu in https://github.com/feldera/feldera/pull/1986
* Disable navigation from materialized to non-materialized view by Karakatiza666 in https://github.com/feldera/feldera/pull/2001
* release: bump project version to 0.20.0 by gz in https://github.com/feldera/feldera/pull/2007


**Full Changelog**: https://github.com/feldera/feldera/compare/v0.19.0...v0.20.0

New Contributors

* aehmttw made their first contribution in https://github.com/feldera/feldera/pull/1857

**Full Changelog**: https://github.com/feldera/feldera/compare/v0.18.0...v0.19.0