Starrocks

New Features

- Supports using the Instance Profile and Assumed Role-based credential methods to access AWS S3 and AWS Glue. [15958](https://github.com/StarRocks/starrocks/pull/15958)
- Supports the following bit functions: bit_shift_left, bit_shift_right, and bit_shift_right_logical. [14151](https://github.com/StarRocks/starrocks/pull/14151)

Bug Fixes

The following bugs are fixed:

- Apache Hive external tables that contain MAP and ARRAY data cannot be refreshed. [17548](https://github.com/StarRocks/starrocks/pull/17548)
- Superset cannot identify column types of materialized views. [17686](https://github.com/StarRocks/starrocks/pull/17686)
- BI connectivity fails because SET GLOBAL/SESSION TRANSACTION cannot be parsed. [17295](https://github.com/StarRocks/starrocks/pull/17295)
- The bucket number of dynamic partitioned tables in a Colocate Group cannot be modified and an error message is returned. [17418](https://github.com/StarRocks/starrocks/pull/17418/)

Behavior Change
- Added CHARACTER to the reserved keyword list. [17488](https://github.com/StarRocks/starrocks/pull/17488)

Improvements
- Multi-table materialized views created based on external catalogs support query rewrite. [11116](https://github.com/StarRocks/starrocks/issues/11116)[ #15791](https://github.com/StarRocks/starrocks/issues/15791)
- Allows users to specify a collection period for automatic CBO statistics collection, which prevents cluster performance jitter caused by automatic full collection. [14996](https://github.com/StarRocks/starrocks/pull/14996)
- Added Thrift server queue. Requests that cannot be processed immediately during INSERT INTO SELECT can be pending in the Thrift server queue, preventing requests from being rejected. [14571](https://github.com/StarRocks/starrocks/pull/14571)
- Deprecated the FE parameter default_storage_medium. If storage_medium is not explicitly specified when users create a table, the system automatically infers the storage medium of the table based on BE disk type. [14394](https://github.com/StarRocks/starrocks/pull/14394)

Bug Fixes
The following bugs are fixed:
- Null pointer exception (NPE) caused by SET PASSWORD. [15247](https://github.com/StarRocks/starrocks/pull/15247)
- JSON data with empty keys cannot be parsed. [16852](https://github.com/StarRocks/starrocks/pull/16852)
- Data of invalid types can be successfully converted into ARRAY data. [16866](https://github.com/StarRocks/starrocks/pull/16866)
- Nested Loop Join cannot be interrupted when an exception occurs. [16875](https://github.com/StarRocks/starrocks/pull/16875)

Behavior Change
- Deprecated the FE parameter default_storage_medium. The storage medium of a table is automatically inferred by the system. [14394](https://github.com/StarRocks/starrocks/pull/14394)

New Features
- Supports querying Merge On Read tables using [Hudi catalogs](https://docs.starrocks.io/en-us/2.5/data_source/catalog/hudi_catalog) and [Hudi external tables](https://docs.starrocks.io/en-us/2.5/data_source/External_table#hudi-external-table). [6780](https://github.com/StarRocks/starrocks/pull/6780)
- Supports querying STRUCT and MAP data using [Hive catalogs](https://docs.starrocks.io/en-us/2.5/data_source/catalog/hive_catalog), Hudi catalogs, and [Iceberg catalogs](https://docs.starrocks.io/en-us/2.5/data_source/catalog/iceberg_catalog). [#10677](https://github.com/StarRocks/starrocks/issues/10677)
- Provides [Block Cache](https://docs.starrocks.io/en-us/2.5/data_source/Block_cache) to improve access performance of hot data stored in external storage systems, such as HDFS. [#11597](https://github.com/StarRocks/starrocks/pull/11579)
- Supports creating [Delta Lake catalogs](https://docs.starrocks.io/en-us/2.5/data_source/catalog/deltalake_catalog), which allow direct queries on data from Delta Lake. [#11972](https://github.com/StarRocks/starrocks/issues/11972)
- Hive, Hudi, and Iceberg catalogs are compatible with AWS Glue. [12249](https://github.com/StarRocks/starrocks/issues/12249)
- Supports creating [file external tables](https://docs.starrocks.io/en-us/2.5/data_source/file_external_table), which allow direct queries on - Parquet and ORC files from HDFS and object stores. [#13064](https://github.com/StarRocks/starrocks/pull/13064)
- Supports creating materialized views based on Hive, Hudi, Iceberg catalogs, and materialized views. For more information, see [Materialized view](https://docs.starrocks.io/en-us/2.5/using_starrocks/Materialized_view). [#11116](https://github.com/StarRocks/starrocks/issues/11116) [#11873](https://github.com/StarRocks/starrocks/pull/11873)
- Supports conditional updates for tables that use the Primary Key model. For more information, see [Change data through loading](https://docs.starrocks.io/en-us/2.5/loading/Load_to_Primary_Key_tables). [#12159](https://github.com/StarRocks/starrocks/pull/12159)
- Supports [Query Cache](https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache), which stores intermediate computation results of queries, improving the QPS and reduces the average latency of highly-concurrent, simple queries. [#9194](https://github.com/StarRocks/starrocks/pull/9194)
- Supports specifying the priority of Broker Load jobs. For more information, see [BROKER LOAD](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-statements/data-manipulation/BROKER%20LOAD) [#11029](https://github.com/StarRocks/starrocks/pull/11029)
- Supports specifying the number of replicas for data loading for StarRocks native tables. For more information, see [CREATE TABLE](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-statements/data-definition/CREATE%20TABLE). [#11253](https://github.com/StarRocks/starrocks/pull/11253)
- Supports [query queues](https://docs.starrocks.io/en-us/2.5/administration/query_queues). [#12594](https://github.com/StarRocks/starrocks/pull/12594)
- Supports isolating compute resources occupied by data loading, thereby limiting the resource consumption of data loading tasks. For more information, see [Resource group](https://docs.starrocks.io/en-us/2.5/administration/resource_group). [#12606](https://github.com/StarRocks/starrocks/pull/12606)
- Supports specifying the following data compression algorithms for StarRocks native tables: LZ4, Zstd, Snappy, and Zlib. For more information, see [Data compression](https://docs.starrocks.io/en-us/2.5/table_design/data_compression). [#10097](https://github.com/StarRocks/starrocks/pull/10097) [#12020](https://github.com/StarRocks/starrocks/pull/12020)
- Supports [user-defined variables](https://docs.starrocks.io/en-us/2.5/reference/user_defined_variables). [#10011](https://github.com/StarRocks/starrocks/pull/10011)
- Supports [lambda expression](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/Lambda_expression) and the following higher-order functions: [array_map](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/array_map), [array_filter](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/array_filter), [array_sum](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/array_sum), and [array_sortby](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/array_sortby). [#9461](https://github.com/StarRocks/starrocks/pull/9461) [#9806](https://github.com/StarRocks/starrocks/pull/9806) [#10323](https://github.com/StarRocks/starrocks/pull/10323) [#14034](https://github.com/StarRocks/starrocks/pull/14034)
- Provides the QUALIFY clause that filters the results of [window functions](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/Window_function). [#13239](https://github.com/StarRocks/starrocks/pull/13239)
- Supports using the result returned by the uuid() and uuid_numeric() functions as the default value of a column when you create a table. For more information, see [CREATE TABLE](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-statements/data-definition/CREATE%20TABLE). [#11155](https://github.com/StarRocks/starrocks/pull/11155)
- Supports the following functions: [map_size](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/map-functions/map_size), [map_keys](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/map-functions/map_keys), [map_values](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/map-functions/map_values), [max_by](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/aggregate-functions/max_by), [sub_bitmap](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/bitmap-functions/sub_bitmap), [bitmap_to_base64](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/bitmap-functions/bitmap_to_base64), [host_name](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/utility-functions/host_name), and [date_slice](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/date-time-functions/date_slice). [#11299](https://github.com/StarRocks/starrocks/pull/11299) [#11323](https://github.com/StarRocks/starrocks/pull/11323) [#12243](https://github.com/StarRocks/starrocks/pull/12243) [#11776](https://github.com/StarRocks/starrocks/pull/11776) [#12634](https://github.com/StarRocks/starrocks/pull/12634) [#14225](https://github.com/StarRocks/starrocks/pull/14225)

Improvements
- Optimized the metadata access performance when you query external data using [Hive catalogs](https://docs.starrocks.io/en-us/2.5/data_source/catalog/hive_catalog), [Hudi catalogs](https://docs.starrocks.io/en-us/2.5/data_source/catalog/hudi_catalog), and [Iceberg catalogs](https://docs.starrocks.io/en-us/2.5/data_source/catalog/iceberg_catalog). [#11349](https://github.com/StarRocks/starrocks/issues/11349)
- Supports querying ARRAY data using [Elasticsearch external tables](https://docs.starrocks.io/en-us/2.5/data_source/External_table#elasticsearch-external-table). [9693](https://github.com/StarRocks/starrocks/pull/9693)
- Optimized the following aspects of materialized views:
- Multi-table async refresh materialized views support automatic and transparent query rewrite based on the SPJG-type materialized views. For more information, see [Materialized view](https://docs.starrocks.io/en-us/2.5/using_starrocks/Materialized_view#about-async-refresh-mechanisms-for-materialized-views). [13193](https://github.com/StarRocks/starrocks/issues/13193)
- Multi-table async refresh materialized views support multiple async refresh mechanisms. For more information, see [Materialized view](https://docs.starrocks.io/en-us/2.5/using_starrocks/Materialized_view#enable-query-rewrite-based-on-async-materialized-views). [12712](https://github.com/StarRocks/starrocks/pull/12712) [#13171](https://github.com/StarRocks/starrocks/pull/13171) [#13229](https://github.com/StarRocks/starrocks/pull/13229) [#12926](https://github.com/StarRocks/starrocks/pull/12926)
- The efficiency of refreshing materialized views is improved. [13167](https://github.com/StarRocks/starrocks/issues/13167)
- StarRocks automatically sets an appropriate number of tablets when you create a table, eliminating the need for manual operations. For more information, see [CREATE TABLE](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-statements/data-definition/CREATE%20TABLE). [#10614](https://github.com/StarRocks/starrocks/pull/10614)
- Optimized the following aspects of data loading:
- Optimized loading performance in multi-replica scenarios and supported single_leader_replication, which gains a one-fold increase. For more information about single_leader_replication, see [CREATE TABLE](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-statements/data-definition/CREATE%20TABLE). [#10138](https://github.com/StarRocks/starrocks/pull/10138)
- Broker Load and Spark Load no longer need to depend on brokers for data loading when only one HDFS system or Kerberos is configured. For more information, see [Load data from HDFS or cloud storage](https://docs.starrocks.io/en-us/2.5/loading/BrokerLoad) and [Bulk load using Apache Spark™](https://docs.starrocks.io/en-us/2.5/loading/SparkLoad). [#9049](https://github.com/starrocks/starrocks/pull/9049) [#9228](https://github.com/StarRocks/starrocks/pull/9228)
- Optimized the performance of Broker Load when a large number of small ORC files are loaded. [11380](https://github.com/StarRocks/starrocks/pull/11380)
Reduced the memory usage when you load data into tables of the Primary Key Model.
- Optimized the information_schema database and the tables and columns tables within. Adds a new table table_config. For more information, see [Information Schema](https://docs.starrocks.io/en-us/2.5/administration/information_schema). [#10033](https://github.com/StarRocks/starrocks/pull/10033)
Optimized data backup and restore:
- Supports backing up and restoring data from multiple tables in a database at a time. For more information, see [Backup and restore data](https://docs.starrocks.io/en-us/2.5/administration/Backup_and_restore). [#11619](https://github.com/StarRocks/starrocks/issues/11619)
Supports backing up and restoring data from Primary Key tables. For more information, see Backup and restore. [11885](https://github.com/StarRocks/starrocks/pull/11885)
Optimized the following functions:
- Added an optional parameter for the [time_slice](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/date-time-functions/time_slice) function, which is used to determine whether the beginning or end of the time interval is returned. [#11216](https://github.com/StarRocks/starrocks/pull/11216)
- Added a new mode INCREASE for the [window_funnel](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/aggregate-functions/window_funnel) function to avoid computing duplicate timestamps. [#10134](https://github.com/StarRocks/starrocks/pull/10134)
- Supports specifying multiple arguments in the [unnest](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/unnest) function. [#12484](https://github.com/StarRocks/starrocks/pull/12484)
lead() and lag() functions support querying HLL and BITMAP data. For more information, see [Window function](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/Window_function). [#12108](https://github.com/StarRocks/starrocks/pull/12108)
- The following ARRAY functions support querying JSON data: [array_agg](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/array_agg), [array_sort](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/array_sort), [array_concat](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/array_concat), [array_slice](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/array_slice), and [reverse](https://docs.starrocks.io/en-us/2.5/sql-reference/sql-functions/array-functions/reverse). [#13155](https://github.com/StarRocks/starrocks/pull/13155)
- Optimized the use of some functions. The current_date, current_timestamp, current_time, localtimestamp, and localtime functions can be executed without using (), for example, you can directly run select current_date;. [ 14319](https://github.com/StarRocks/starrocks/pull/14319)
Removed some redundant information from FE logs. [ 15374](https://github.com/StarRocks/starrocks/pull/15374)

Bug Fixes
The following bugs are fixed:

- The append_trailing_char_if_absent() function may return an incorrect result when the first argument is empty. [13762](https://github.com/StarRocks/starrocks/pull/13762)
- After a table is restored using the RECOVER statement, the table does not exist. [13921](https://github.com/StarRocks/starrocks/pull/13921)
- The result returned by the SHOW CREATE MATERIALIZED VIEW statement does not contain the database and catalog specified in the query statement when the materialized view was created. [12833](https://github.com/StarRocks/starrocks/pull/12833)
- Schema change jobs in the waiting_stable state cannot be canceled. [12530](https://github.com/StarRocks/starrocks/pull/12530)
- Running the SHOW PROC '/statistic'; command on a Leader FE and non-Leader FE returns different results. [12491](https://github.com/StarRocks/starrocks/issues/12491)
- The position of the ORDER BY clause is incorrect in the result returned by SHOW CREATE TABLE. [ 13809](https://github.com/StarRocks/starrocks/pull/13809)
- When users use Hive Catalog to query Hive data, if the execution plan generated by FE does not contain partition IDs, BEs fail to query Hive partition data. [ 15486](https://github.com/StarRocks/starrocks/pull/15486).

Behavior Change
- Changed the default value of the AWS_EC2_METADATA_DISABLED parameter to False, which means that the metadata of Amazon EC2 is obtained to access AWS resources.
- Renamed session variable is_report_success to enable_profile, which can be queried using the SHOW VARIABLES statement.
- Added four reserved keywords: CURRENT_DATE, CURRENT_TIME, LOCALTIME, and LOCALTIMESTAMP. [ 14319](https://github.com/StarRocks/starrocks/pull/14319)
- The maximum length of table and database names can be up to 1023 characters. [ 14929](https://github.com/StarRocks/starrocks/pull/14929) [# 15020](https://github.com/StarRocks/starrocks/pull/15020)

Upgrade Notes
- You can upgrade your cluster to 2.5.0 from 2.0.x, 2.1.x, 2.2.x, 2.3.x, or 2.4.x. However, if you need to perform a rollback, we recommend that you roll back only to 2.4.x.
- If you have a partitioned table that uses LIST partitioning, you must delete this table before the upgrade.

Improvements

- Forbade the List Partition syntax because it may cause errors in upgrading metadata. [15401](https://github.com/StarRocks/starrocks/pull/15401)
- Supports BITMAP, HLL, and PERCENTILE types for materialized views. [15731](https://github.com/StarRocks/starrocks/pull/15731)
- Optimized the inference of `storage_medium`. When BEs use both SSD and HDD as storage devices, if the property `storage_cooldown_time` is specified, StarRocks sets `storage_medium` to `SSD`. Otherwise, StarRocks sets `storage_medium` to `HDD`. [18649](https://github.com/StarRocks/starrocks/pull/18649)
- Optimized the accuracy of thread dump. [16748](https://github.com/StarRocks/starrocks/pull/16748)
- Optimized load efficiency by triggering metadata compaction before loading. [19347](https://github.com/StarRocks/starrocks/pull/19347)
- Optimized the Stream Load planner timeout. [18992](https://github.com/StarRocks/starrocks/pull/18992/files)
- Optimized the Unique key table performance by forbidding the collection of statistics from value columns. [19563](https://github.com/StarRocks/starrocks/pull/19563)

Bug Fixes

The following bugs are fixed:

- NPE is returned when an unsupported data type is used in CREATE TABLE. [ 20999](https://github.com/StarRocks/starrocks/issues/20999)
- Wrong results are returned to queries using Broadcast Join with the short-circuit. [20952](https://github.com/StarRocks/starrocks/issues/20952)
- The disk occupation problem caused by the wrong data truncate logic. [20590](https://github.com/StarRocks/starrocks/pull/20590)
- The AuditLoader plugin can neither be installed nor deleted. [20468](https://github.com/StarRocks/starrocks/issues/20468)
- If an exception is thrown when a tablet is being scheduled, other tablets in the same batch will never be scheduled. [20681](https://github.com/StarRocks/starrocks/pull/20681)
- Unknown Error is returned when an unsupported SQL function is used in the creation of a synchronous materialized view. [20348](https://github.com/StarRocks/starrocks/issues/20348)
- Multiple COUNT DISTINCT calculations are incorrectly rewritten. [19714](https://github.com/StarRocks/starrocks/pull/19714)
- Wrong results are returned to queries on the tablet that is in compaction. [20084](https://github.com/StarRocks/starrocks/issues/20084)
- Wrong results are returned to queries with aggregation. [19725](https://github.com/StarRocks/starrocks/issues/19725)
- No error message is returned when loading NULL parquet data into NOT NULL columns. [19885](https://github.com/StarRocks/starrocks/pull/19885)
- The query concurrency metric decreases slowly when the concurrency limit of a resource group is continuously reached. [19363](https://github.com/StarRocks/starrocks/pull/19363)
- FE fails to start when replaying the `InsertOverwriteJob` state change log. [19061](https://github.com/StarRocks/starrocks/issues/19061)
- The Primary Key table deadlock. [18488](https://github.com/StarRocks/starrocks/pull/18488)
- For Colocation tables, the replica status can be manually specified as `bad` by using statements like `ADMIN SET REPLICA STATUS PROPERTIES ("tablet_id" = "10003", "backend_id" = "10001", "status" = "bad");`. If the number of BEs is less than or equal to the number of replicas, the corrupted replica cannot be repaired. [17876](https://github.com/StarRocks/starrocks/issues/17876)
- Issues caused by ARRAY-related functions. [18556](https://github.com/StarRocks/starrocks/pull/18556)

Improvements
- Supports fast cancellation of load. [15514](https://github.com/StarRocks/starrocks/pull/15514) [#15398](https://github.com/StarRocks/starrocks/pull/15398) [#15969](https://github.com/StarRocks/starrocks/pull/15969)
- Optimized the CPU usage of the compaction framework. [11747](https://github.com/StarRocks/starrocks/pull/11747)
- Supports cumulative compaction on the tablet with missing versions. [17030](https://github.com/StarRocks/starrocks/pull/17030)
Bug Fixes
The following bugs are fixed:
- Excessive dynamic partitions are created when an illegal DATE value is specified. [17966](https://github.com/StarRocks/starrocks/pull/17966)
- Failure to connect to ES external table with the default HTTPS port URL. [13726](https://github.com/StarRocks/starrocks/pull/13726)
- BE failed to cancel a Stream Load transaction after the transaction is timeout. [15738](https://github.com/StarRocks/starrocks/pull/15738)
- Wrong query results are returned from a local shuffle aggregation on a single BE. [17845](https://github.com/StarRocks/starrocks/pull/17845)
- Queries may fail with the error message "wait_for_version version: failed: apply stopped". [17848](https://github.com/StarRocks/starrocks/pull/17850)
- Wrong query results are returned because OLAP scan bucket expressions are not cleared correctly. [17666](https://github.com/StarRocks/starrocks/pull/17666)
- The bucket number of dynamic partitioned tables in a Colocate Group cannot be modified and an error message is returned. [17418](https://github.com/StarRocks/starrocks/pull/17418)
- When you connect to a non-Leader FE node and send the SQL statement `USE <catalog_name>.<database_name>`, the non-Leader FE node forwards the SQL statement, with `<catalog_name>` excluded, to the Leader FE node. As a result, the Leader FE node chooses to use the `default_catalog` and eventually fails to find the specified database. [17302](https://github.com/StarRocks/starrocks/pull/17302)
- Incorrect logic for the dictmapping check before rewriting. [17405](https://github.com/StarRocks/starrocks/pull/17405)
- If an FE sends an occasional heartbeat to a BE, and the heartbeat connection times out, the FE considers the BE unavailable, leading to transaction failures on the BE. [16386](https://github.com/StarRocks/starrocks/pull/16386)
- `get_applied_rowsets` failed for queries on newly cloned tablets on a FE follower. [17192](https://github.com/StarRocks/starrocks/pull/17192)
- NPE caused by executing `SET variable = default` on a follower FE. [17549](https://github.com/StarRocks/starrocks/pull/17549)
- Expressions in projection are not rewritten by the dictionary. [17558](https://github.com/StarRocks/starrocks/pull/17558)
- Incorrect logic for creating dynamic partitions on weekly basis.[17163](https://github.com/StarRocks/starrocks/pull/17163)
- Wrong query results are returned from a local shuffle. [17130](https://github.com/StarRocks/starrocks/pull/17130)
- Incremental clones may fail. [16930](https://github.com/StarRocks/starrocks/pull/16930)
- In some cases, CBO may use incorrect logic to compare whether two operators are equivalent. [17199](https://github.com/StarRocks/starrocks/pull/17199) [#17227](https://github.com/StarRocks/starrocks/pull/17227)
- Failed to access JuiceFS because the JuiceFS schema is not checked and resolved properly. [16940](https://github.com/StarRocks/starrocks/pull/16940)

test-allin1

Behavior Change
- Default value of backlog of thrift listen is changed to 1024. [13911](https://github.com/StarRocks/starrocks/pull/13911)
- Added FORBID_INVALID_DATES SQL mode, off by default. If turned on, the input of the date data type will be verified, and an error will be raised when the date is an illegal time. [14143](https://github.com/StarRocks/starrocks/pull/14143)
Bug fixes
- Fix an issue where broker kerberos ticket would timeout when there are broker load jobs continuously running.[16149](https://github.com/StarRocks/starrocks/pull/16149)
- Fixed a bug that would cause stream load to fail. [16241](https://github.com/StarRocks/starrocks/pull/16241)
- Fixed a bug where brpc send would crash when too much memory is used. [16046](https://github.com/StarRocks/starrocks/issues/16046)
- Fixed a bug where data cannot be imported from a lower version of StarRocks using an StarRocks external table. [16130](https://github.com/StarRocks/starrocks/pull/16130)
- Fixed a bug that would cause a memory leak when materialized view refresh fails. [16041](https://github.com/StarRocks/starrocks/pull/16041)
- Fixed issue of getting stuck in publish phase when schema change occurs. [14148](https://github.com/StarRocks/starrocks/issues/14148)
- Fixed a materialized view memory leak in QeProcessorImpl. [15699](https://github.com/StarRocks/starrocks/pull/15699)
- Fixed a bug in LimitPruneTabletsRule that caused limit to cause inconsistent query results. [13574](https://github.com/StarRocks/starrocks/pull/13574)
- Fixed a bug where memory leak occurs when insert is used for data ingestion. [14718](https://github.com/StarRocks/starrocks/pull/14718)
- Primary key table will not perform tablet migration now. [13720](https://github.com/StarRocks/starrocks/pull/13720)
- Fixed the problem that the column nullable information was incorrectly converted during the process of generating view from the table. [15744](https://github.com/StarRocks/starrocks/pull/15744)
Improvements
- Check whether the database and table exist to prevent NPE during analyze table. [14467](https://github.com/StarRocks/starrocks/pull/14467)
- When querying external tables, if the data type of the column is not supported, the column will not be materialized. [13305](https://github.com/StarRocks/starrocks/pull/13305)
- The start_fe start script adds Java version checking. [14333](https://github.com/StarRocks/starrocks/pull/14333)