hopsworks Changelog

2.11.0

[HWORKS-373](https://hopsworks.atlassian.net/browse/HWORKS-373) Bump ray\[serve\] dependency in kserve package

[HWORKS-400](https://hopsworks.atlassian.net/browse/HWORKS-400) Upgrade Jupyter\(Lab\) to address CVE-2021-32797

[HWORKS-430](https://hopsworks.atlassian.net/browse/HWORKS-430) OnlineFS CVEs

Task

[HWORKS-126](https://hopsworks.atlassian.net/browse/HWORKS-126) Add idempotent methods for creating deployments

[HWORKS-219](https://hopsworks.atlassian.net/browse/HWORKS-219) Fix Proxy Servlet to use consul instead of localhost

[HWORKS-220](https://hopsworks.atlassian.net/browse/HWORKS-220) Fix zip/unzip for clustered payara

[HWORKS-253](https://hopsworks.atlassian.net/browse/HWORKS-253) Refactor loadtest project creation

[HWORKS-313](https://hopsworks.atlassian.net/browse/HWORKS-313) Include model.deploy\(\) method in the docs

[HWORKS-333](https://hopsworks.atlassian.net/browse/HWORKS-333) Fix container vulnerabilities

[HWORKS-352](https://hopsworks.atlassian.net/browse/HWORKS-352) Make model input\_example consistent across data types

[HWORKS-361](https://hopsworks.atlassian.net/browse/HWORKS-361) Increase TransactionInactiveTimeout to 30000

[HWORKS-362](https://hopsworks.atlassian.net/browse/HWORKS-362) Update spark to depend on latest version of hopsfs

[HWORKS-363](https://hopsworks.atlassian.net/browse/HWORKS-363) Bump Hops version to 3.2.0.9-SNAPSHOT on hopsworks master

[HWORKS-364](https://hopsworks.atlassian.net/browse/HWORKS-364) Update flatbuffers dependency in Hive to address CVE-2020-36632

[HWORKS-366](https://hopsworks.atlassian.net/browse/HWORKS-366) Remove unused ClusterUtili price multiplicator singleton

[HWORKS-367](https://hopsworks.atlassian.net/browse/HWORKS-367) create zip/unzip job

[HWORKS-378](https://hopsworks.atlassian.net/browse/HWORKS-378) Metrics for consul nodes

[HWORKS-391](https://hopsworks.atlassian.net/browse/HWORKS-391) Add utility function to create directory using hopsworks python SDK

[HWORKS-394](https://hopsworks.atlassian.net/browse/HWORKS-394) Remove cron job to copy logs to HopsFS

[HWORKS-395](https://hopsworks.atlassian.net/browse/HWORKS-395) Remove admin UI

[HWORKS-398](https://hopsworks.atlassian.net/browse/HWORKS-398) OpenSearch Dashboard - elastic cluster status is wrong

[HWORKS-399](https://hopsworks.atlassian.net/browse/HWORKS-399) Improve project admin rest api

[HWORKS-402](https://hopsworks.atlassian.net/browse/HWORKS-402) Add monitoring rules

[HWORKS-403](https://hopsworks.atlassian.net/browse/HWORKS-403) Parallelize workflow and load tests

[HWORKS-405](https://hopsworks.atlassian.net/browse/HWORKS-405) Installing library using hopsworks python SDK should wait for ongoing environment sync operation

[HWORKS-411](https://hopsworks.atlassian.net/browse/HWORKS-411) CVE-2023-25194 - Kafka Connect Worker Vulnerability

[HWORKS-416](https://hopsworks.atlassian.net/browse/HWORKS-416) Upgrade data science libraries in Project environment

[HWORKS-420](https://hopsworks.atlassian.net/browse/HWORKS-420) Remove links from images

[HWORKS-423](https://hopsworks.atlassian.net/browse/HWORKS-423) Fix links for public slack on docs and community edition

[HWORKS-435](https://hopsworks.atlassian.net/browse/HWORKS-435) Enable ACL for Zookeeper

[HWORKS-436](https://hopsworks.atlassian.net/browse/HWORKS-436) Helper for loadtest to show execution logs in case of failure

2.5.0

<div class="csg-wrapper" style="font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', 'Roboto', 'Oxygen', 'Ubuntu', 'Fira Sans', 'Droid Sans', 'Helvetica Neue', sans-serif; font-size: 14px; font-weight: 400; line-height: 24px; vertical-align: baseline;"><h1 class="csg-h1" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 23px; line-height: 1.1034; margin-top: 40px; letter-spacing: -0.01em;">Release notes - Hopsworks - Version 2.5.0</h1><h3 class="csg-h3" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 16px; line-height: 1.2; margin-top: 32px; font-weight: 500; letter-spacing: -0.008em;">Bug</h3><a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2983" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2983</a> Projects can't be created without hops-system namespace in Kubernetes<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2980" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2980</a> Allow multiple model files in a model artifact<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2973" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2973</a> zip/unzip URI encoding calls system python, use hops-system python instead<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2965" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2965</a> Remove pathlib, confluent-kafka, hops-petastorm, opencv-python as dependencies for hops-util-py<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2963" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2963</a> NullPointerException when listing tags for model<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2962" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2962</a> Components in Serving UI are not aligned<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2953" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2953</a> init_prepared_statement throws NoneType exception<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2952" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2952</a> update hsfs examples with <code class="csg-mark-code" style="background: F4F5F7; color: rgb(23, 43, 77); border-radius: 3px; padding: 2px 4px; font-size: 12px; line-height: 24px; font-family: 'SFMono-Medium', 'SF Mono', 'Segoe UI Mono', 'Roboto Mono', 'Ubuntu Mono', Menlo, Consolas, Courier, monospace;">train_split</code> property<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2951" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2951</a> hsml should also be monitored for minor releases<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2950" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2950</a> Remove user, project and installation section from hopsworks documentation<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2939" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2939</a> [tez] Tez master does not send application certificates with the create container request<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2936" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2936</a> Pin ipython to 7.31.0<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2935" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2935</a> jupyter_spec insufficient spark memory test should set python kernel to false<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2924" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2924</a> cloud-metrics-daemon ownership is incorrect<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2920" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2920</a> exclude org.slf4j:slf4j-log4j12 from zookeeper<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2893" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2893</a> SYNC_BASE_ENV should also check for conflicts<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2884" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2884</a> DefaultJobConfiguration update fails for PySpark/Spark JobType<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2873" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2873</a> Log4j2 vulnerability mitigation<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2869" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2869</a> Improve Spark/PySpark logging<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2863" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2863</a> parallel conversion of same notebook - add execution id to make name unique<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2856" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2856</a> OnlineFS user removal during project removal can result in collision<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2839" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2839</a> Fix batch serving vectors sql syntax<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2838" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2838</a> Training dataset get_query for offline storage not working on hive engine<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2826" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2826</a> OnlineFS replays data on cluster restart<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2818" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2818</a> Serialize Date objects correctly in Query Constructor<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2817" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2817</a> settings.updateOauthLogoutRedirectUri add a path to the uri<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2814" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2814</a> Enabling feature store service on an existing project doesn't create online users for existing members<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2813" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2813</a> Should be able to scale out a running serving<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2812" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2812</a> Kafka failing to query the database<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2809" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2809</a> Fix IllegalAnnotationsException that is polluting the log<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2805" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2805</a> Regex for validating library name does not allow square brackets<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2800" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2800</a> onlinefs service fails silently to start if Kafka has not fully started yet<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2781" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2781</a> Fix timestamp features for Hudi Feature Groups<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2779" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2779</a> OAuth callback redirect not working when user is already logged in<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2777" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2777</a> executions table grows infinitely and may kill RonDB when deleting a Job or Project<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2770" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2770</a> Feature Group clear content endpoint rethinking<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2721" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2721</a> Data validation inequality rules should compare columns but accept fractional values<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2698" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2698</a> Update hops::fuse_mnt for logging and bug fixes<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2592" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2592</a> Dataset href path is malformed<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2590" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2590</a> Storage connector should not set empty values<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2398" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2398</a> KVM ruby sorting int as string.<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2239" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2239</a> NullPointerException when creating a feature group with Null description<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2171" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2171</a> Online Feature Group creation without schema through UI fails with uninformative Error<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2097" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2097</a> Materialize font awesome icons<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2030" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2030</a> Hopsworks Airflow operator doesn't work with python jobs<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-1867" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-1867</a> flyway_schema_history engine should be ndbcluster instead of innodb<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-1351" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-1351</a> Services versions list needs to be updated<h3 class="csg-h3" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 16px; line-height: 1.2; margin-top: 32px; font-weight: 500; letter-spacing: -0.008em;">Improvement</h3><a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2955" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2955</a> default <code class="csg-mark-code" style="background: F4F5F7; color: rgb(23, 43, 77); border-radius: 3px; padding: 2px 4px; font-size: 12px; line-height: 24px; font-family: 'SFMono-Medium', 'SF Mono', 'Segoe UI Mono', 'Roboto Mono', 'Ubuntu Mono', Menlo, Consolas, Courier, monospace;">train_split</code> property to "train"<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2948" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2948</a> Simplify getting shared feature store by name on HSFS<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2940" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2940</a> Use consul for livy.rsc.launcher.address configuration<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2933" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2933</a> Improve HSFS Python upload memory usage<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2926" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2926</a> Adding vscode specific folders to .gitignore<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2925" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2925</a> Move SqlCondition and SqlFilterLogic Enums to Persistance Package to make them reusable<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2916" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2916</a> use tf.io.parse_example instead of tf.io.parse_single_example<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2902" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2902</a> Fix for user management new UI<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2899" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2899</a> feature group data preview should default to online feature store<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2891" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2891</a> Add tags as a subresource for Models<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2888" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2888</a> Support for pyodbc in python environment<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2887" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2887</a> OAuth not working if 2fa set to mandatory<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2882" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2882</a> Vulnerability check failing in jenkins<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2880" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2880</a> Update prometheus version<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2872" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2872</a> Migrate auth and project<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2865" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2865</a> Disallow TLSv1 and TLSv1.1 at kagent web interface<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2853" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2853</a> Save OAuth id_token to be used for logout.<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2850" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2850</a> Fine-grained activity logging for validations<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2843" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2843</a> default data storage storage policy<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2842" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2842</a> Improve recent notebooks endpoint<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2836" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2836</a> Add retention policy for services logs<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2828" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2828</a> Support serving scikit-learn models and custom predictor scripts with KFServing<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2827" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2827</a> New module for managing model serving (HSML)<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2820" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2820</a> [consul-chef] Keep existing search domain in resolv.conf<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2819" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2819</a> Allow feature comparison in Query Filters<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2810" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2810</a> Fixes for oauth new UI<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2808" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2808</a> Fix home directory<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2804" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2804</a> Remove zookeeper rubygems dependency<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2803" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2803</a> Add prometheus rules for RonDb alerting<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2799" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2799</a> Use logging module in hops-util-py<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2797" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2797</a> Add model name and serving state filters to ServingService<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2784" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2784</a> bump up dependency versions to fix vulnerabilities<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2780" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2780</a> Configuration parameter for InitialLogFileGroup and InitialTablespace<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2774" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2774</a> Rest endpoints for configuring remote authentication<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2772" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2772</a> Alert on job fail not working<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2771" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2771</a> Include vnd.schemaregistry.v1+json header for kafka registry POST endpoints<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2766" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2766</a> Add template_fields to the Airflow HopsworksAbstractOperator<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2759" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2759</a> Set HttpOnly and Secure flags for cookies<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2745" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2745</a> New API for managing machine learning models<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2703" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2703</a> Improve documentation for model serving<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2633" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2633</a> Support for Istio authentication<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2623" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2623</a> Add Feature normalizer functions as in-built Transformation Functions to HSFS<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2617" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2617</a> add batch lookup API to retrieve batch of serving vectors from online feature store<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2504" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2504</a> Move feature descriptions from Hive Metastore to Hopsworks<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2395" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2395</a> Change s3 connector bucket name tooltip<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-1882" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-1882</a> Sparkmagic should send certificate to Livy<h3 class="csg-h3" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 16px; line-height: 1.2; margin-top: 32px; font-weight: 500; letter-spacing: -0.008em;">New Feature</h3><a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2919" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2919</a> Refresh online storage connector if connection gets dropped<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2917" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2917</a> Rest API for editing Hopsworks configuration<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2829" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2829</a> Expandable links provenance graph<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2811" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2811</a> Add ModelRegistry API to fully support shared models<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2802" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2802</a> Make it possible to manually set oauth session end point even if provider metadata end point is supported<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2750" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2750</a> Hopsworks GIT integration<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2680" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2680</a> Save code that it's used to create a feature group<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2382" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2382</a> Collect service logs on Elastic<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-1960" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-1960</a> Add support for downloading a model using the python API<h3 class="csg-h3" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 16px; line-height: 1.2; margin-top: 32px; font-weight: 500; letter-spacing: -0.008em;">Task</h3><a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2954" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2954</a> Add Old Documentation header to mkdocs.yml to point to readthedocs<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2930" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2930</a> Update schema and model_schema paths in test notebooks<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2929" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2929</a> Add zip package to hopsworks::install recipe<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2913" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2913</a> Bump Hops dependencies to 3.2.0.6<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2909" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2909</a> Reduce hopsworks-ear size<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2896" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2896</a> Run Airflow in Docker container<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2895" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2895</a> Add endpoint to generate elk service log user jwt token<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2894" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2894</a> adjust model_spec tests to check new input_example format<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2868" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2868</a> Model schema and input example should be expandable<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2860" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2860</a> Rename Signature to ModelSchema in ModelDTO<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2837" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2837</a> Extend query field size for SQL based on-demand feature group<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2835" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2835</a> Zookeeper recipe does not respect external_user option<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2833" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2833</a> Add documentation template<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2821" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2821</a> Add user scope API key for secrets APIs<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2776" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2776</a> Bump hops dependencies to 3.2.0.6-SNAPSHOT<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2773" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2773</a> Maven dependency refactoring and vulnerability fixes<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2769" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2769</a> Fix error management for python library installation<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2767" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2767</a> Update to Python 3.8<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-1755" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-1755</a> Upgrade PyTorch to 1.5<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-1416" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-1416</a> Support for bulk activating users in the Admin UI</div>

2.4.0

<div class="csg-wrapper" style="font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', 'Roboto', 'Oxygen', 'Ubuntu', 'Fira Sans', 'Droid Sans', 'Helvetica Neue', sans-serif; font-size: 14px; font-weight: 400; line-height: 24px; vertical-align: baseline;"><h1 class="csg-h1" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 23px; line-height: 1.1034; margin-top: 40px; letter-spacing: -0.01em;">Release notes - Hopsworks - Version 2.4.0</h1><h3 class="csg-h3" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 16px; line-height: 1.2; margin-top: 32px; font-weight: 500; letter-spacing: -0.008em;">Bug</h3><a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2770" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2770</a> Feature Group clear content endpoint rethinking<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2748" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2748</a> Kibana and Grafana consul health checks are wrong<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2738" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2738</a> Artifact files should not have glassfish as owner<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2730" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2730</a> Proxy servlet is leaking resources<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2717" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2717</a> Avro fails with schema names starting with numeric characters<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2710" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2710</a> Wrong permissions for Airflow subdirectories<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2696" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2696</a> Cannot store features of tinyint offline type as avro serialization fails<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2682" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2682</a> node_exporter is not added to kagent services file if kagent is not enabled<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2669" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2669</a> Nullpointerexception when trying to get an environment that doesn't exists<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2665" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2665</a> Use Hopsworks internal port when calling generate_service_jwt in chef<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2663" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2663</a> Fix docker installation on ubuntu 18.04<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2662" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2662</a> Fix angular-material version<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2659" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2659</a> [hopsworks-chef] Chef guard has incorrect syntax<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2656" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2656</a> Incorrect payload when creating sklearn servings with new artifacts<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2644" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2644</a> Non HOPS_ADMIN users should not be able to access the cluster settings.<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2642" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2642</a> EditableSelect listening to keyboard event on window.<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2641" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2641</a> Project page not loading after login<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2640" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2640</a> Cannot start Jupyter if Kafka is offline<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2638" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2638</a> elastic clear cached scrolling contexts<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2620" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2620</a> Add shared by and accepted by to dataset sharing requests<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2213" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2213</a> feature group commit endpoints doesn't fall back to pagination defaults<h3 class="csg-h3" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 16px; line-height: 1.2; margin-top: 32px; font-weight: 500; letter-spacing: -0.008em;">Improvement</h3><a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2768" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2768</a> Add private_ips attribute in consul-chef metadata.rb<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2736" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2736</a> Add versioning for KFServing tars in the archive<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2731" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2731</a> On-demand feature group should return primary key information<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2720" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2720</a> KfServing storage initializer should use Hopsworks internal port<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2712" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2712</a> Add support for IN condition in query filter<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2709" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2709</a> Add endpoint to retrieve the most recent ran jupyter notebooks<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2708" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2708</a> Add option to disable Jupyter shutdown<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2701" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2701</a> improve Jobs REST API filters<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2695" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2695</a> Replace creator with UserDTO in FeaturestoreEntityDTO<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2692" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2692</a> Disable Yarn application retry<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2683" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2683</a> Anaconda environment should be exported after every operation<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2681" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2681</a> Profiling optimization<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2667" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2667</a> Disable projects with no feature store<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2661" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2661</a> Sort Feature Group columns by hive metastore index<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2660" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2660</a> No user feedback when jupyter is not launched due to cpu/memory constraints<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2654" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2654</a> Attaching an expectation without features should try to use all the FG features<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2653" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2653</a> Flyway dir already exists error in hopsworks::install<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2606" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2606</a> compute training dataset statistics for train,test and validation separately<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2598" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2598</a> Add application field in snowflake storage connector<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2453" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2453</a> Feature validations - turn on by default<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-1832" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-1832</a> [ePipe] Handle connection errors with NDB<h3 class="csg-h3" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 16px; line-height: 1.2; margin-top: 32px; font-weight: 500; letter-spacing: -0.008em;">New Feature</h3><a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2518" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2518</a> Point-In-Time Joins<h3 class="csg-h3" style="font-style: inherit; color: 172B4D; font-weight: 600; margin-bottom: 0; font-size: 16px; line-height: 1.2; margin-top: 32px; font-weight: 500; letter-spacing: -0.008em;">Task</h3><a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2765" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2765</a> Remove Sqoop<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2754" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2754</a> Bump hops dependencies to 3.2.0.5-RC0<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2753" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2753</a> Install ca-certificates in base image as required by nodejs<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2737" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2737</a> Pre-install flask in airflow-chef<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2723" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2723</a> Remove AUDITOR role<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2705" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2705</a> Deterministic UID/GID<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2693" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2693</a> Bump minor version of service proxy<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2689" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2689</a> Increase max file descriptors for mysql unit<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2684" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2684</a> Remove ndb_backup from Hopsworks<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2650" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2650</a> Bump hops dependencies to 3.2.0.5-SNAPSHOT<a href="https://logicalclocks.atlassian.net/browse/HOPSWORKS-2155" class="csg-mark-link" style="border: none; background: transparent; color: #0052cc; text-decoration: none;">HOPSWORKS-2155</a> Set up multi-repo documentation for docs.hopsworks.ai</div>

2.3.0

Bug

2.2.0

Bug

[HOPSWORKS-2482](https://logicalclocks.atlassian.net/browse/HOPSWORKS-2482) Read Hudi Feature Group from Hive Engine fails with unknown fg0

[HOPSWORKS-2481](https://logicalclocks.atlassian.net/browse/HOPSWORKS-2481) Only default deployments must be enabled when KFServing is not installed

[HOPSWORKS-2473](https://logicalclocks.atlassian.net/browse/HOPSWORKS-2473) dataset read acl list does not get cleared on dataset delete

[HOPSWORKS-2471](https://logicalclocks.atlassian.net/browse/HOPSWORKS-2471) fix prepared statement parameter for string PKs

[HOPSWORKS-2447](https://logicalclocks.atlassian.net/browse/HOPSWORKS-2447) Pip conflicts modal not closing when clicking confirm

[HOPSWORKS-2415](https://logicalclocks.atlassian.net/browse/HOPSWORKS-2415) reset elastic client in case it uses the wrong certificate

[HOPSWORKS-2414](https://logicalclocks.atlassian.net/browse/HOPSWORKS-2414) Verify that API token used when starting Jupyter with AutoPushOnShutdown enabled has write access to git repo

2.1.4

[HWORKS-946](https://hopsworks.atlassian.net/browse/HWORKS-946) Global Chef attribute for arbitrary Systemd unit dependencies

[HWORKS-949](https://hopsworks.atlassian.net/browse/HWORKS-949) Add git repo pull to workflow tests

[HWORKS-962](https://hopsworks.atlassian.net/browse/HWORKS-962) Purge binlog files when Global replication is enabled

[HWORKS-965](https://hopsworks.atlassian.net/browse/HWORKS-965) In some OSes DNS resolution does not work from within a Kubernetes Pod

[HWORKS-973](https://hopsworks.atlassian.net/browse/HWORKS-973) Share feature store with project on creation

[HWORKS-977](https://hopsworks.atlassian.net/browse/HWORKS-977) Mount hopsfs by default in jupyter notebooks and python jobs containers

[HWORKS-980](https://hopsworks.atlassian.net/browse/HWORKS-980) Don't set DB storagePolicy for Hive warehouse location

[HWORKS-992](https://hopsworks.atlassian.net/browse/HWORKS-992) Remove code for generating service Renewal JWTs

[HWORKS-1050](https://hopsworks.atlassian.net/browse/HWORKS-1050) Run expat as glassfish hopsfs user

Feature Store

Epic

[FSTORE-612](https://hopsworks.atlassian.net/browse/FSTORE-612) Feature Monitoring

Bug

[FSTORE-830](https://hopsworks.atlassian.net/browse/FSTORE-830) Error fetching feature statistics from feature view UI - but statistics exists with a different timestamp

[FSTORE-856](https://hopsworks.atlassian.net/browse/FSTORE-856) Only one OnlineFS instance running

[FSTORE-987](https://hopsworks.atlassian.net/browse/FSTORE-987) Failed to read data when there is a self-join

[FSTORE-989](https://hopsworks.atlassian.net/browse/FSTORE-989) GCS connector-Encryption fields and secrets update issues

[FSTORE-992](https://hopsworks.atlassian.net/browse/FSTORE-992) create\_train\_validation\_test\_split fails with unexpected keyword argument 'pit\_query\_asof'

[FSTORE-998](https://hopsworks.atlassian.net/browse/FSTORE-998) Can't read from a shared feature store

[FSTORE-1000](https://hopsworks.atlassian.net/browse/FSTORE-1000) Tags parameter is missing in TrainingDataset class

[FSTORE-1034](https://hopsworks.atlassian.net/browse/FSTORE-1034) .select\(\) method should not default to empty list

[FSTORE-1035](https://hopsworks.atlassian.net/browse/FSTORE-1035) No error if a user tries to create a feature view without features

[FSTORE-1084](https://hopsworks.atlassian.net/browse/FSTORE-1084) Cannot run multiple insert\_stream query on the same project by default

[FSTORE-1089](https://hopsworks.atlassian.net/browse/FSTORE-1089) Remove copying of application code from databricks integration

[FSTORE-1095](https://hopsworks.atlassian.net/browse/FSTORE-1095) JDBC storage connector missing driver option in the documentation

[FSTORE-1099](https://hopsworks.atlassian.net/browse/FSTORE-1099) Nightly test test\_append\_feature failing on float type mistmatch

[FSTORE-1100](https://hopsworks.atlassian.net/browse/FSTORE-1100) Improve OnlineFS offset saving

[FSTORE-1110](https://hopsworks.atlassian.net/browse/FSTORE-1110) Recreation of Training dataset throwing exception due to NULL reference

[FSTORE-1111](https://hopsworks.atlassian.net/browse/FSTORE-1111) OnlineFS monitoring shows wrong clusterj session count

[FSTORE-1118](https://hopsworks.atlassian.net/browse/FSTORE-1118) Pandas arrow type dataframes cannot be inserted into feature group

[FSTORE-1120](https://hopsworks.atlassian.net/browse/FSTORE-1120) get\_feature\_vector\(s\) init fails if feature view contains complex feature

[FSTORE-1122](https://hopsworks.atlassian.net/browse/FSTORE-1122) QueryController issue when joining one feature group multiple times

[FSTORE-1126](https://hopsworks.atlassian.net/browse/FSTORE-1126) python mysql client sometimes failed when user name is too long

[FSTORE-1138](https://hopsworks.atlassian.net/browse/FSTORE-1138) Java client is not designed to work with shared feature store

[FSTORE-1139](https://hopsworks.atlassian.net/browse/FSTORE-1139) Get feature store requests can throw NullPointerException is the project is not properly initialized

[FSTORE-1140](https://hopsworks.atlassian.net/browse/FSTORE-1140) OnlineFS loads wrong kafka property files

[FSTORE-1144](https://hopsworks.atlassian.net/browse/FSTORE-1144) Hopsworks should not change the Access Mode of the Databricks cluster

[FSTORE-1146](https://hopsworks.atlassian.net/browse/FSTORE-1146) Appending lots of features results in error to commit activity update

[FSTORE-1154](https://hopsworks.atlassian.net/browse/FSTORE-1154) OnlineFS onPartitionsAssigned ConcurrentModificationException

[FSTORE-1156](https://hopsworks.atlassian.net/browse/FSTORE-1156) Fix FeatureView.clean\(\) code snippet to use the static method

[FSTORE-1161](https://hopsworks.atlassian.net/browse/FSTORE-1161) Arrowflight server hangs when instantiating a FlightServer instance and cannot validate the certificates.

[FSTORE-1174](https://hopsworks.atlassian.net/browse/FSTORE-1174) Spark streaming workflow test failing

[FSTORE-1181](https://hopsworks.atlassian.net/browse/FSTORE-1181) Helper columns should return all columns if they have different names across feature groups

[FSTORE-1184](https://hopsworks.atlassian.net/browse/FSTORE-1184) Kafka storage connector confluent\_options method uses wrong certificates.

[FSTORE-1187](https://hopsworks.atlassian.net/browse/FSTORE-1187) Execution failing with framework\_failure causes insert to hang forever

[FSTORE-1189](https://hopsworks.atlassian.net/browse/FSTORE-1189) Arrowflight \`tls\` option parsing the wrong number of arguments

[FSTORE-1193](https://hopsworks.atlassian.net/browse/FSTORE-1193) HSFS python tests fail after moto has been updated

[FSTORE-1199](https://hopsworks.atlassian.net/browse/FSTORE-1199) Training dataset info objects cannot be retrieved within a job

[FSTORE-1203](https://hopsworks.atlassian.net/browse/FSTORE-1203) 'FeatureGroup' object has no attribute 'time\_travel\_format'

[FSTORE-1230](https://hopsworks.atlassian.net/browse/FSTORE-1230) fg.select\_all\(\).read\(\) on PySpark does not return latest version of a Feature Group

[FSTORE-1233](https://hopsworks.atlassian.net/browse/FSTORE-1233) AML tutorial replace append \(removed from Pandas\) and fix grammar errors

[FSTORE-1252](https://hopsworks.atlassian.net/browse/FSTORE-1252) In Neo4j tutorial. fix feature group order in query when creating feature view

[FSTORE-1253](https://hopsworks.atlassian.net/browse/FSTORE-1253) Create training test split without materialization fails when during computing statistics when Feature Group contains certain types.

[FSTORE-1272](https://hopsworks.atlassian.net/browse/FSTORE-1272) Statistics cleaner should not delete statistics during migration

Subtask

[FSTORE-1132](https://hopsworks.atlassian.net/browse/FSTORE-1132) Enable filtering in find\_neighbors

[FSTORE-1133](https://hopsworks.atlassian.net/browse/FSTORE-1133) Enable deleting embedding index

[FSTORE-1134](https://hopsworks.atlassian.net/browse/FSTORE-1134) Enable updating embedding

[FSTORE-1136](https://hopsworks.atlassian.net/browse/FSTORE-1136) Add documentation for similarity search in hsfs

[FSTORE-1164](https://hopsworks.atlassian.net/browse/FSTORE-1164) Support composite primary key in similarity search

[FSTORE-1276](https://hopsworks.atlassian.net/browse/FSTORE-1276) Use a larger value of k in find\_neighbors when using project index

Task

[FSTORE-878](https://hopsworks.atlassian.net/browse/FSTORE-878) Integrate Docsbot into Docs

[FSTORE-885](https://hopsworks.atlassian.net/browse/FSTORE-885) Catch no data error when fetching dataframe in feature monitoring

[FSTORE-905](https://hopsworks.atlassian.net/browse/FSTORE-905) Add tests for training dataset statistics computation

[FSTORE-951](https://hopsworks.atlassian.net/browse/FSTORE-951) Increase test coverage for feature monitoring

[FSTORE-971](https://hopsworks.atlassian.net/browse/FSTORE-971) Do not compute statistics on in-memory training datasets

[FSTORE-1021](https://hopsworks.atlassian.net/browse/FSTORE-1021) Add a warning when using externally managed Kafka

[FSTORE-1022](https://hopsworks.atlassian.net/browse/FSTORE-1022) Missing data in featurestore benchmark

[FSTORE-1042](https://hopsworks.atlassian.net/browse/FSTORE-1042) Investigate increasing time to make hudi commits

[FSTORE-1046](https://hopsworks.atlassian.net/browse/FSTORE-1046) Improve online feature store metrics

[FSTORE-1052](https://hopsworks.atlassian.net/browse/FSTORE-1052) Update the docs to include Kafka config variables for throughput

[FSTORE-1055](https://hopsworks.atlassian.net/browse/FSTORE-1055) Support pandas 2.1.\*

[FSTORE-1060](https://hopsworks.atlassian.net/browse/FSTORE-1060) Add load tests that read feature groups and feature views

[FSTORE-1063](https://hopsworks.atlassian.net/browse/FSTORE-1063) Hopsworks data preview should use arrow flight to retrieve data if available

[FSTORE-1070](https://hopsworks.atlassian.net/browse/FSTORE-1070) Tutorial for external Flink client

[FSTORE-1074](https://hopsworks.atlassian.net/browse/FSTORE-1074) Expand documentation on filter logic

[FSTORE-1090](https://hopsworks.atlassian.net/browse/FSTORE-1090) Concepts & Guides for helper columns and on-demand features

[FSTORE-1097](https://hopsworks.atlassian.net/browse/FSTORE-1097) Add user id to workflow test and unit test

[FSTORE-1103](https://hopsworks.atlassian.net/browse/FSTORE-1103) AML Tutorial

[FSTORE-1104](https://hopsworks.atlassian.net/browse/FSTORE-1104) Pin numpy < 2

[FSTORE-1106](https://hopsworks.atlassian.net/browse/FSTORE-1106) inconsistencies in training dataset documentation

[FSTORE-1112](https://hopsworks.atlassian.net/browse/FSTORE-1112) Support Similarity Search in the Feature Store v1 - OnlineFS

[FSTORE-1113](https://hopsworks.atlassian.net/browse/FSTORE-1113) Support Similarity Search in the Feature Store v1 - HSFS

[FSTORE-1115](https://hopsworks.atlassian.net/browse/FSTORE-1115) HSFS should be able to read data from Databricks Unity Catalog

[FSTORE-1116](https://hopsworks.atlassian.net/browse/FSTORE-1116) Parallelize PK lookups for get feature vectors

[FSTORE-1119](https://hopsworks.atlassian.net/browse/FSTORE-1119) Support Similarity Search in the Feature Store v1 - migration

[FSTORE-1121](https://hopsworks.atlassian.net/browse/FSTORE-1121) Support Similarity Search in the Feature Store v1 - onlinefs monitoring

[FSTORE-1124](https://hopsworks.atlassian.net/browse/FSTORE-1124) \[OnlineFs\] Subject id should add to black list if feature group is not found

[FSTORE-1125](https://hopsworks.atlassian.net/browse/FSTORE-1125) Add retry when vector db is empty in load test

[FSTORE-1127](https://hopsworks.atlassian.net/browse/FSTORE-1127) Fix log4j vulnerability

[FSTORE-1128](https://hopsworks.atlassian.net/browse/FSTORE-1128) Fallback to head node host in opensearch api

[FSTORE-1130](https://hopsworks.atlassian.net/browse/FSTORE-1130) Get schema from shared project

[FSTORE-1131](https://hopsworks.atlassian.net/browse/FSTORE-1131) DeltaStreamer job fails when feature group has complex feature

[FSTORE-1142](https://hopsworks.atlassian.net/browse/FSTORE-1142) Remove markupsafe<2.1.0 pinning

[FSTORE-1143](https://hopsworks.atlassian.net/browse/FSTORE-1143) Bump fastavro to 1.8.4 to install using provided wheel in python 3.12 environments

[FSTORE-1147](https://hopsworks.atlassian.net/browse/FSTORE-1147) Online feature store notification system

[FSTORE-1148](https://hopsworks.atlassian.net/browse/FSTORE-1148) Python to Kafka writing analysis and benchmarking

[FSTORE-1152](https://hopsworks.atlassian.net/browse/FSTORE-1152) Add support for listing training datasets metadata from a feature view object

[FSTORE-1166](https://hopsworks.atlassian.net/browse/FSTORE-1166) Add backend support for Delta as time travel format

[FSTORE-1167](https://hopsworks.atlassian.net/browse/FSTORE-1167) Add Api support for delta time travel format

[FSTORE-1168](https://hopsworks.atlassian.net/browse/FSTORE-1168) Update databricks instance configurator to configure cluster for delta

[FSTORE-1175](https://hopsworks.atlassian.net/browse/FSTORE-1175) Add FeatureGroup.read\_changes\(..\) and FeatureGroup.as\_of\(..\) workflow tests

[FSTORE-1182](https://hopsworks.atlassian.net/browse/FSTORE-1182) Extend spark-no-metastore engine to compute statistics and remove calling use database

[FSTORE-1196](https://hopsworks.atlassian.net/browse/FSTORE-1196) Neo4j tutorial

[FSTORE-1213](https://hopsworks.atlassian.net/browse/FSTORE-1213) Remove support for configuring databricks instances from hsfs API

[FSTORE-1259](https://hopsworks.atlassian.net/browse/FSTORE-1259) Add Change Notification for Feature Groups Example

Hopsworks

Page 6 of 12