Flexmeasures

============================

.. warning:: Upgrading to this version requires running ``flexmeasures db upgrade`` (you can create a backup first with ``flexmeasures db-ops dump``).

New features
-------------

Infrastructure / Support
----------------------
* Migrate data for the ``flex_context`` of an asset to a dedicated column in the database table for assets [see `PR 1293 <https://github.com/FlexMeasures/flexmeasures/pull/1293>`_]
* Enhance reporting infrastructure by ensuring that all ``Sensor.search_beliefs`` filters can be used as report parameters [see `PR 1318 <https://github.com/FlexMeasures/flexmeasures/pull/1318>`_]
* Improve searching for multi-sourced data by returning data from only the latest version of a data generator (e.g. forecaster or scheduler) by default, when using ``Sensor.search_beliefs`` [see `PR 1306 <https://github.com/FlexMeasures/flexmeasures/pull/1306>`_]
* Extra reporter tests [see `PR 1317 <https://github.com/FlexMeasures/flexmeasures/pull/1317>`_]
* Catch invalid time windows passed to ``flexmeasures add report`` [see `PR 1324 <https://github.com/FlexMeasures/flexmeasures/pull/1324>`_]
* Test utility function for device scheduling in a multi-asset setting (sequential and simultaneous) [see `PR 1341 <https://github.com/FlexMeasures/flexmeasures/pull/1341>`_]

Bugfixes
-----------

============================

Infrastructure / Support
----------------------
* Update cache and Ubuntu versions used for testing in GitHub Actions [see `PR 1329 <https://github.com/FlexMeasures/flexmeasures/pull/1329>`_]

Bugfixes
-----------
* Fix map not loading when editing an asset [see `PR 1310 <https://github.com/FlexMeasures/flexmeasures/pull/1310>`_]
* Add missing support for fallback attribute for the ``soc-usage`` and ``soc-gain`` fields of the ``flex-model`` [see `PR 1340 <https://github.com/FlexMeasures/flexmeasures/pull/1340>`_]

============================

.. note:: Read more on these features on `the FlexMeasures blog <https://flexmeasures.io/024-more-expressive-congestion-modeling-data-dashboards/>`_.

.. warning:: Upgrading to this version requires running ``flexmeasures db upgrade`` (you can create a backup first with ``flexmeasures db-ops dump``).

New features
-------------
* Allow scheduling against energy contracts, capacity contracts and peak contracts simultaneously, using various new ``flex-context`` fields [see `PR 1144 <https://github.com/FlexMeasures/flexmeasures/pull/1144>`_]
* Allow using numeric values for ``flex-model`` fields accepting dimensionless quantities [see `PR 1144 <https://github.com/FlexMeasures/flexmeasures/pull/1299>`_]
* The data chart on the asset page splits up its color-coded sensor legend when showing more than 7 sensors, becoming a legend per subplot [see `PR 1176 <https://github.com/FlexMeasures/flexmeasures/pull/1176>`_ and `PR #1193 <https://github.com/FlexMeasures/flexmeasures/pull/1193>`_]
* Speed up loading the users page, by making the pagination backend-based and adding support for that in the API [see `PR 1160 <https://github.com/FlexMeasures/flexmeasures/pull/1160>`_]
* X-axis labels in CLI plots show datetime values in a readable and informative format [see `PR 1172 <https://github.com/FlexMeasures/flexmeasures/pull/1172>`_]
* Enhanced API for listing sensors: Added filtering and pagination on sensor index endpoint and created new endpoint to get all sensors under an asset [see `PR 1191 <https://github.com/FlexMeasures/flexmeasures/pull/1191>`_ and `PR #1219 <https://github.com/FlexMeasures/flexmeasures/pull/1219>`_]
* Speed up loading the accounts page by making the pagination backend-based and adding support for that in the API [see `PR 1196 <https://github.com/FlexMeasures/flexmeasures/pull/1196>`_]
* Speed up loading the account detail page by by switching to server-side pagination for assets, replacing client-side pagination [see `PR 1202 <https://github.com/FlexMeasures/flexmeasures/pull/1202>`_]
* Added form to edit an asset's sensors_to_show data directly from the UI [see `PR 1212 <https://github.com/FlexMeasures/flexmeasures/pull/1212>`_]
* Speed up loading on audit log tables page by switching to server-side pagination, replacing client-side pagination [see `PR 1274 <https://github.com/FlexMeasures/flexmeasures/pull/1274>`_ and `PR #1272 <https://github.com/FlexMeasures/flexmeasures/pull/1272>`_]
* Simplify and globalize UI messages, using Toast [see `PR 1207 <https://github.com/FlexMeasures/flexmeasures/pull/1207>`_]
* Power sensors created through the CLI no longer require a capacity attribute to be set [see `PR 1234 <https://github.com/FlexMeasures/flexmeasures/pull/1234>`_]

Infrastructure / Support
----------------------
* The breadcrumbs on asset and sensor pages can now be customized [see `PR 1257 <https://github.com/FlexMeasures/flexmeasures/pull/1257>`_]
* The monitoring command to check for users who have been absent too long now can be used to keep data volume low and be more effective [see `PR 1268 <https://github.com/FlexMeasures/flexmeasures/pull/1268>`_]
* Speed up status page by choosing for a faster query (only latest belief needed) [see `PR 1142 <https://github.com/FlexMeasures/flexmeasures/pull/1142>`_]
* Speed up user page (for users with many assets) [see `PR 1286 <https://github.com/FlexMeasures/flexmeasures/pull/1286>`_]
* For MacOS developers, install HiGHS solver automatically [see `PR 1187 <https://github.com/FlexMeasures/flexmeasures/pull/1187>`_]
* Migrate data for the ``sensors_to_show`` asset attribute to a dedicated column in the database table for assets [see `PR 1200 <https://github.com/FlexMeasures/flexmeasures/pull/1200>`_ and `PR #1282 <https://github.com/FlexMeasures/flexmeasures/pull/1282>`_]
* Add support for installing FlexMeasures under Python 3.12 [see `PR 1233 <https://github.com/FlexMeasures/flexmeasures/pull/1233>`_]
* Better error handling in UI, for example, in case of a forgotten ``flexmeasures db upgrade`` [see `PR 1302 <https://github.com/FlexMeasures/flexmeasures/pull/1302>`_]

Bugfixes
-----------
* Fix table sorting on the assets, accounts and users page (regression from `PR 988 <https://github.com/FlexMeasures/flexmeasures/pull/988>`_) [see `PR #1239 <https://github.com/FlexMeasures/flexmeasures/pull/1239>`_, `PR #1242 <https://github.com/FlexMeasures/flexmeasures/pull/1242>`_, `PR #1248 <https://github.com/FlexMeasures/flexmeasures/pull/1248>`_, `PR #1247 <https://github.com/FlexMeasures/flexmeasures/pull/1247>`_ and `PR #1272 <https://github.com/FlexMeasures/flexmeasures/pull/1272>`_]
* Fix ``flexmeasures delete measurements`` and ``flexmeasures delete prognoses`` which had an error in counting affected rows after SQLAlchemy2.0 upgrade [see `PR 1095 <https://github.com/FlexMeasures/flexmeasures/pull/1095>`_ and `PR #1303 <https://github.com/FlexMeasures/flexmeasures/pull/1303>`_]
* Fix asset count on the user page, which showed 0 assets after (de)activating a user or resetting their password [see `PR 1251 <https://github.com/FlexMeasures/flexmeasures/pull/1251>`_]
* The UI footer now stays at the bottom even on pages with little content [see `PR 1204 <https://github.com/FlexMeasures/flexmeasures/pull/1204>`_]
* Correct stroke dash (based on source type) for forecasts made by forecasters included in FlexMeasures [see `PR 1211 <https://www.github.com/FlexMeasures/flexmeasures/pull/1211>`_]
* Show the correct :abbr:`UTC (Coordinated Universal Time)` offset for the data's time span as shown under sensor stats in the UI [see `PR 1213 <https://github.com/FlexMeasures/flexmeasures/pull/1213>`_]
* Fixed issue where audit log buttons are visible to users without the necessary permissions. [see `PR 1228 <https://github.com/FlexMeasures/flexmeasures/pull/1228>`_]
* Fix issue with displaying ``deactivate user`` and ``reset password`` buttons for non admin users [see `PR 1220 <https://github.com/FlexMeasures/flexmeasures/pull/1220>`_]
* Resolve overlapping time series segments in several flex-model and flex-context fields in a way befitting their nature [see `PR 1223 <https://github.com/FlexMeasures/flexmeasures/pull/1223>`_]

============================

Bugfixes
-----------
* Correct source filters on reporter input, and support piping additional transformations in the ``PandasReporter`` [see `PR 1284 <https://github.com/FlexMeasures/flexmeasures/pull/1284>`_]

============================

Bugfixes
-----------
* Correct unit conversion of reporter output to output sensor [see `PR 1238 <https://github.com/FlexMeasures/flexmeasures/pull/1238>`_]

============================

.. note:: Read more on these features on `the FlexMeasures blog <https://flexmeasures.io/023-data-insights-and-white-labelling/>`_.

.. warning:: Upgrading to this version requires running ``flexmeasures db upgrade`` (you can create a backup first with ``flexmeasures db-ops dump``).

New features
-------------
* New chart type on sensor page: histogram [see `PR 1143 <https://github.com/FlexMeasures/flexmeasures/pull/1143>`_]
* Add basic sensor info to sensor page [see `PR 1115 <https://github.com/FlexMeasures/flexmeasures/pull/1115>`_]
* Add `Statistics` table on the sensor page and also add `api/v3_0/sensors/<id>/stats` endpoint to get sensor statistics [see `PR 1116 <https://github.com/FlexMeasures/flexmeasures/pull/1116>`_]
* Support adding custom titles to the graphs on the asset page, by extending the ``sensors_to_show`` format [see `PR 1125 <https://github.com/FlexMeasures/flexmeasures/pull/1125>`_ and `PR #1177 <https://github.com/FlexMeasures/flexmeasures/pull/1177>`_]
* Support zoom-in action on the asset and sensor charts [see `PR 1130 <https://github.com/FlexMeasures/flexmeasures/pull/1130>`_]
* Speed up loading the assets page, by making the pagination backend-based and adding support for that in the API, and by enabling to query all accounts one can see in a single call (for admins and consultants) [see `PR 988 <https://github.com/FlexMeasures/flexmeasures/pull/988>`_]
* Added Primary and Secondary colors to account for white-labelled UI themes [see `PR 1137 <https://github.com/FlexMeasures/flexmeasures/pull/1137>`_]
* Added Logo URL to account for white-labelled UI themes [see `PR 1145 <https://github.com/FlexMeasures/flexmeasures/pull/1145>`_]
* Added PopUp form to edit account details [see `PR 1152 <https://github.com/FlexMeasures/flexmeasures/pull/1152>`_]
* When listing past jobs on the `Tasks` page, show the most recent jobs first [see `PR 1163 <https://github.com/FlexMeasures/flexmeasures/pull/1163>`_]
* Introduce the ``VariableQuantityField`` to allow three ways of passing a variable quantity in most of the ``flex-model`` and ``flex-context`` fields [see `PR 1127 <https://github.com/FlexMeasures/flexmeasures/pull/1127>`_ and `PR #1138 <https://github.com/FlexMeasures/flexmeasures/pull/1138>`_]
* Support directly passing a fixed price in the ``flex-context`` using the new fields ``consumption-price`` and ``production-price``, which are meant to replace the ``consumption-price-sensor`` and ``production-price-sensor`` fields, respectively [see `PR 1028 <https://github.com/FlexMeasures/flexmeasures/pull/1028>`_]

Infrastructure / Support
----------------------
* Save beliefs faster by bulk saving [see `PR 1159 <https://github.com/FlexMeasures/flexmeasures/pull/1159>`_]
* Support new single-belief fast track (looking up only one belief) [see `PR 1067 <https://github.com/FlexMeasures/flexmeasures/pull/1067>`_]
* Add new annotation types: ``"error"`` and ``"warning"`` [see `PR 1131 <https://github.com/FlexMeasures/flexmeasures/pull/1131>`_ and `PR #1150 <https://github.com/FlexMeasures/flexmeasures/pull/1150>`_]
* When deleting a sensor, asset or account, delete any annotations that belong to them [see `PR 1151 <https://github.com/FlexMeasures/flexmeasures/pull/1151>`_]
* Removed deprecated ``app.schedulers`` and ``app.forecasters`` (use ``app.data_generators["scheduler"]`` and ``app.data_generators["forecaster"]`` instead) [see `PR 1098 <https://github.com/FlexMeasures/flexmeasures/pull/1098/>`_]
* Save beliefs faster by bulk saving [see `PR 1159 <https://github.com/FlexMeasures/flexmeasures/pull/1159>`_]
* Introduced dynamic, JavaScript-generated toast notifications. [see `PR 1152 <https://github.com/FlexMeasures/flexmeasures/pull/1152>`_]

Bugfixes
-----------
* Fix string length exceeding the 255-character limit in the `event` field of `AssetAuditLog` by truncating long updates and logging each field or attribute change individually. [see `PR 1162 <https://github.com/FlexMeasures/flexmeasures/pull/1162>`_]
* Fix image carousel on the login page [see `PR 1154 <https://github.com/FlexMeasures/flexmeasures/pull/1154>`_]
* Fix styling for User and Documentation menu items [see `PR 1140 <https://github.com/FlexMeasures/flexmeasures/pull/1140>`_]
* Fix styling of sensor page, especially the graph chart dropdown [see `PR 1148 <https://github.com/FlexMeasures/flexmeasures/pull/1148>`_]
* Fix posting a single instantaneous belief [see `PR 1129 <https://github.com/FlexMeasures/flexmeasures/pull/1129>`_]
* Allow reassigning a public asset to private ownership using the ``flexmeasures edit transfer-ownership`` CLI command [see `PR 1123 <https://github.com/FlexMeasures/flexmeasures/pull/1123>`_]
* Fix missing value on spring :abbr:`DST (Daylight Saving Time)` transition for ``PandasReporter`` using daily sensor as input [see `PR 1122 <https://github.com/FlexMeasures/flexmeasures/pull/1122>`_]
* Fix date range persistence on session across different pages [see `PR 1165 <https://github.com/FlexMeasures/flexmeasures/pull/1165>`_]
* Fix issue with account creation failing when the ``--logo-url`` option is omitted. [see related PRs `PR 1167 <https://github.com/FlexMeasures/flexmeasures/pull/1167>`_ and `PR #1145 <https://github.com/FlexMeasures/flexmeasures/pull/1145>`_]
* Fix ordering of audit logs (asset, account) and job list on status page [see `PR 1179 <https://github.com/FlexMeasures/flexmeasures/pull/1179>_` and `PR #1183 <https://github.com/FlexMeasures/flexmeasures/pull/1183>`_]