Spinetoolbox

Added

- New context menu action (Select superclass) for entity class items in the entity tree.
- Added Tool Specification type (Python, Gams, etc.) icons on Design View.
- There is now a new filter type, Alternative filter available in Link properties.
Unlike scenario filters, the execution is not parallelized.
Instead, a successor item sees parameter values of all selected alternatives.
Because of this behavior,
alternative filters cannot be used at the same time with scenario filters.
Link properties tab has a combo box that lets one choose which filter type to use.

Changed

Spine data structure

Many parts of the Spine data structure have been redesigned.

- *Entities* have replaced objects and relationships.
Zero-dimensional entities correspond to objects while multidimensional entities replace the former relationships.
Unlike relationships, the *elements* of multidimensional entities can now be other multidimensional entities.
- Simple inheritance is now supported by *superclasses*.
- Tools, features and methods have been removed.
The functionality that was previously implemented using the is_active parameter
has been replaced by *entity alternatives*.
Entity classes have a default setting for the entity alternative called *active by default*.
Database migration should automatically replace tools, features and methods
by entity alternatives and set active by default to whatever default value `is_active`
or similar parameter had.
The `is_active` parameter is not removed from entity classes but its values are.
- Note that new zero-dimensional entity classes have *active by default* set to `false` initially.
This means that the entities of those classes are hidden when using scenario filters
unless specifically shown using entity alternatives.

Miscellaneous changes

- "Rubber band" selection of items in Design and Graph views is now done with **left mouse button**
(no need to press Ctrl anymore). The views can be dragged around by holding the **right mouse button**.
- Spine Database Editor now remembers the configuration of the docs in each view for a specific URL. The docks
can be reset from the hamburger menu **View->Docks...->Reset docks**.
- You can now select a different Julia executable & project or Julia kernel for each Tool spec.
This overrides the global setting from Toolbox Settings.
- Headless mode now supports remote execution (see 'python -m spinetoolbox --help')
- Commit Viewer's UI has undergone some redesigning and can now handle large databases.

Removed

- Project dock widget
- Dependency on Dagster

Changed

- Microsoft build tools are not needed anymore when installing Toolbox requirements on Python 3.10 and up.

Added

- On Toolbox startup, a link appears in Event log that opens Upgrade notification window
offering information about the upcoming 0.8 update.

Added

- Data Connection items now support schemas in database references
- Importer Specification Editor now supports database schemas

Added

- Allow choosing of highlight color for items found in entity graph

Fixed

- Fixed issues when remote databases were used as references in Data Connections
- Fixed a bug where the order of scenario alternatives would be messed up when copy-pasting
the alternatives in the Scenario Tree
- Fixed a bug with time series plots
- Fixed issues with Pivot table

Added
- Support for version 11 Spine Toolbox projects.
- Executable Tool Specifications can be used to run any (shell) command. This enhancement
duplicates the functionality of Gimlet project items and makes them obsolete.
- There is now an option to select if new scenarios or tools are automatically used
for filtering in Link properties.
- The new "Filer validation" button in Link properties allows forcing at least one scenario or tool
filter to be checked.
- Python 3.11 support.
- PySide6 support. The app has been ported from PySide2 to PySide6.
- In addition to dragging and dropping,
it is now possible to copy alternatives from Alternative tree and paste them to the scenario tree
in Database editor.
- Scenarios can now be copied and pasted between databases in Database editor.
- Scenarios can now be duplicated in Database editor.
- Tool project item's Python and Julia consoles can now be killed from the right-click context menu.
A killed console can be restored by restarting it.
- A new option "Kill consoles at the end of execution" has been added to Tool properties,
that kills Python and Julia console processes after execution saving some memory and computing resources.
- A new option "Log process output to a file" has been added to Tool properties,
that logs all the 'console' output of the Tool to a file in the logs subfolder.
- You can now open a 'Detached' Jupyter Console on any kernel you have installed in your system from the *Consoles*
main window menu.
- "Make Julia Kernel" and "Make Python Kernel" buttons in Settings->Tools page. Clicking them creates a new
Julia or Python kernel based on selected Julia/Python executable on the same page if the kernel does not exist.
If the kernel already exists, it is selected automatically.
- ``project.json`` now has an experimental option ["project"]["settings"]["enable_execute_all"] which disables the
Execute Project button when set to ``false``. The option is currently not settable in the UI.
- New context menu action (Find...) to find items by name in DB editor's entity graph.

Changed
- The console settings of Python tools as well as the command and shell settings of executable tools
are now treated as project-specific data
and stored in ``<project root>/.spinetoolbox/local/specification_local_data.json``.
This should make it easier to share projects over e.g. Git.
- Scenario and tool filters are now ON by default.
If new scenario or tool is added to a database it will be automatically selected in outgoing connections.
NOTE: In existing projects, if a connection did not have any scenarios/tools selected,
they will all be selected when opening a project for the first time after this change.
If this is not desired, the scenarios/tools need to be deselected manually
before saving the project on disk.
- Project name is now the project directory name and cannot be changed unless by moving the project to another
directory manually or by using the File -> Save project as... menu item.
- Scenario filters now filter unrelated scenarios and alternatives as well.
- Alternative/Scenario tree in Database editor has been split into separate Alternative tree and Scenario tree docks.
This will hopefully make dragging and dropping alternatives to scenarios easier.
- Logic of executing selected project items. URL's passed by unselected Data Transformers are not included automatically
into selective execution anymore. When selecting project items for execution, make sure to select also preceding
Data Transformers if needed.
- Names for duplicate items/scenarios/etc now use the format `prefix (xx)` instead of `prefix xx`.
Duplicating a previously duplicated item now has the number `xx` incremented instead of having a new number appended.
- "Open kernel spec editor" buttons in Settings->Tools page have been changed "Make Julia kernel" and
"Make Python Kernel" buttons
-

Deprecated

Removed
- Python 3.7 support
- GdxExporter project item. Please use Exporter instead.
- Gimlet project item. Please use Tool instead.
- The possibility to import parameter values when importing object groups using Importer.
Existing mappings will not import group parameters anymore.
Please add explicit parameter import mappings if needed.
- The possibility to export parameter values when exporting object groups using Exporter.
Existing mappings will not export group parameters anymore.
Please add explicit parameter export mappings if needed.
- Execute in work setting in Tool Specification Editor. Please use Execute in work setting
in Tool Properties instead.
- Kernel Spec Editor widget and the "Open Kernel Spec Editor" button in Tool Specification Editor

Fixed
- Deleting the last item of a mapping in the importer specification editor no longer disables the 'add' button.
- Group Id's for Jupyter Consoles
- Kill consoles at end of execution for Jupyter Consoles
- Crash when typing exit, exit(), quit, or quit() into Jupyter Console

Security