<!-- Release notes generated using configuration in .github/release.yml at version-11.1 -->
What's Changed Other Changes * [Backport] Fix faulty validation for maintained forward model objectives. by DanSava in https://github.com/equinor/ert/pull/9225
<!-- Release notes generated using configuration in .github/release.yml at version-11.1 -->
What's Changed User impact 🛠* Remove Everest restart functionality by verveerpj in https://github.com/equinor/ert/pull/8809 * Move tool buttons to side pane by andreas-el in https://github.com/equinor/ert/pull/8703 Breaking Changes 🛠* Remove blockfs support by yngve-sk in https://github.com/equinor/ert/pull/8752 * Save & load responses as parquet by yngve-sk in https://github.com/equinor/ert/pull/8684 * Remove broadcasting of Eclipse stdout to multiple files by berland in https://github.com/equinor/ert/pull/8922 * Remove iEverest by frode-aarstad in https://github.com/equinor/ert/pull/9097 New Features 🎉 * Merge Everest into ert by oyvindeide in https://github.com/equinor/ert/pull/8709 * Add support for design matrix keyword in ert config by larsevj in https://github.com/equinor/ert/pull/8803 * Add support for reading designmatrix by larsevj in https://github.com/equinor/ert/pull/8800 * Add design matrix panel for parameters preview by xjules in https://github.com/equinor/ert/pull/8910 Improvements * Add cpu_seconds to MemoryStatus report sent from the runner by berland in https://github.com/equinor/ert/pull/8713 * Detect Eclipse300 license problems by berland in https://github.com/equinor/ert/pull/8730 * Detect license failures in Eclipse slave models by berland in https://github.com/equinor/ert/pull/8746 * Log mismatch between NUM_CPU and actual cpu usage by berland in https://github.com/equinor/ert/pull/8722 * Fix restart experiment by updating shapshot only by xjules in https://github.com/equinor/ert/pull/8692 * Group items in Experiment Panel's drop-down by AugustoMagalhaes in https://github.com/equinor/ert/pull/8602 * Log LSF execution host to Azure by andreas-el in https://github.com/equinor/ert/pull/8826 * Improve error handling in runner.py `job.run(...)` by jonathan-eq in https://github.com/equinor/ert/pull/8761 * Give warning when memory usage is set in `LSF_RESOURCE` by jonathan-eq in https://github.com/equinor/ert/pull/8938 * Give hint on REALIZATION_MEMORY on oom kills by berland in https://github.com/equinor/ert/pull/8977 * Add runpath validation in gui load_results_manually by jonathan-eq in https://github.com/equinor/ert/pull/8971 * Improve validation for unintialized ensembles in manual update and evaluate ensemble by jonathan-eq in https://github.com/equinor/ert/pull/8980 * Combine dicts instead of mutating user environment variables by oyvindeide in https://github.com/equinor/ert/pull/9025 * Add _verify_checksum lock in job.py by jonathan-eq in https://github.com/equinor/ert/pull/9046 * Have CopyDebugInfoButton change text to `Copied...` on click by jonathan-eq in https://github.com/equinor/ert/pull/9119 * Disable experiment types that do parameter updates if there are no params to update by JHolba in https://github.com/equinor/ert/pull/9007 Bug Fixes * Avoid bsub retrying on known error messages by berland in https://github.com/equinor/ert/pull/8790 * Have ForwardModelRunner validate executable_file earlier by jonathan-eq in https://github.com/equinor/ert/pull/8735 * Fix an issue where aborted processes could corrupt storage by eivindjahren in https://github.com/equinor/ert/pull/8802 * Fix capturing of ForwardModelStepWarning by eivindjahren in https://github.com/equinor/ert/pull/8857 * Fix scaling reporting in Everest by verveerpj in https://github.com/equinor/ert/pull/8884 * Handle inaccessible runpath gracefully by eivindjahren in https://github.com/equinor/ert/pull/8894 * Fix run_dialog second progress bar hanging by jonathan-eq in https://github.com/equinor/ert/pull/8935 * Only send analysis time updates every second by eivindjahren in https://github.com/equinor/ert/pull/8942 * Ensure keys can contain "/" by eivindjahren in https://github.com/equinor/ert/pull/8818 * Ensure non-existent gen_kw does not error in dark_storage by eivindjahren in https://github.com/equinor/ert/pull/8956 * Fix progress bar legend getting cut when loading bar shows by jonathan-eq in https://github.com/equinor/ert/pull/8989 * Fix bug with time format for Slurms max_runtime by berland in https://github.com/equinor/ert/pull/9005 * Make InvalidResponseFile and FileNotFoundError part of read_from_file by eivindjahren in https://github.com/equinor/ert/pull/9023 * Fix run_dialog second progress bar hanging by jonathan-eq in https://github.com/equinor/ert/pull/8948 * Fix <= .to3 migrations causing .to7 gendata migration failure by yngve-sk in https://github.com/equinor/ert/pull/9048 * Fix ert crashes if invalid range string in REPORT_STEPS config by HakonSohoel in https://github.com/equinor/ert/pull/9068 * Fix unbound event when there is a validation error for events. by eivindjahren in https://github.com/equinor/ert/pull/9114 * Make plot_api return all observations for response by yngve-sk in https://github.com/equinor/ert/pull/9087 * Timeout reading information from forward model runner after 60s and proceed with status from queue system by eivindjahren in https://github.com/equinor/ert/pull/9128 * Scheduler now allows other code to run when starting realizations by JHolba in https://github.com/equinor/ert/pull/9133 * Assume non-LSF host error is flaky by berland in https://github.com/equinor/ert/pull/9190 Maintenance * Add formatting to simulation mode helptext by andreas-el in https://github.com/equinor/ert/pull/8816 * Move plottery to tools plot by eivindjahren in https://github.com/equinor/ert/pull/8900 * Refactor test ecl_run by berland in https://github.com/equinor/ert/pull/8903 * Remove unused plugin code by berland in https://github.com/equinor/ert/pull/8909 * Remove unused help_text fm_step property by berland in https://github.com/equinor/ert/pull/8911 * Rename jobs to forward_models in snake_oil by berland in https://github.com/equinor/ert/pull/8916 * Refactor BatchSimulator by verveerpj in https://github.com/equinor/ert/pull/8899 * Refactor and rename summary_block() by berland in https://github.com/equinor/ert/pull/8927 * Shift doc and plugins test up one level by berland in https://github.com/equinor/ert/pull/8974 * Move template_render.py up two levels by berland in https://github.com/equinor/ert/pull/8988 * Rename substitution_list to substitutions by eivindjahren in https://github.com/equinor/ert/pull/9026 * Rename job.py to fm_step.py and Job to ForwardModelStep by berland in https://github.com/equinor/ert/pull/9022 * Change job to forward model step in strings by berland in https://github.com/equinor/ert/pull/9020 * Remove unused function by oyvindeide in https://github.com/equinor/ert/pull/9061 * Rename job to step in runner by berland in https://github.com/equinor/ert/pull/9069 * Log wall- and cputime for each finished forward model step by berland in https://github.com/equinor/ert/pull/9103 * Remove unused functions by oyvindeide in https://github.com/equinor/ert/pull/9099 * Skip logging of short fm steps by berland in https://github.com/equinor/ert/pull/9122 * Improve logging with open telemetry traces by HakonSohoel in https://github.com/equinor/ert/pull/9083 * Remove ert config from batch sim by frode-aarstad in https://github.com/equinor/ert/pull/9070 * Make QueueConfig serializable by oyvindeide in https://github.com/equinor/ert/pull/9143 * Freeze websockets at < 14 by JHolba in https://github.com/equinor/ert/pull/9171 * Add trace ID to clipboard debug info and title bar by HakonSohoel in https://github.com/equinor/ert/pull/9157 Build System * Add more release-notes categories by eivindjahren in https://github.com/equinor/ert/pull/8895 Dependencies * Update everest dependencies on ropt by verveerpj in https://github.com/equinor/ert/pull/8808 * Update ropt dependency to 0.9.0 by verveerpj in https://github.com/equinor/ert/pull/9138 Other Changes * Add dark storage test for summary response by yngve-sk in https://github.com/equinor/ert/pull/8745 * Copy everest test data by oyvindeide in https://github.com/equinor/ert/pull/8750 * Mark config sections as optional if all members are also optional. by DanSava in https://github.com/equinor/ert/pull/8749 * Remove python 3.12 x86-64 MacOS 14 build by andreas-el in https://github.com/equinor/ert/pull/8767 * Merge everest examples and ert test-data by DanSava in https://github.com/equinor/ert/pull/8755 * Read directly from contents by eivindjahren in https://github.com/equinor/ert/pull/8769 * Warn when parsed PRT errors are inconsistent by berland in https://github.com/equinor/ert/pull/8773 * Ignore failed block storage migration by yngve-sk in https://github.com/equinor/ert/pull/8782 * Use iens = 0 to avoid error with ensemble_size=1 by eivindjahren in https://github.com/equinor/ert/pull/8817 * (Everest) Use one experiment per optimization by yngve-sk in https://github.com/equinor/ert/pull/8670 * Use wait_for_child for getting RunDialog in test by eivindjahren in https://github.com/equinor/ert/pull/8823 * Add select_wells forward model to everest documentation by DanSava in https://github.com/equinor/ert/pull/8834 * Raise warning when summary key and no simulator job present in ert config by DanSava in https://github.com/equinor/ert/pull/8666 * Turn unexpected fm errors into warnings by yngve-sk in https://github.com/equinor/ert/pull/8832 * Fix ConfigWarning not calling class method of child classes by jonathan-eq in https://github.com/equinor/ert/pull/8845 * Add box-plots to standard deviation plot by xjules in https://github.com/equinor/ert/pull/8833 * Avoid reserved ports in test_adaptive_localization by eivindjahren in https://github.com/equinor/ert/pull/8886 * Avoid buggy hypothesis versions 6.112.3 an onwards by eivindjahren in https://github.com/equinor/ert/pull/8891 * Propagate and show lsf exec_hosts in run_dialog label by andreas-el in https://github.com/equinor/ert/pull/8824 * Make sure that the last evaluator event is EETerminated by xjules in https://github.com/equinor/ert/pull/8887 * Add well trajectory everest doc entry. by DanSava in https://github.com/equinor/ert/pull/8862 * Run everest test in komodo by DanSava in https://github.com/equinor/ert/pull/8827 * Refactor everest tmpdir fixture by frode-aarstad in https://github.com/equinor/ert/pull/8885 * Renamed jobmanager test files to forward_model_manager by berland in https://github.com/equinor/ert/pull/8918 * Rename forward-models to forward_models by berland in https://github.com/equinor/ert/pull/8908 * Explicitly sort observations&responses in _es_update by yngve-sk in https://github.com/equinor/ert/pull/8923 * Aggregate duplicate indices by mean in dark storage by eivindjahren in https://github.com/equinor/ert/pull/8952 * Initialize ErtConfig in everest_to_res by yngve-sk in https://github.com/equinor/ert/pull/8957 * Add torque support to Everest by yngve-sk in https://github.com/equinor/ert/pull/8854 * Move everest workflow logic over to a baserunmodel by yngve-sk in https://github.com/equinor/ert/pull/8963 * Use a concat instead of vstack by yngve-sk in https://github.com/equinor/ert/pull/9003 * Adjust histogram boundaries when min(data)==max(data) in plotting by xjules in https://github.com/equinor/ert/pull/8994 * Update polars import by yngve-sk in https://github.com/equinor/ert/pull/9010 * Document everest forward models by frode-aarstad in https://github.com/equinor/ert/pull/8940 * Fix read_from_file error propagation by yngve-sk in https://github.com/equinor/ert/pull/9014 * Remove duplicate eclbase from ensemble config by oyvindeide in https://github.com/equinor/ert/pull/9006 * Set ensemble_size dynamically for each batch by StephanDeHoop in https://github.com/equinor/ert/pull/9012 * Remove src/everest/suite.py by yngve-sk in https://github.com/equinor/ert/pull/9033 * Relax requirement for flaky cpu multiprocess test by berland in https://github.com/equinor/ert/pull/9040 * Handle empty responses in MeasuredData by yngve-sk in https://github.com/equinor/ert/pull/9045 * Use baserunmodel in test_egg_simulation by yngve-sk in https://github.com/equinor/ert/pull/9051 * Add some detached <-> scheduler edge cases by yngve-sk in https://github.com/equinor/ert/pull/8898 * Add reference to refcase section in summary keyword by oyvindeide in https://github.com/equinor/ert/pull/9064 * Increment storage version by yngve-sk in https://github.com/equinor/ert/pull/9081 * Show obs counts correctly summary panel by yngve-sk in https://github.com/equinor/ert/pull/9065 * Add readthedocs for everest by oyvindeide in https://github.com/equinor/ert/pull/9074 * Fix logging of step runtime statistics by berland in https://github.com/equinor/ert/pull/9121 * Fix small typo in Everest docs by StephanDeHoop in https://github.com/equinor/ert/pull/9153 * Remove LSF_SERVER from everest and add deprecation warning for simulator server option by DanSava in https://github.com/equinor/ert/pull/9150 * Smaller simplifications of everest baserunmodel by yngve-sk in https://github.com/equinor/ert/pull/9158 * Limit the use of EverestConfig in function signatures in everest csv exporting by DanSava in https://github.com/equinor/ert/pull/9163 * Enable load results manually from any available iteration by DanSava in https://github.com/equinor/ert/pull/8700 * Mitigate flakyness for LSF kill test on busy test nodes by berland in https://github.com/equinor/ert/pull/9167 * Use snapshots for everest export tests by yngve-sk in https://github.com/equinor/ert/pull/9180 * Add snapshot test for everest API by yngve-sk in https://github.com/equinor/ert/pull/9189 * Fixup ert plugin documentation by larsevj in https://github.com/equinor/ert/pull/9013 * Move everserver config to ServerConfig by frode-aarstad in https://github.com/equinor/ert/pull/9170 * Add warning when everest-models file outputs do not match everest objectives by DanSava in https://github.com/equinor/ert/pull/9120 * Make ropt use "_" instead of "." delimiter by yngve-sk in https://github.com/equinor/ert/pull/9204
New Contributors * HakonSohoel made their first contribution in https://github.com/equinor/ert/pull/8861 * StephanDeHoop made their first contribution in https://github.com/equinor/ert/pull/8954
<!-- Release notes generated using configuration in .github/release.yml at main -->
What's Changed User impact 🛠* Move tool buttons to side pane by andreas-el in https://github.com/equinor/ert/pull/8703 Breaking Changes 🛠* Remove iEverest by frode-aarstad in https://github.com/equinor/ert/pull/9097 New Features 🎉 * Add support for reading designmatrix by larsevj in https://github.com/equinor/ert/pull/8800 * Add design matrix panel for parameters preview by xjules in https://github.com/equinor/ert/pull/8910 Improvements * Give warning when memory usage is set in `LSF_RESOURCE` by jonathan-eq in https://github.com/equinor/ert/pull/8938 * Give hint on REALIZATION_MEMORY on oom kills by berland in https://github.com/equinor/ert/pull/8977 * Add runpath validation in gui load_results_manually by jonathan-eq in https://github.com/equinor/ert/pull/8971 * Improve validation for unintialized ensembles in manual update and evaluate ensemble by jonathan-eq in https://github.com/equinor/ert/pull/8980 * Combine dicts instead of mutating user environment variables by oyvindeide in https://github.com/equinor/ert/pull/9025 * Add _verify_checksum lock in job.py by jonathan-eq in https://github.com/equinor/ert/pull/9046 * Have CopyDebugInfoButton change text to `Copied...` on click by jonathan-eq in https://github.com/equinor/ert/pull/9119 Bug Fixes * Fix run_dialog second progress bar hanging by jonathan-eq in https://github.com/equinor/ert/pull/8935 * Only send analysis time updates every second by eivindjahren in https://github.com/equinor/ert/pull/8942 * Ensure keys can contain "/" by eivindjahren in https://github.com/equinor/ert/pull/8818 * Ensure non-existent gen_kw does not error in dark_storage by eivindjahren in https://github.com/equinor/ert/pull/8956 * Fix progress bar legend getting cut when loading bar shows by jonathan-eq in https://github.com/equinor/ert/pull/8989 * Fix bug with time format for Slurms max_runtime by berland in https://github.com/equinor/ert/pull/9005 * Make InvalidResponseFile and FileNotFoundError part of read_from_file by eivindjahren in https://github.com/equinor/ert/pull/9023 * Fix run_dialog second progress bar hanging by jonathan-eq in https://github.com/equinor/ert/pull/8948 * Fix <= .to3 migrations causing .to7 gendata migration failure by yngve-sk in https://github.com/equinor/ert/pull/9048 * Fix ert crashes if invalid range string in REPORT_STEPS config by HakonSohoel in https://github.com/equinor/ert/pull/9068 * Fix unbound event when there is a validation error for events. by eivindjahren in https://github.com/equinor/ert/pull/9114 * Make plot_api return all observations for response by yngve-sk in https://github.com/equinor/ert/pull/9087 * Timeout reading information from forward model runner after 60s and proceed with status from queue system by eivindjahren in https://github.com/equinor/ert/pull/9128 * Scheduler now allows other code to run when starting realizations by JHolba in https://github.com/equinor/ert/pull/9133 Maintenance * Refactor BatchSimulator by verveerpj in https://github.com/equinor/ert/pull/8899 * Refactor and rename summary_block() by berland in https://github.com/equinor/ert/pull/8927 * Shift doc and plugins test up one level by berland in https://github.com/equinor/ert/pull/8974 * Move template_render.py up two levels by berland in https://github.com/equinor/ert/pull/8988 * Rename substitution_list to substitutions by eivindjahren in https://github.com/equinor/ert/pull/9026 * Rename job.py to fm_step.py and Job to ForwardModelStep by berland in https://github.com/equinor/ert/pull/9022 * Change job to forward model step in strings by berland in https://github.com/equinor/ert/pull/9020 * Remove unused function by oyvindeide in https://github.com/equinor/ert/pull/9061 * Rename job to step in runner by berland in https://github.com/equinor/ert/pull/9069 * Log wall- and cputime for each finished forward model step by berland in https://github.com/equinor/ert/pull/9103 * Remove unused functions by oyvindeide in https://github.com/equinor/ert/pull/9099 * Skip logging of short fm steps by berland in https://github.com/equinor/ert/pull/9122 * Improve logging with open telemetry traces by HakonSohoel in https://github.com/equinor/ert/pull/9083 * Remove ert config from batch sim by frode-aarstad in https://github.com/equinor/ert/pull/9070 Other Changes * Aggregate duplicate indices by mean in dark storage by eivindjahren in https://github.com/equinor/ert/pull/8952 * Initialize ErtConfig in everest_to_res by yngve-sk in https://github.com/equinor/ert/pull/8957 * Add torque support to Everest by yngve-sk in https://github.com/equinor/ert/pull/8854 * Move everest workflow logic over to a baserunmodel by yngve-sk in https://github.com/equinor/ert/pull/8963 * Use a concat instead of vstack by yngve-sk in https://github.com/equinor/ert/pull/9003 * Adjust histogram boundaries when min(data)==max(data) in plotting by xjules in https://github.com/equinor/ert/pull/8994 * Update polars import by yngve-sk in https://github.com/equinor/ert/pull/9010 * Document everest forward models by frode-aarstad in https://github.com/equinor/ert/pull/8940 * Fix read_from_file error propagation by yngve-sk in https://github.com/equinor/ert/pull/9014 * Remove duplicate eclbase from ensemble config by oyvindeide in https://github.com/equinor/ert/pull/9006 * Set ensemble_size dynamically for each batch by StephanDeHoop in https://github.com/equinor/ert/pull/9012 * Remove src/everest/suite.py by yngve-sk in https://github.com/equinor/ert/pull/9033 * Relax requirement for flaky cpu multiprocess test by berland in https://github.com/equinor/ert/pull/9040 * Handle empty responses in MeasuredData by yngve-sk in https://github.com/equinor/ert/pull/9045 * Use baserunmodel in test_egg_simulation by yngve-sk in https://github.com/equinor/ert/pull/9051 * Add some detached <-> scheduler edge cases by yngve-sk in https://github.com/equinor/ert/pull/8898 * Add reference to refcase section in summary keyword by oyvindeide in https://github.com/equinor/ert/pull/9064 * Increment storage version by yngve-sk in https://github.com/equinor/ert/pull/9081 * Show obs counts correctly summary panel by yngve-sk in https://github.com/equinor/ert/pull/9065 * Add readthedocs for everest by oyvindeide in https://github.com/equinor/ert/pull/9074 * Fix logging of step runtime statistics by berland in https://github.com/equinor/ert/pull/9121
New Contributors * StephanDeHoop made their first contribution in https://github.com/equinor/ert/pull/8954
<!-- Release notes generated using configuration in .github/release.yml at main -->
What's Changed Breaking Changes 🛠* Remove broadcasting of Eclipse stdout to multiple files by berland in https://github.com/equinor/ert/pull/8922 Improvements * Improve error handling in runner.py `job.run(...)` by jonathan-eq in https://github.com/equinor/ert/pull/8761 Bug Fixes * Handle inaccessible runpath gracefully by eivindjahren in https://github.com/equinor/ert/pull/8894 Maintenance * Move plottery to tools plot by eivindjahren in https://github.com/equinor/ert/pull/8900 * Refactor test ecl_run by berland in https://github.com/equinor/ert/pull/8903 * Remove unused plugin code by berland in https://github.com/equinor/ert/pull/8909 * Remove unused help_text fm_step property by berland in https://github.com/equinor/ert/pull/8911 * Rename jobs to forward_models in snake_oil by berland in https://github.com/equinor/ert/pull/8916 Other Changes * Propagate and show lsf exec_hosts in run_dialog label by andreas-el in https://github.com/equinor/ert/pull/8824 * Make sure that the last evaluator event is EETerminated by xjules in https://github.com/equinor/ert/pull/8887 * Add well trajectory everest doc entry. by DanSava in https://github.com/equinor/ert/pull/8862 * Run everest test in komodo by DanSava in https://github.com/equinor/ert/pull/8827 * Refactor everest tmpdir fixture by frode-aarstad in https://github.com/equinor/ert/pull/8885 * Renamed jobmanager test files to forward_model_manager by berland in https://github.com/equinor/ert/pull/8918 * Rename forward-models to forward_models by berland in https://github.com/equinor/ert/pull/8908 * Explicitly sort observations&responses in _es_update by yngve-sk in https://github.com/equinor/ert/pull/8923