Covalent

Authors

- Prasanna Venkatesh <54540812+Prasy12users.noreply.github.com>
- Co-authored-by: Aravind-psiog <aravind.prabaharanpsiog.com>
- Co-authored-by: kamalesh.suresh <kamalesh.sureshpsiog.com>
- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]users.noreply.github.com>
- Casey Jao <caseyagnostiq.ai>
- Scott Wyman Neagle <wymneaprotonmail.com>
- Co-authored-by: Scott Wyman Neagle <scottagnostiq.ai>
- Co-authored-by: Alejandro Esquivel <aealejandro.ltd>
- Will Cunningham <wjcunningham7users.noreply.github.com>
- Will Cunningham <wjcunningham7gmail.com>

Added

- Ability to use terminal on the GUI.

Fixed

- Exceptions when instantiating executors are handled
- Covalent start now waits for the server to settle before returning

Operations

- updated hotfix logic to run on a merge to a release branch
- Fixing js github actions dist by re-building from develop
- Fixing syntax in describe action & compiled action manually

Authors

- Prasanna Venkatesh <54540812+Prasy12users.noreply.github.com>
- Co-authored-by: ArunPsiog <arun.mukeshpsiog.com>
- Co-authored-by: kamalesh.suresh <kamalesh.sureshpsiog.com>
- Co-authored-by: Amalan Jenicious F <amalan.jeniciouspsiog.com>
- Co-authored-by: Alejandro Esquivel <aealejandro.ltd>
- Casey Jao <caseyagnostiq.ai>

Added

- Ability to view sublattices list as part of the main lattice
- Ability to view subalattices graph as part of main lattice

Fixed

- Electron dependencies are no longer written twice to the DB during a workflow

Authors

- Venkat Bala <15014089+venkatBalausers.noreply.github.com>
- Will Cunningham <wjcunningham7users.noreply.github.com>
- Co-authored-by: Scott Wyman Neagle <scottagnostiq.ai>
- Co-authored-by: Alejandro Esquivel <aealejandro.ltd>
- Aravind <100823292+Aravind-psiogusers.noreply.github.com>
- Co-authored-by: Amalan Jenicious F <amalan.jeniciouspsiog.com>
- Co-authored-by: kamalesh.suresh <kamalesh.sureshpsiog.com>
- Co-authored-by: Prasy12 <prasanna.venkateshpsiog.com>
- Co-authored-by: ArunPsiog <arun.mukeshpsiog.com>
- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]users.noreply.github.com>
- Co-authored-by: Casey Jao <caseyagnostiq.ai>
- Co-authored-by: Will Cunningham <wjcunningham7gmail.com>
- Okechukwu Emmanuel Ochia <okechukwuagnostiq.ai>
- Scott Wyman Neagle <wymneaprotonmail.com>

Docs

- Added AWS Plugins RTD page

Fixed

- Updated import statements in alembic `env.py` file to refer to updated location of `DataStore` class
- Imports in entry_point

Docs

- Fixed the docstring for `get_node_error`

Changed

- move `upsert_lattice_data()` to dispatcher
- move `upsert_electron_data()` to dispatcher
- move `insert_electron_dependency_data()` to dispatcher
- move `persist()` to dispatcher
- move `get_unique_id()` to dispatcher
- move `initialize_result_object()` to dispatcher

Removed

- `get_node_value` from `Result`

Tests

- Updated more functional tests

Authors

- Venkat Bala <15014089+venkatBalausers.noreply.github.com>
- Scott Wyman Neagle <scottagnostiq.ai>
- Co-authored-by: Faiyaz Hasan <faiyazagnostiq.ai>
- Co-authored-by: Will Cunningham <wjcunningham7gmail.com>
- Will Cunningham <wjcunningham7users.noreply.github.com>
- Co-authored-by: Alejandro Esquivel <aealejandro.ltd>
- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]users.noreply.github.com>
- Aravind <100823292+Aravind-psiogusers.noreply.github.com>
- Co-authored-by: Amalan Jenicious F <amalan.jeniciouspsiog.com>
- Co-authored-by: kamalesh.suresh <kamalesh.sureshpsiog.com>
- Co-authored-by: Prasy12 <prasanna.venkateshpsiog.com>
- Co-authored-by: ArunPsiog <arun.mukeshpsiog.com>
- Co-authored-by: Casey Jao <caseyagnostiq.ai>
- Okechukwu Emmanuel Ochia <okechukwuagnostiq.ai>

Docs

- Updated ECS Executor RTD with config & cloud resources table

Added

- Ability to view the configuration file on the GUI as settings
- Ability to copy python objects for inputs and results for lattice and electrons

Fixed

- Minor GUI bugs and improvements

Docs

- Updated Lambda Executor RTD with config & cloud resources table
- Updated EC2, Braket, and Batch AWS Executors RTD with config & cloud resources table

Operations

- Fixed syntax issues in `nightly.yml`
- Add `repository` arg to checkout in `version`
- fix `octokit` request action route, update env token
- create stable versions for stable releases
- add `fetch-depth: 0` to fetch entire history
- fix regex for matching version
- add `persist-credentials: false` in nightly
- Update `nightly` schedule to midnight EST
- Added CI for Ubuntu 22.04 / Python 3.8, 3.9
- Added CI for Centos 7 / Python 3.9
- Added experimental CI for Debian 11 / Python 3.11rc2
- Renamed Ubuntu images to Debian for accuracy
- Adding boilerplate workflow
- Syntax fixes in release.yml
- Verbose failure messages in boilerplate workflow
- Change license.yml to pip-license-checker action

Authors

- Venkat Bala <15014089+venkatBalausers.noreply.github.com>
- Co-authored-by: Will Cunningham <wjcunningham7gmail.com>
- Co-authored-by: Scott Wyman Neagle <scottagnostiq.ai>
- Will Cunningham <wjcunningham7users.noreply.github.com>
- Sankalp Sanand <sankalpagnostiq.ai>
- Casey Jao <caseyagnostiq.ai>
- Prasanna Venkatesh <54540812+Prasy12users.noreply.github.com>
- Co-authored-by: Manjunath PV <manjunath.poilathpsiog.com>
- Co-authored-by: kamalesh.suresh <kamalesh.sureshpsiog.com>
- Co-authored-by: ArunPsiog <arun.mukeshpsiog.com>
- Co-authored-by: RaviPsiog <raviteja.gurrampsiog.com>
- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]users.noreply.github.com>
- Co-authored-by: Faiyaz Hasan <faiyazagnostiq.ai>
- Co-authored-by: Alejandro Esquivel <aealejandro.ltd>

Tests

- Fixed `asserts` in stress tests
- Added unit tests for `defaults.py`
- Updated `test_sync()` to match the new function signature.

Added

- `requirements-client.txt` file added.
- Logs tab on the GUI which displays the covalent logs and also the ability to download the log file.
- Missing copyrights to the file transfer module.

Fixed

- Config file is now locked during reads and writes to mitigate concurrency issues
- In `defaults.py/get_default_executor`, condition to return `local` or `dask` is now fixed
- Strip "/" from the S3 bucket download "from file path" and the upload "to file path"
- Correctly return stderr in get_node_result

Changed

- Installation requirements are now split into client side and server side requirements' files.
- `setup.py` modified to install client side requirements only, if `COVALENT_SDK_ONLY` environment variable is present and `True`.
- Updated `requirements.txt` and `tests/requirements.txt`
- Updated `nbconvert` by dependabot
- Split the `ConfigManager` into `Client` and `Server` components
- Update the `set/get/update` config methods to distinguish between the client and server parts
- `get_all_node_results()` uses in memory `Result` instead of DB
- `get_all_node_outputs()` uses in memory Result instead of DB

Removed

- The DB dependency in `sync()`
- The ability for `sync()` to wait for all dispatches.

Docs

- Fixed a notebook which was not rendering

Operations

- Updating all references to local workflows
- Adding `nightly.yml` workflow for nightly CI
- Updated triggers to `tests` and `changelog` workflows
- Enhanced pre-release workflows
- `codecov` passthrough jobs added for when tests are not run
- Tests are run on one platform on pushes to `develop` to keep codecov reports accurate
- Test matrix source triggers changed from `workflow_call` to `schedule` since contexts are inherited
- Removed badges workflow; version badge is now generated using the latest pre-release tag
- Removed unused `push_to_s3` workflow
- Workflows authenticate to AWS using OIDC with specific roles
- Only the recommended platform is tested on pull requests
- Update check blocks to assert the `workflow_call` event type is replaced with `schedule`
- Create a hotfix when pushing to a release branch
- Update nightly trigger to `hourly` for testing
- Update `changelog` action token to `COVALENT_OPS_BOT_TOKEN`
- Remove `benchmark` workflow from `nightly` schedule
- Removed payload dependency from changelog action so it can run on a schedule
- Remove `benchmark` workflow from `nightly` schedule

Authors

- Scott Wyman Neagle <scottagnostiq.ai>
- Co-authored-by: Will Cunningham <wjcunningham7gmail.com>

Operations

- Fix `release.yml` workflow
- Adding a step in `release.yml/docker` job to trigger the AWS executor base image build in the remote repo `covalent-aws-plugins`
- Pass all the necessary inputs for the triggered workflow as part of the HTTP POST request body
- Added MacOS 12 to test matrix

Changed

- Skipping stalling `dask_executor` functional test
- Database is initialized in `covalent_ui/app.py` instead of in the CLI's `start` method in order to support management via `start-stop-daemon`.
- Convert `COVALENT_SVC_PORT` to `int` when parsing env var
- Skipping stalling `dask_executor` functional test

Added

- Modified `_DEFAULT_CONSTRAINT_VALUES` to a dataclass called `DefaultMetadataValues`, it is still used as a dictionary everywhere (named `DEFAULT_METADATA_VALUES` instead) but in an object-like manner.
- Modified `_DEFAULT_CONFIG` to also be a dataclass called `DefaultConfig`, which is initialized whenever needed and used like a dictionary (named `DEFAULT_CONFIG`).
- `ConfigManager` is now thread safe since it is initialized whenever needed instead of one object being accessed by multiple processes/threads leading to corruption of the config file.
- Using `contextlib.supress` to ignore `psutil.NoSuchProcess` errors instead of `try/except` with `pass`.
- Filter workflow dispatches by status on the GUI.
- Delete all workflow dispatches present in the database from the GUI and add filter level deletion of workflow dispatches as well.
- Theme changes as part of latest wireframe.
- Factory functions to generate configurations and default metadata at the time when required. This is because certain values like default executors are only determined when the covalent server starts.
- Respecting the configuration options like default executor, no. of workers, developer mode, etc. when restarting the server.
- Unit tests for `remote_executor.py`
- Added alembic migrations script for DB schema v12
- Environment variables added to `defaults.py` in order to support system services
- Covalent OpenRC init script added

Removed

- Deprecated `_DEFAULT_CONSTRAINTS_DEPRECATED` removed.
- Confusing `click` argument `no-cluster` instead of flag `--no-cluster` removed; this was also partially responsible for unexpected behaviour with using `no-cluster` option when starting covalent.

Operations

- Fixed a bug in changelog.yml caused by passing a large list of commits as a var

Tests

- Updated tests to reflect above changes.
- Updated more tests to DB schema v12
- Improved DB mocking in dispatcher tests

Fixed

- Removed inheritance of `call_before` metadata related to file transfers from parent electron to collected nodes.
- Executor instances at runtime no longer inadvertently modify
transport graph nodes when modifying their attributes.
- Syntax error in `tests.yml`

Docs

- Updated AWS Lambda plugin rtd with mention to its limitations.
- Updated RTD concepts and tutorials to reflect new UI.