Covalent

Authors

- Ara Ghukasyan <38226926+araghukasusers.noreply.github.com>
- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]users.noreply.github.com>

Added

- check for `/bin/bash` AND `/bin/sh` (in that order) to execute bash leptons

Changed

- Changed the axios version on the webapp side.

Operations

- Change the strict version pin on `pennylane` from `==0.33.1` to `>=0.31.1,<0.33.0`

Authors

- Andrew S. Rosen (Andrew_S_Rosen)
- Co-authored-by: Will Cunningham <wjcunningham7users.noreply.github.com>
- Co-authored-by: Sankalp Sanand <sankalpagnostiq.ai>
- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]users.noreply.github.com>
- Kevin Taylor <tkdtaylorgmail.com>
- FilipBolt <filipboltgmail.com>
- Co-authored-by: dependabot[bot] <49699333+dependabot[bot]users.noreply.github.com>
- Co-authored-by: Will Cunningham <wjcunningham7gmail.com>
- Co-authored-by: Prasy12 <prasanna.venkateshpsiog.com>
- Co-authored-by: Ara Ghukasyan <38226926+araghukasusers.noreply.github.com>
- Aviral Katiyar <123640350+maskboyAviusers.noreply.github.com>
- Co-authored-by: ArunPsiog <arun.mukeshpsiog.com>
- Casey Jao <caseyagnostiq.ai>
- Arnav Kohli <95236897+THEGAMECHANGER416users.noreply.github.com>
- Kirill Pushkarev <71515921+kirill-pushusers.noreply.github.com>
- Aditya Raj Kashyap <95625520+AdityaRaj23users.noreply.github.com>
- ArunPsiog <106462226+ArunPsiogusers.noreply.github.com>
- mpvgithub <107603631+mpvgithubusers.noreply.github.com>
- Aravind <100823292+Aravind-psiogusers.noreply.github.com>
- Faiyaz Hasan <faiyazagnostiq.ai>
- Co-authored-by: Venkat Bala <balavk89gmail.com>
- Co-authored-by: kessler-frost <ssanandhawk.iit.edu>
- Co-authored-by: Aravind-psiog <aravind.prabaharanpsiog.com>
- Co-authored-by: Manjunath PV <manjunath.poilathpsiog.com>
- Co-authored-by: Ara Ghukasyan <araagnostiq.ai>
- Co-authored-by: Alejandro Esquivel <aealejandro.ltd>

Added

- Programmatic equivalents of CLI commands `covalent start` and `covalent stop`

Changed

- Changed the azurebatch.rst banner from default covalent jpg to azure batch's svg file

Fixed

- Lattice-default metadata attributes are now applied correctly
- Sublattices are built using `workflow_executor`
- Added covalent version attribute to Remote Executors
- Removed unassigned variable names
- Contributing guidelines steps for installing for the first time
- Updated gitignore to ignore yarn files and folders for latest version of yarn
- Fixed the bug that caused ValueError error when using KEYWORD_ONLY parameter in electron func
- Changed code at line 218 in covalent/\_shared_files/utils.py
- Fixed usage of deprecated pydantic validation methods
- Fixed qelectron_db retrieval in result object
- Fixed editability of Qelectron on settings page - UI changes
- Certain pydantic v2 related updates
- Fixed lattice's metadata propagation to electron's metadata in case no metadata was provided to the electron

Operations

- Updated `black` , `prettier`, `pycln` package versions in pre-commit config
- Changed `actions/checkoutv3` to `actions/checkoutv4` in CI
- Dependabot update to npm in changelog action
- Update tough-cookie to 4.1.3 version
- Added rich support to cli for better printing statements.
- Changed semver from 5.7.1 to 5.7.2 in package.json
- Updated word-wrap to 1.2.4 version
- Updated the nightly workflow's schedule
- Temporarily making the nightly workflow more frequent to test the fix for the failing tests
- Fixed failing tests

Changed

- [Significant Changes] Improving memory management part 1/3
- Removed strict version pins on `lmdbm`, `mpire`, `orjson`, and `pennylane`
- Changed license to Apache
- Improved error handling in generate_docs.py
- [Significant Changes] Migrated core server-side code to new data access layer.
- Changed the way UI was accessing the qelectron database to access it directly from the mdb file in object store
- Update version of browserverify-sign
- Limiting cloudpickle version to less than 3.0 for now

Added

- Documentation and test cases for database triggers.
- Added the `__pow__` method to the `Electron` class
- New Runner and executor API to bypass server-side memory when running tasks.
- Added qelectron_db as an asset to be transferred from executor's machine to covalent server
- New methods to qelectron_utils, replacing the old ones
- Covalent deploy CLI tool added - allows provisioning infras directly from covalent

Docs

- Added federated learning showcase code
- Updated tutorial for redispatching workflows with Streamlit

Tests

- Temporarily skipping the sqlite and database trigger functional tests
- Updated tests to accommodate the new qelectron fixes
- Added new tests for the Database class and qelectron_utils
- Covalent deploy CLI tool tests.

Removed

- Removed no longer needed methods in qelectron_utils
- Removed `dispatch-id` from generate_node_result method

Authors

- Andrew S. Rosen (Andrew_S_Rosen)
- Alejandro Esquivel <aealejandro.ltd>
- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]users.noreply.github.com>
- Co-authored-by: mpvgithub <107603631+mpvgithubusers.noreply.github.com>
- Co-authored-by: Manjunath PV <manjunath.poilathpsiog.com>
- Co-authored-by: Ara Ghukasyan <araagnostiq.ai>
- Co-authored-by: Sankalp Sanand <sankalpagnostiq.ai>
- Co-authored-by: jackbaker1001 <jsbaker1001gmail.com>
- Co-authored-by: Santosh kumar <29346072+santoshkumarradhausers.noreply.github.com>
- Co-authored-by: Ara Ghukasyan <38226926+araghukasusers.noreply.github.com>
- Co-authored-by: Will Cunningham <willagnostiq.ai>
- Co-authored-by: sriranjani venkatesan <sriranjani.venkatesanpsiog.com>
- Co-authored-by: ArunPsiog <arun.mukeshpsiog.com>
- Co-authored-by: Prasy12 <prasanna.venkateshpsiog.com>
- Co-authored-by: Prasanna Venkatesh <54540812+Prasy12users.noreply.github.com>
- FilipBolt <filipboltgmail.com>

Fixed

- Formatted executor block under Qelectron job details to handle any class-type values
- Fixed test-cases to handle latest pydantic version changes
- Rsync command fixed to recursively copy files when using SSH
- Removed accidentally added migrations build files
- Updated migration script to add a default value for `qelectron_data_exists` in the `electrons` table since it cannot be nullable
- Reduced server memory consumption during workflow processing

Changed

- Raised the minimum version of Pydantic from 1.10.1 to 2.1.1 in `requirements.txt`
- Electron DAL to use Covalent server's data instead of QServer's data.
- Renamed QCluster's `selector_serialized` attribute so it gets propagated to the qserver.
- Removed `orm_mode = True` in `covalent_ui/api/v1/models/dispatch_model.py` as it is deprecated in Pydantic 2

Added

- Added a `py.typed` file to support type-checking
- Corrected support from distributed Hamiltonian expval calculations
- Exposed qelectron db in sdk result object
- UI changes added for qelectrons and fix for related config file corruption
- UI fix regarding Qelectron not showing up
- Performance optimisation of UI for large Qelectrons

Tests

- Changed the method for startup and shutdown events for pytest to work with fastapi version 0.93.0
- Fixed test cases to adapt changes to SQLAlchemy version 1.4.49
- Add tests for GUI frontend and backend.
- Skipped `tests/covalent_ui_backend_tests/end_points/summary_test.py::test_overview` until it gets fixed.

Docs

- Fix autodoc for SSH, Slurm, AWS Braket, AWS Lambda, AWS EC2, AWS Batch, Google Batch
- Updated documentation links in README
- Added tutorial for redispatching workflows with Streamlit

Authors

- Andrew S. Rosen (Andrew_S_Rosen)
- Co-authored-by: Sankalp Sanand <sankalpagnostiq.ai>
- Will Cunningham <wjcunningham7users.noreply.github.com>
- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]users.noreply.github.com>
- Co-authored-by: Casey Jao <caseyagnostiq.ai>
- WingCode <smallstar1234gmail.com>
- Nick Tyler <nicholas.s.tyler.4gmail.com>
- Co-authored-by: Alejandro Esquivel <aealejandro.ltd>
- Aravind <100823292+Aravind-psiogusers.noreply.github.com>
- Co-authored-by: Manjunath PV <manjunath.poilathpsiog.com>
- Co-authored-by: ArunPsiog <arun.mukeshpsiog.com>
- Co-authored-by: RaviPsiog <raviteja.gurrampsiog.com>
- Co-authored-by: Prasy12 <prasanna.venkateshpsiog.com>
- Co-authored-by: mpvgithub <107603631+mpvgithubusers.noreply.github.com>
- Co-authored-by: Will Cunningham <wjcunningham7gmail.com>
- dwelsch-esi <116022979+dwelsch-esiusers.noreply.github.com>
- Co-authored-by: dwelsch-memverge <david.welschmemverge.com>
- Co-authored-by: kessler-frost <ssanandhawk.iit.edu>
- Faiyaz Hasan <faiyazagnostiq.ai>
- Santosh kumar <29346072+santoshkumarradhausers.noreply.github.com>

Fixed

- Fixed dispatcher address not showing when covalent server starts.
- Fixed the failing tests in the `nightly` workflow.

Operations

- Respecting node version as specified in `.nvmrc` file for tests workflow
- Bumped versions in pre-commit config
- Added prettier for markdown files.
- Reduce the number of pinned version numbers in the `setup.py`, `requirements.txt`, and `requirements-client.txt`
- Updated the `wci.yml` file with new features
- Bumped pre-commit versions
- Temporarily running nightly hourly to test whether the fix worked
- Reverted to daily frequency for nightly

Added

- File transfer strategy for GCP storage
- Add CLI status for zombie, stopped process.
- Fix for double locking file in configurations.
- Introduced new data access layer
- Introduced Shutil file transfer strategy for local file transfers

Docs

- Added documentation for Azure Blob Storage file transfers
- Added documentation for Google Cloud Storage file transfers
- Enhanced the quickstart with a set of commonly used features
- Removed duplicate "stop server" warning in the First Experimemnt page
- Fixed typo in quickstart
- Fix autodoc for SSH, Slurm, AWS Braket, AWS Lambda, AWS EC2, AWS Batch, Google Batch
- Updated documentation links in README
- Updating and reorganizing RTD API documentation
- Adding example links in API documentation

Changed

- Removed the upper limit from `dask` and `distributed` packages' versions until we find a version which is incompatible with Covalent.
- When the server is stopped, any workflows in a non-terminal state are first cancelled
- Pinned sqlalchemy version with upper limit <2.0.0.
- Added rich support to cli for better printing statements.
- Performed minor modifications and rearrangementsto fix the broken tests in the `nightly` workflow.

Tests

- Skipping functional tests for azure blob storage and gcp storage how to guides since they require credentials to run.
- Added testcases for GUI backend.
- Changed the method for startup and shutdown events for pytest to work with fastapi version 0.93.0
- Fixed test cases to adapt changes to SQLAlchemy version 1.4.49
- Ignored remote file transfer how-to functional tests.
- Skipping a UI backend test for now
- Fixed `test_decorated_function` test case in functional tests

Fixed

- Using `filelock` package now for platform independent file locking of config file. This should fix the failing tests as well as improve compatibility with Windows.
- When stopping the server, we send the proper `SIGINT` signal to uvicorn instead of `SIGKILL` which allows the second part of the FastAPI `lifespan` to execute properly.
- Fixed the outstanding incompatibities between front-end data layer and a postgres database
- Reverted file-lock changes
- Fixed dispatches list UI api caused by pydantic config.
- Fixed graph API.
- Fixed UI backend unit test case.
- Executor and workflow executor data dictionaries are passed to sublattices

Authors

- Andrew S. Rosen (Andrew_S_Rosen)
- Co-authored-by: Sankalp Sanand <sankalpagnostiq.ai>
- Will Cunningham <wjcunningham7users.noreply.github.com>
- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]users.noreply.github.com>
- Co-authored-by: Casey Jao <caseyagnostiq.ai>

Added

- File transfer strategy for Azure blob storage

Fixed

- Read in `README.md` with `encoding="utf-8"` in `setup.py`

Docs

- Fix `Lattice` docstring in RTD.
- Added a missing `,` to the Slurm docs.

Operations

- Update the PR template.

Authors

- Sankalp Sanand <sankalpagnostiq.ai>

Changed

- Reverting nightly frequency back to midnight basis