Fractal-server

* API:
* Add rate limiting to `POST /{project_id}/workflow/{workflow_id}/apply/` (\1199).
* Allow users to read the logs of ongoing jobs with `GET /project/{project_id}/job/{job_id}/`, using `show_tmp_logs` query parameter (\1216).
* Add `log` query parameter in `GET {/api/v1/job/,/api/v1/{project.id}/job/,/admin/job/}`, to trim response body (\1218).
* Add `args_schema` query parameter in `GET /api/v1/task/` to trim response body (\1218).
* Add `history` query parameter in `GET {/api/v1/dataset/,/api/v1/project/{project.id}/dataset/}` to trim response body (\1219).
* Remove `task_list` from `job.workflow_dump` creation in `/api/v1/{project_id}/workflow/{workflow_id}/apply/`(\1219)
* Remove `task_list` from `WorkflowDump` Pydantic schema (\1219)
* Dependencies:
* Update fastapi to `^0.109.0` (\1222).
* Update gunicorn to `^21.2.0` (\1222).
* Update aiosqlite to `^0.19.0` (\1222).
* Update uvicorn to `^0.27.0` (\1222).

> **WARNING**:
>
> This update requires running a fix-db script, via `fractalctl update-db-data`.

* API:
* Improve validation of `UserCreate.slurm_accounts` (\1162).
* Add `timestamp_created` to `WorkflowRead`, `WorkflowDump`, `DatasetRead` and `DatasetDump` (\1152).
* Make all dumps in `ApplyWorkflowRead` non optional (\1175).
* Ensure that timestamps in `Read` schemas are timezone-aware, regardless of `DB_ENGINE` (\1186).
* Add timezone-aware timestamp query parameters to all `/admin` endpoints (\1186).
* API (internal):
* Change the class method `Workflow.insert_task` into the auxiliary function `_workflow_insert_task` (\1149).
* Database:
* Make `WorkflowTask.workflow_id` and `WorfklowTask.task_id` not nullable (\1137).
* Add `Workflow.timestamp_created` and `Dataset.timestamp_created` columns (\1152).
* Start a new `current.py` fix-db script (\1152, \1195).
* Add to `migrations.yml` a new script (`validate_db_data_with_read_schemas.py`) that validates test-DB data with Read schemas (\1187).
* Expose `fix-db` scripts via command-line option `fractalctl update-db-data` (\1197).
* App (internal):
* Check in `Settings` that `psycopg2`, `asyngpg` and `cfut`, if required, are installed (\1167).
* Split `DB.set_db` into sync/async methods (\1165).
* Rename `DB.get_db` into `DB.get_async_db` (\1183).
* Normalize names of task packages (\1188).
* Testing:
* Update `clean_db_fractal_1.4.1.sql` to `clean_db_fractal_1.4.2.sql`, and change `migrations.yml` target version (\1152).
* Reorganise the test directory into subdirectories, named according to the order in which we want the CI to execute them (\1166).
* Split the CI into two independent jobs, `Core` and `Runner`, to save time through parallelisation (\1204).
* Dependencies:
* Update `python-dotenv` to version 0.21.0 (\1172).
* Runner:
* Remove `JobStatusType.RUNNING`, incorporating it into `JobStatusType.SUBMITTED` (\1179).
* Benchmarks:
* Add `fractal_client.py` and `populate_script_v2.py` for creating different database status scenarios (\1178).
* Add a custom benchmark suite in `api_bench.py`.
* Remove locust.
* Documentation:
* Add the minimum set of environment variables required to set the database and start the server (\1198).

> **WARNINGs**:
>
> 1. This update requires running a fix-db script, available at https://raw.githubusercontent.com/fractal-analytics-platform/fractal-server/1.4.2/scripts/fix_db/current.py.
> 2. Starting from this version, non-verified users have limited access to `/api/v1/` endpoints. Before the upgrade, all existing users must be manually set to verified.

* API:
* Prevent access to `GET/PATCH` task endpoints for non-verified users (\1114).
* Prevent access to task-collection and workflow-apply endpoints for non-verified users (\1099).
* Make first-admin-user verified (\1110).
* Add the automatic setting of `ApplyWorkflow.end_timestamp` when patching `ApplyWorkflow.status` via `PATCH /admin/job/{job_id}` (\1121).
* Change `ProjectDump.timestamp_created` type from `datetime` to `str` (\1120).
* Change `_DatasetHistoryItem.workflowtask` type into `WorkflowTaskDump` (\1139).
* Change status code of stop-job endpoints to 202 (\1151).
* API (internal):
* Implement cascade operations explicitly, in `DELETE` endpoints for datasets, workflows and projects (\1130).
* Update `GET /project/{project_id}/workflow/{workflow_id}/job/` to avoid using `Workflow.job_list` (\1130).
* Remove obsolete sync-database dependency from apply-workflow endpoint (\1144).
* Database:
* Add `ApplyWorkflow.project_dump` column (\1070).
* Provide more meaningful names to fix-db scripts (\1107).
* Add `Project.timestamp_created` column, with timezone-aware default (\1102, \1131).
* Remove `Dataset.list_jobs_input` and `Dataset.list_jobs_output` relationships (\1130).
* Remove `Workflow.job_list` (\1130).
* Runner:
* In SLURM backend, use `slurm_account` (as received from apply-workflow endpoint) with top priority (\1145).
* Forbid setting of SLURM account from `WorkflowTask.meta` or as part of `worker_init` variable (\1145).
* Include more info in error message upon `sbatch` failure (\1142).
* Replace `sbatch` `--chdir` option with `-D`, to support also slurm versions before 17.11 (\1159).
* Testing:
* Extended systematic testing of database models (\1078).
* Review `MockCurrentUser` fixture, to handle different kinds of users (\1099).
* Remove `persist` from `MockCurrentUser` (\1098).
* Update `migrations.yml` GitHub Action to use up-to-date database and also test fix-db script (\1101).
* Add more schema-based validation to fix-db current script (\1107).
* Update `.dict()` to `.model_dump()` for `SQLModel` objects, to fix some `DeprecationWarnings`(\1133).
* Small improvement in schema coverage (\1125).
* Add unit test for `security` module (\1036).
* Dependencies:
* Update `sqlmodel` to version 0.0.14 (\1124).
* Benchmarks:
* Add automatic benchmark system for API's performances (\1123)
* App (internal):
* Move `_create_first_user` from `main` to `security` module, and allow it to create multiple regular users (\1036).

* API:
* Add `GET /admin/job/{job_id}/stop/` and `GET /admin/job/{job_id}/download/` endpoints (\1059).
* Use `DatasetDump` and `WorkflowDump` models for "dump" attributes of `ApplyWorkflowRead` (\1049, \1082).
* Add `slurm_accounts` to `User` schemas and add `slurm_account` to `ApplyWorkflow` schemas (\1067).
* Prevent providing a `package_version` for task collection from a `.whl` local package (\1069).
* Add `DatasetRead.project` and `WorkflowRead.project` attributes (\1082).
* Database:
* Make `ApplyWorkflow.workflow_dump` column non-nullable (\1049).
* Add `UserOAuth.slurm_accounts` and `ApplyWorkflow.slurm_account` columns (\1067).
* Add script for adding `ApplyWorkflow.user_email` (\1058).
* Add `Dataset.project` and `Workflow.project` relationships (\1082).
* Avoid using `Project` relationships `dataset_list` or `workflow_list` within some `GET` endpoints (\1082).
* Fully remove `Project` relationships `dataset_list`, `workflow_list` and `job_list` (\1091).
* Testing:
* Only use ubuntu-22.04 in GitHub actions (\1061).
* Improve unit testing of database models (\1082).
* Dependencies:
* Pin `bcrypt` to 4.0.1 to avoid warning in passlib (\1060).
* Runner:
* Set SLURM-job working directory to `job.working_dir_user` through `--chdir` option (\1064).

> directly.

* Make `Dataset.resource_list` an `ordering_list`, ordered by `Resource.id` (\951).
* Expose `redirect_url` for OAuth clients (\953).
* Expose JSON Schema for the `ManifestV1` Pydantic model (\942).
* Improve delete-resource endpoint (\943).
* Dependencies:
* Upgrade sqlmodel to 0.0.11 (\949).
* Testing:
* Fix bug in local tests with Docker/SLURM (\948).

> **WARNING**: This version introduces a change that is then reverted in 1.4.0,
> namely it sets the `ApplyWorkflow.status` type to `Enum`, when used with