Taskcluster

DEPLOYERS

▶ [patch] [6716](https://github.com/taskcluster/taskcluster/issues/6716)
Adds lifecycle preStop hook for services to allow graceful termination of pods in kubernetes without loss of connections.

▶ [patch] [6716](https://github.com/taskcluster/taskcluster/issues/6716)
Fix kubernetes deployment configuration - `lifecycle` was misplaced.

DEPLOYERS

▶ [MAJOR] [5514](https://github.com/taskcluster/taskcluster/issues/5514)
Removes postgres v11 support.

▶ [minor] [6716](https://github.com/taskcluster/taskcluster/issues/6716)
Services now support graceful server termination by listening to `SIGTERM` and letting existing connections to be served while rejecting new connections.

Automated Package Updates

<details>
<summary>6 Dependabot updates</summary>

* bump the deps group in /ui with 21 updates (9a5f92ace)
* build(deps): bump the deps group with 14 updates (2c4e72139)
* build(deps-dev): bump the deps group in /clients/client with 1 update (7d6e6cb72)
* build(deps): bump taskcluster from 57.0.1 to 58.0.2 in /taskcluster (6cdb51eab)
* build(deps): bump the deps group with 8 updates (6eff15e94)
* build(deps): bump aiohttp from 3.8.6 to 3.9.0 in /taskcluster (cf9985828)

</details>

GENERAL

▶ [patch] [6701](https://github.com/taskcluster/taskcluster/issues/6701)
Generic Worker: Fixes `permission denied` error while checking if `generic-worker` binary is executable by the task user for simple engine.

▶ [patch]
Upgrades rust version to 1.74.0 and ran `cargo audit fix` to fix insecure crates.

Automated Package Updates

<details>
<summary>1 Dependabot updates</summary>

* build(deps): bump slugid from 4.0.0 to 5.0.1 in /clients/client (947e00ba6)

</details>

GENERAL

▶ [patch]
Generic Worker: Adds validation that the task user is able to read and execute the generic-worker binary on startup of the worker. If the task user is not able to read and execute the binary, the worker will exit with exit code 69, internal error.

USERS

▶ [patch] [4998](https://github.com/taskcluster/taskcluster/issues/4998)
This fixes a bug in the Python client where an exception was raised on 300 HTTP
status.

GENERAL

▶ [MAJOR] [bug 1855653](http://bugzil.la/1855653)
Generic Worker: The `generic-worker` binary _must be_ readable and executable by the task user. If it's not, artifact uploads _will fail_.

Generic Worker: Add `copy-to-temp-file` subcommand to `generic-worker` to copy a file (`--copy-file`) to a temporary file.

▶ [patch] [6671](https://github.com/taskcluster/taskcluster/issues/6671)
Introduces `workerManager.workerPoolErrorStats()` to return total number of errors for any worker pool or all worker pools.
Stats are split into totals by day, hour, kind of error and error code.
Worker Pool errors are kept in db for 7 days.

▶ [patch]
Removes compatibility columns in refactored queue tables that were used during migration for backward-compatibility purposes.

▶ [patch] [6682](https://github.com/taskcluster/taskcluster/issues/6682)
Tweaking `server.keepAliveTimeout` to fix downstream errors in reverse proxy and load balancer.
Default node's http server keepAliveTimeout is 5s which might be an issue when working behind a reverse proxy which has bigger timeouts.
To reduce number of `502` errors, application's keep alive timeout should be larger than the one of the reverse proxy,
and that in turn, should be larger than the Load Balancer's one.

▶ [patch]
Upgrades to go1.21.4 and node 18.18.2.

WORKER-DEPLOYERS

▶ [patch] [bug 1859323](http://bugzil.la/1859323)
Generic Worker now reports the full path of tasks-resolved-count.txt, next-task-user.json and current-task-user.json in worker logs.

Automated Package Updates

<details>
<summary>3 Dependabot updates</summary>

* build(deps): bump aiohttp from 3.8.5 to 3.8.6 in /taskcluster (cfd8296cf)
* build(deps): bump babel/traverse from 7.13.13 to 7.23.2 in /ui (ea440855c)
* build(deps-dev): bump the deps group in /clients/client with 1 update (575193ad7)

</details>

GENERAL

▶ [minor] [2939](https://github.com/taskcluster/taskcluster/issues/2939)
Introduces `queue.listPendingTasks(taskQueueId)` and `queue.listClaimedTasks(taskQueueId)`.
Those endpoints return a list of tasks that are currently pending or claimed by workers.

New scopes introduced for those endpoints:
- `queue:pending-list:<taskQueueId>`
- `queue:claimed-list:<taskQueueId>`

▶ [patch] [6656](https://github.com/taskcluster/taskcluster/issues/6656)
D2G now shell escapes environment variable key names in case they contain spaces or special characters that would previously mess up the `podman run...` command.

Automated Package Updates

<details>
<summary>3 Dependabot updates</summary>

* build(deps-dev): bump the deps group (ef65976fe)
* build(deps): bump taskcluster from 55.3.2 to 57.0.1 in /taskcluster (dfbcf2cac)
* build(deps): bump the deps group with 3 updates (79ce5c89b)

</details>