Taskcluster

GENERAL

▶ [patch] [6543](https://github.com/taskcluster/taskcluster/issues/6543)
Generic Worker: d2g no longer passes the environment variable values to the `podman run` command. Instead, just the variable name is passed as `-e VAR` which tells podman to take the value from the host. This will tidy up the run command and will help with any escaping issues users may have been having.

DEPLOYERS

▶ [minor] [5514](https://github.com/taskcluster/taskcluster/issues/5514)
Adds support for postgres version 15.

Note: if you want to migrate your local dev db to pg15, you'll need to either erase the existing db with `docker volume rm taskcluster_db-data` before you migrate, or, if you'd prefer to keep your local dev data, you'll need to manually dump the db contents and then import them into the upgraded db.

Support for postgres v11 will be dropped from Taskcluster on November 9, 2023 (v11 EoL date) and that will be a breaking change.

▶ [patch] [6534](https://github.com/taskcluster/taskcluster/issues/6534)
Upgrades kubernetes cronjob api version to `batch/v1`.

WORKER-DEPLOYERS

▶ [patch] [6540](https://github.com/taskcluster/taskcluster/issues/6540)
Generic Worker panicked when evicting caches to free up space on workers. This was reported via sentry [here](https://mozilla.sentry.io/issues/4044685700/?project=6462337).

USERS

▶ [patch] [6470](https://github.com/taskcluster/taskcluster/issues/6470)
D2G now properly escapes artifact paths in generated `podman cp` commands.

▶ [patch] [6488](https://github.com/taskcluster/taskcluster/issues/6488)
Generic Worker no longer panics if an IO error occurs while scanning the filesystem for artifacts.

▶ [patch] [6516](https://github.com/taskcluster/taskcluster/issues/6516)
Generic Worker now handles Indexed Docker Images where the docker image
contains multiple tags. Previously, Generic Worker assumed that indexed docker
images would have only one tag.

DEVELOPERS

▶ [patch]
Updates Github integration documentation to tell which events to subscribe to.

WORKER-DEPLOYERS

▶ [patch] [6530](https://github.com/taskcluster/taskcluster/issues/6530)
Workers deployed in GCP as spot instances or preemptible VMs now
handle instance termination gracefully.

GENERAL

▶ [minor] [6528](https://github.com/taskcluster/taskcluster/issues/6528)
Github webhook handler supports recommended `X-Hub-Signature-256` verification.
All verification failures are being reported to the sentry additionally.

▶ [patch]
Replaces slow db query to fetch check run build status with a faster one, which is used in background status update handlers.

▶ [patch]
Upgrades to go1.21.1

USERS

▶ [patch] [6521](https://github.com/taskcluster/taskcluster/issues/6521)
Generic Worker now outputs a warning in the task log if a Docker Worker payload is supplied, together with the
d2g-converted task definition, in order to help users migrate their tasks to native Generic Worker format.

OTHER

▶ Additional change not described here: [6513](https://github.com/taskcluster/taskcluster/issues/6513).

Automated Package Updates

<details>
<summary>7 Dependabot updates</summary>

* build(deps-dev): bump the deps group (1a1e30ce3)
* build(deps-dev): bump the deps-dev group (9f2491c20)
* build(deps): bump actions/checkout from 3 to 4 (487c1c0de)
* build(deps-dev): bump babel/core in /clients/client-web (2af04e02f)
* build(deps): bump taskcluster from 54.4.1 to 55.0.0 in /taskcluster (6421f4f8c)
* build(deps-dev): bump chai from 4.3.7 to 4.3.8 in /clients/client-web (c5cd0f576)
* build(deps-dev): bump eslint in /clients/client-web (8f82a9e90)

</details>

DEPLOYERS

▶ [minor] [2942](https://github.com/taskcluster/taskcluster/issues/2942)
The new `queue.maxTaskDeadlineDays` Helm configuration parameter controls the maximum value allowed for task deadlines. The default is 5 days, matching the previous hard-coded setting.

USERS

▶ [MAJOR] [6117](https://github.com/taskcluster/taskcluster/issues/6117)
`workerManager.getWorker` returns worker even if it is quarantined and expired.
This is to avoid confusion in the UI when a worker is linked in UI, still exists in database, but page returns `404`.

Automated Package Updates

<details>
<summary>1 Dependabot/Renovate updates</summary>

* build(deps): bump apollo-server-core from 3.12.0 to 3.12.1 (74b091287)

</details>

USERS

▶ [minor] [5995](https://github.com/taskcluster/taskcluster/issues/5995)
Generic Worker: Adds `task.payload.feature.loopbackAudio` for loopback audio device support on Linux.

The `snd-aloop` kernel module must be installed on the host system for this feature to work, although it does not _need_ to be loaded. Generic Worker loads the module with `modprobe` and generates the virtual audio device with a `snd-aloop` command. Under the multiuser engine, it also manages file ownership of the device with `chown` to ensure that only tasks with suitable scopes have read/write access to the virtual device.

For tasks that enable the feature, the virtual audio device will be found at `/dev/snd`. Devices inside that directory will take the form `/dev/snd/controlC<DEVICE_NUMBER>`, `/dev/snd/pcmC<DEVICE_NUMBER>D0c`, `/dev/snd/pcmC<DEVICE_NUMBER>D0p`, `/dev/snd/pcmC<DEVICE_NUMBER>D1c`, and `/dev/snd/pcmC<DEVICE_NUMBER>D1p`, where `<DEVICE_NUMBER>` is an integer between 0 and 31, inclusive. The Generic Worker config setting `loopbackAudioDeviceNumber` may be used to change the device number in case the default value (`16`) conflicts with another audio device on the worker. Future releases of Generic Worker may provide the capability of having more than one virtual audio device; currently only one virtual audio device is supported.

▶ [patch] [6481](https://github.com/taskcluster/taskcluster/issues/6481)
Allow git SSH urls in `metadata.source`.

▶ [patch] [6476](https://github.com/taskcluster/taskcluster/issues/6476)
Generic Worker now checks the Index to see if there is a new version of an Indexed Artifact available. If there isn't, it is fine to use its cached copy, but if there is, it updates its cache.

▶ [patch]
Generic Worker: If a Docker Worker payload is received, the resulting, d2g-translated Generic Worker payload will be logged out to the user.

▶ [patch] [6438](https://github.com/taskcluster/taskcluster/issues/6438)
`dependencies` are no longer removed from the task definition when you `Edit` or `Retrigger` a task.

DEVELOPERS

▶ [minor] [6269](https://github.com/taskcluster/taskcluster/issues/6269)
Generic Worker now provides configuration property `maxTaskRunTime` as an upper bound for task payload property `maxRunTime`. Tasks with `maxRunTime` exceeding this value will be resolved as `exception/malformed-payload`.

OTHER

▶ Additional changes not described here: [6482](https://github.com/taskcluster/taskcluster/issues/6482), [#6484](https://github.com/taskcluster/taskcluster/issues/6484).

Automated Package Updates

<details>
<summary>3 Dependabot/Renovate updates</summary>

* build(deps): bump taskcluster-taskgraph in /taskcluster (172ce2df5)
* build(deps): bump protobufjs from 6.11.3 to 6.11.4 (328acc638)
* build(deps): bump slugid from 3.2.0 to 4.0.0 in /clients/client (22eb08ae4)

</details>