Taskcluster

GENERAL

▶ [patch]
Upgrade Node.js to 18.17.0.

ADMINS

▶ [patch] [6405](https://github.com/taskcluster/taskcluster/issues/6405)
Expire artifacts job no longer logs errors for each missing artifact. Instead it reports the number of missing artifacts at the end of the job.

USERS

▶ [patch]
Adds a task log letting the user know their Docker Worker payload is being converted to a Generic Worker payload using d2g.

Automated Package Updates

<details>
<summary>1 Dependabot/Renovate updates</summary>

* build(deps): bump aiohttp from 3.8.4 to 3.8.5 in /taskcluster (56a9903ae)

</details>

USERS

▶ [minor] [5961](https://github.com/taskcluster/taskcluster/issues/5961)
Generic Worker now supports the `osGroups` feature on macOS, Linux and
FreeBSD. Support was already added to Windows in Generic Worker 6.0.0.

Example Linux/macOS task (requires `docker` to be installed on worker):


created: <timestamp>
deadline: <timestamp>
workerType: my-worker-type
provisionerId: mv-provisioner-id
scopes:
- generic-worker:os-group:my-provisioner-id/my-worker-type/docker
payload:
osGroups:
- docker
command:
- - docker
- run
- --rm
- ubuntu:latest
- /usr/bin/echo
- hello
maxRunTime: 60
metadata:
name: Ubuntu - docker test
owner: pmooremozilla.com
source: https://github.com/taskcluster/taskcluster/pull/6397
description: Test calling docker from a Generic Worker task

GENERAL

▶ [patch] [6420](https://github.com/taskcluster/taskcluster/issues/6420)
Fixes generic worker issue where artifacts were no longer being uploaded.

ADMINS

▶ [patch] [6405](https://github.com/taskcluster/taskcluster/issues/6405)
Expire artifacts handles the case where the artifact is not found during deletion. GCS behaves differently to S3 here, as it will throw an error if the artifact is not found, where S3 would always return 204.

USERS

▶ [minor] [5967](https://github.com/taskcluster/taskcluster/issues/5967)
This change integrates the `d2g` tool into Generic Worker so that it can accept a valid, Docker Worker payload.

▶ [patch] [6417](https://github.com/taskcluster/taskcluster/issues/6417)
Generic Worker: Interactive sessions suffered from a race condition that was introduced in Generic Worker 54.2.0. This has been fixed.

USERS

▶ [minor] [6405](https://github.com/taskcluster/taskcluster/issues/6405)
Expire artifacts supports both bulk deletion and single deletion. This can be configured for the deployment using `AWS_USE_BULK_DELETE` environment variable (`false` by default). This is needed because not all S3 compatible storages support bulk delete, specifically [GCS](https://cloud.google.com/storage/docs/migrating#methods-comparison).
`EXPIRE_ARTIFACTS_BATCH_SIZE` can be used to control how many records to process at once, i.e. how many parallel delete requests would be sent to storage service (`100` by default).

DEVELOPERS

▶ [patch] [6395](https://github.com/taskcluster/taskcluster/issues/6395)
Fixed local development environment where artifacts could not be loaded in the UI. This was caused by not using pinned `minio/*` images.

▶ [patch] [6395](https://github.com/taskcluster/taskcluster/issues/6395)
Local development environment now supports live log.

GENERAL

▶ [patch]
Upgrades to go1.20.6 which is a security release.

>go1.20.6 (released 2023-07-11) includes a security fix to the net/http package, as well as bug fixes to the compiler, cgo, the cover tool, the go command, the runtime, and the crypto/ecdsa, go/build, go/printer, net/mail, and text/template packages. See the [Go 1.20.6 milestone](https://github.com/golang/go/issues?q=milestone%3AGo1.20.6+label%3ACherryPickApproved) on our issue tracker for details.

USERS

▶ [patch]
Hooks page improvements: extra schedule and exchanges displayed as Badge with a proper tooltip.