Aws-parallelcluster

------

**DEPRECATIONS**
- This is the last ParallelCluster release supporting Ubuntu 20.04
as Ubuntu 20.04 will be in End-Of-Standard-Support on May 2025.

**ENHANCEMENTS**
- Add support for Ubuntu 24.04.
Notice that ParallelCluster official AMI for Ubuntu 24.04 does not support Lustre.
- Disable unused services cups and wpa_supplicant from Official ParallelCluster AMIs to improve security.

**CHANGES**
- Upgrade Slurm to version 24.05.6.
- Upgrade NVIDIA driver to version 570.86.15 (from 550.127.08) for all OSs except AL2.
- Upgrade CUDA Toolkit to version 12.8.0 (from 12.4.1) for all OSs except AL2.
- Upgrade Python to 3.12.8 for all OSs except AL2 (from 3.9.20).
- On Ubuntu 22.04, install the Nvidia driver with the same compiler version used to compile the kernel.
- Upgrade aws-cfn-bootstrap to version 2.0-33.
- Upgrade EFA installer to 1.38.0 (from 1.36.0).
- Efa-driver: efa-2.13.0-1
- Efa-config: efa-config-1.17-1
- Efa-profile: efa-profile-1.7-1
- Libfabric-aws: libfabric-aws-1.22.0-1
- Rdma-core: rdma-core-54.0-1
- Open MPI: openmpi40-aws-4.1.7-1 and openmpi50-aws-5.0.5
- Upgrade amazon-efs-utils to version 2.1.0.
- Remove third-party cookbook: apt-7.5.22 and pyenv-4.2.3.
- Upgrade third-party cookbook dependencies:
- line-4.5.21 (from line-4.5.13)
- nfs-5.1.5 (from nfs-5.1.2)
- openssh-2.11.14 (from openssh-2.11.12)
- yum-7.4.20 (from yum-7.4.13)
- yum-epel-5.0.8 (from yum-epel-5.0.2)
- Upgrade Pmix to 5.0.6 (from 5.0.3).
- Upgrade ARM PL to version 24.10 (from 23.10).
- Upgrade Python to version 3.12.8 (from 3.9.17) in Lambda layer and installer.
- Upgrade NodeJS to version 20.18.3 (from 18.20.3) in Lambda layer and installer.
- Remove generation of DSA keys for login nodes as DSA, which became unsupported in OpenSSH 9.7+.
- Set instance ID and instance type information in Slurm upon compute nodes launch.
- Install NVIDIA drivers without the option 'no-cc-version-check', which is now deprecated in the NVIDIA installer.
- Add validator to enforce up to 10- login node pools.
- Update the default root volume size to 45 GB.

**BUG FIXES**
- Remove usage of cfn-init for compute node bootstrapping to reduce node scale up time.
- Fix an issue causing compute node bootstrap failure when a proxy is used.
- On Ubuntu 22.04, install the Nvidia driver with the same compiler version used to compile the kernel
to prevent inmstallation failures.- Fix the execution of overriding aws-parallelcluster-node package only on the head node during update.
- Fix an issue where containerized jobs executed through Pyxis/Enroot in a multi-user environment (integrated with Active Directory) would fail.
- Fix usage of authselect causing node bootstrap failures on Rocky 9.5+ when directory service is used.

------

**ENHANCEMENTS**
- Add new build image configuration section `Build/Installation` to turn on/off Nvidia software and Lustre client installations. By default, Nvidia software, although included in official ParallelCluster AMIs, is not installed by `build-image`. By default, Lustre client is installed.
- The CLI commands `export-cluster-logs` and `export-image-logs` can now by default export the logs to the default ParallelCluster bucket or to the CustomS3Bucket if specified in the config.
- Extend Amazon DCV support to Ubuntu2204 on ARM instances.
- Add new parameter 'ParallelClusterFunctionAdditionalPolicies' to the ParallelCluster API stack to add custom permissions for the API Lambda role, on top of the default ones.

**CHANGES**
- Upgrade NVIDIA driver to version 550.127.08 (from 550.90.07). This addresses [a known issue from Nivdia](https://docs.nvidia.com/datacenter/tesla/tesla-release-notes-550-90-07/index.html#known-issues).
- Upgrade Amazon DCV to version `2024.0-18131`.
- server: `2024.0-18131-1`
- xdcv: `2024.0.631-1`
- gl: `2024.0.1078-1`
- web_viewer: `2024.0-18131-1`
- Upgrade EFA installer to `1.36.0`.
- Efa-driver: `efa-2.13.0-1`
- Efa-config: `efa-config-1.17-1`
- Efa-profile: `efa-profile-1.7-1`
- Libfabric-aws: `libfabric-aws-1.22.0-1`
- Rdma-core: `rdma-core-54.0-1`
- Open MPI: `openmpi40-aws-4.1.7-1` and `openmpi50-aws-5.0.5`
- Auto-restart slurmctld on failure.
- Upgrade mysql-community-client to version 8.0.39.
- Remove support for Python 3.7 and 3.8, which are in end of life.

**BUG FIXES**
- Fix an issue where changes in sequence of custom actions scripts were not detected during cluster updates.
- Add missing permissions for ParallelCluster API to create the service linked roles for Elastic Load Balancing and Auto Scaling, that are required to deploy login nodes.
- Fix retrieval of regions when managing volumes to correctly handle local zones.
- Fix an issue where adding EFS filesystems with AccessPointIds during an update would fail.
- Fix an issue where when using PCAPI, cluster update could fail when updating a parameter that is not type `String` (e.g. `MaxCount`).
- When mounting an external OpenZFS, it is no longer required to set the outbound rules for ports 111, 2049, 20001, 20002, 20003.

------

**CHANGES**
- Pyxis is now disabled by default, so it must be manually enabled as documented in the product documentation.
- Upgrade Python runtime to version 3.12 in ParallelCluster Lambda Layer.
- Remove version pinning for setuptools to version prior to 70.0.0.
- Upgrade libjwt to version 1.17.0.

**BUG FIXES**
- Fix an issue in the way we configure the Pyxis Slurm plugin in ParallelCluster that can lead to job submission failures.
https://github.com/aws/aws-parallelcluster/issues/6459
- Fix an issue that was causing failing deployment in configurations with login nodes
by add missing permissions required by login nodes in the public template of policies.
https://github.com/aws/aws-parallelcluster/issues/6483

------

**ENHANCEMENTS**
- Add support for custom actions on login nodes.
- Allow DCV connection to login nodes.
- Add support for ap-southeast-3 region.
- Add security groups to login node network load balancer.
- Add `AllowedIps` configuration for login nodes.
- Add new configuration `SharedStorage/EfsSettings/AccessPointId` to specify an optional EFS access point for a mount
- Allow up to 10 login node pools.
- Install enroot and pyxis in official pcluster AMIs

**CHANGES**
- *[BREAKING]* The `loginNodes` field returned by the API `DescribeCluster` and the CLI command `describe-cluster`
has been changed from a dictionary to an array to support multiple pools of login nodes.
This change breaks backward compatibility, making these operations incompatible with clusters deployed with older versions.
- Upgrade Slurm to 23.11.10 (from 23.11.7).
- Upgrade Pmix to 5.0.3 (from 5.0.2).
- Upgrade EFA installer to `1.34.0`.
- Efa-driver: `efa-2.10.0-1`
- Efa-config: `efa-config-1.17-1`
- Efa-profile: `efa-profile-1.7-1`
- Libfabric-aws: `libfabric-aws-1.22.0-1`
- Rdma-core: `rdma-core-52.0-1`
- Open MPI: `openmpi40-aws-4.1.6-3` and `openmpi50-aws-5.0.3-11`
- Upgrade NVIDIA driver to version 550.90.07 (from 535.183.01).
- Upgrade CUDA Toolkit to version 12.4.1 (from 12.2.2).
- Upgrade Python to 3.9.20 (from 3.9.19).
- Upgrade Intel MPI Library to 2021.13.1.769 (from 2021.12.1.8).

**BUG FIXES**
- Fix validator `EfaPlacementGroupValidator` so that it does not suggest to configure a Placement Group when Capacity Blocks are used.
- Fix sporadic cluster creation failures with managed FSx for Lustre.
- Fix cluster deletion failure when placement group is enabled.
- Fix issue with login nodes being marked unhealthy when restricting SSH access.
- Fix `retrieve_supported_regions` so that it can get the correct S3 url.
- Fix `describe_images` so that it uses pagination.
- Fix `No route tables found` bug when specifying default VPC subnet to LoginNodes/Networking/SubnetIds.

------

**BUG FIXES**
- Fix image build failure in China regions.

------

**ENHANCEMENTS**
- Add new configuration section `Scheduling/SlurmSettings/ExternalSlurmdbd` to connect the cluster to an external Slurmdbd.
- Allow build-image to be run in an isolated network.
- Add support for Amazon Linux 2023.
- Add support for `price-capacity-optimized` as an `AllocationStrategy`.
- Add validator to prevent the use of Placement Groups with Capacity Blocks.

**CHANGES**
- CentOS 7 is no longer supported.
- Upgrade Cinc Client to version to 18.4.12 from 18.2.7.
- Upgrade munge to version 0.5.16 (from 0.5.15).
- Upgrade Pmix to 5.0.2 (from 4.2.9).
- Upgrade third-party cookbook dependencies:
- apt-7.5.22 (from apt-7.5.14)
- openssh-2.11.12 (from openssh-2.11.3)
- Remove third-party cookbook: selinux-6.1.12.
- Upgrade EFA installer to `1.32.0`.
- Efa-driver: `efa-2.8.0-1`
- Efa-config: `efa-config-1.16-1`
- Efa-profile: `efa-profile-1.7-1`
- Libfabric-aws: `libfabric-aws-1.21.0-1`
- Rdma-core: `rdma-core-50.0-1`
- Open MPI: `openmpi40-aws-4.1.6-3` and `openmpi50-aws-5.0.2-12`
- Upgrade NVIDIA driver to version 535.183.01 (from 535.154.05).
- Upgrade Python to 3.9.19 (from 3.9.17).
- Upgrade Intel MPI Library to 2021.12.1.8 (from 2021.9.0.43482).

**BUG FIXES**
- Fix Data Repository Associations configuration to make `AutoExportPolicy` and `AutoImportPolicy` optional.
- Fixed an issue during cluster deletion that now completes compute fleet cleanup when instances are either in shutting-down or terminated state.
This is to avoid cluster deletion failures for instance types with longer termination cycles.
- Allow cloudwatch dashboard to be enabled and alarms to be disabled in the `Monitoring` section of the cluster config.
- Allow ParallelCluster Custom Resource to suppress validators using `PclusterCluster/SuppressValidators`.
- Removing `/etc/profile.d/pcluster.sh` so that it's not executed at every user login and
`cfn_bootstrap_virtualenv` is not added in PATH environment variable.
- Fix ParallelCluster API spec by replacing field `failureReason` with `failures` in `DescribeCluster` response.
- Fix ParallelCluster API spec by adding the CloudFormation stack status that were missing:
`IMPORT_*`, `REVIEW_IN_PROGRESS` and `UPDATE_FAILED`.
- Fix an issue that prevented cluster updates from including EFS filesystems with encryption in transit.
- Fix an issue that prevented slurmctld and slurmdbd services from restarting on head node reboot when
EFS is used for shared internal data.
- On Ubuntu systems, remove default logrotate configuration for cloud-init log files that clashed with the
configuration coming from Parallelcluster.
- Fix image build failure with RHEL 8.10 or newer.