Aws-parallelcluster

Latest version: v3.11.1

Safety actively analyzes 682387 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 6 of 16

3.0.1

Not secure
------

**ENHANCEMENTS**
- Add `pcluster3-config-converter` CLI command to convert cluster configuration from ParallelCluster 2 to ParallelCluster 3 version.
- The region parameter is now retrieved from the provider chain, thus supporting the use of profiles and defaults
specified in the `~/.aws/config` file.
- export `ParallelClusterApiInvokeUrl` and `ParallelClusterApiUserRole` in CloudFormation API Stack so they can be
used by cross-stack references.

**CHANGES**
- Drop support for SysVinit. Only Systemd is supported.
- Include tags from cluster configuration file in the RunInstances dry runs performed during configuration validation.
- Allow '*' character in the configuration of S3Access/BucketName.

**BUG FIXES**
- Pin to the transitive dependencies resulting from the dependency on connexion.
- Fix cleanup of ECR resources when API infrastructure template is deleted.
- Fix supervisord service not enabled on Ubuntu. This was causing supervisord not to be started on instance reboot.
- Update ca-certificates package during AMI build time and have Cinc use the updated CA certificates bundle.
- Close stderr before exiting from pcluster CLI commands to avoid BrokenPipeError for processes that close the
other end of the stdout pipe.

3.0.0

Not secure
------

**ENHANCEMENTS**
- Add support for pcluster actions (e.g., create-cluster, update-cluster, delete-cluster) through HTTP endpoints
with Amazon API Gateway.
- Revamp custom AMI creation and management by leveraging EC2 Image Builder. This also includes the implementation of
`build-image`, `delete-image`, `describe-image` and `list-image` commands to manage custom ParallelCluster images.
- Add `list-official-images` command to describe ParallelCluster official AMIs.
- Add `export-cluster-logs`, `list-cluster-logs` and `get-cluster-log-events` commands to retrieve both CloudWatch Logs
and CloudFormation Stack Events. Add `export-image-logs`, `list-image-logs` and `get-image-log-events` commands to
retrieve both Image Builder Logs and CloudFormation Stack Events.
- Enable the possibility to restart / reboot the head node also for instance types with
[instance store](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/InstanceStorage.html).
Those operations remain anyway managed by the user that is responsible for the status of the cluster while operating
on the head node, e.g. stopping the compute fleet first.
- Add support to use an existing Private Route53 Hosted Zone when using Slurm as scheduler.
- Add the possibility to configure the instance profile as alternative to configuring the IAM role for the head and for
each compute queue.
- Add the possibility to configure IAM role, profile and policies for head node and for each compute queue.
- Add possibility to configure different security groups for each queue.
- Allow full control on the name of CloudFormation stacks created by ParallelCluster by removing the `parallelcluster-`
prefix.
- Add multiple queues and compute resources support for pcluster configure when the scheduler is Slurm.
- Add prompt for availability zone in pcluster configure automated subnets creation.
- Add configuration `HeadNode / Imds / Secured` to enable/disable restricted access to Instance Metadata Service (IMDS).
- Implement scaling protection mechanism with Slurm scheduler: compute fleet is automatically set to 'PROTECTED'
state in case recurrent failures are encountered when provisioning nodes.
- Add `--suppress-validators` and `--validation-failure-level` parameters to `create` and `update` commands.
- Add support for associating an existing Elastic IP to the head node.
- Extend limits for supported number of Slurm queues (10) and compute resources (5).
- Encrypt root EBS volumes and shared EBS volumes by default. Note that if the scheduler is AWS Batch, the root volumes
of the compute nodes cannot be encrypted by ParallelCluster.

**CHANGES**
- Upgrade EFA installer to version 1.13.0
- EFA configuration: ``efa-config-1.9``
- EFA profile: ``efa-profile-1.5``
- EFA kernel module: ``efa-1.13.0``
- RDMA core: ``rdma-core-35``
- Libfabric: ``libfabric-1.13.0``
- Open MPI: ``openmpi40-aws-4.1.1-2``
- Upgrade NICE DCV to version 2021.1-10851.
- Upgrade Slurm to version 20.11.8.
- Upgrade NVIDIA driver to version 470.57.02.
- Upgrade CUDA library to version 11.4.0.
- Upgrade Cinc Client to version 17.2.29.
- Upgrade Python runtime used by Lambda functions in AWS Batch integration to python3.8.
- Remove support for SGE and Torque schedulers.
- Remove support for CentOS8.
- Change format and syntax of the configuration file to be used to create the cluster, from ini to YAML. A cluster configuration
file now only includes the definition of a single cluster.
- Remove `--cluster-template`, `--extra-parameters` and `--tags` parameters for the `create` command.
- Remove `--cluster-template`, `--extra-parameters`, `--reset-desired` and `--yes` parameters for the `update` command.
- Remove `--config` parameter for `delete`, `status`, `start`, `stop`, `instances` and `list` commands.
- Remove possibility to specify aliases for `ssh` command in the configuration file.
- Distribute AWS Batch commands: `awsbhosts`, `awsbkill`, `awsbout`, `awsbqueues`, `awsbstat` and `awsbsub` as a
separate `aws-parallelcluster-awsbatch-cli` PyPI package.
- Add timestamp suffix to CloudWatch Log Group name created for the cluster.
- Remove `pcluster-config` CLI utility.
- Remove `amis.txt` file.
- Remove additional EBS volume attached to the head node by default.
- Change NICE DCV session storage path to `/home/{UserName}`.
- Create a single ParallelCluster S3 bucket for each AWS region rather than for each cluster.
- Adopt inclusive language
- Rename MasterServer to HeadNode in CLI outputs.
- Rename variable exported in the AWS Batch job environment from MASTER_IP to PCLUSTER_HEAD_NODE_IP.
- Rename all CFN outputs from Master* to HeadNode*.
- Rename NodeType and tags from Master to HeadNode.
- Rename tags (Note: the following tags are crucial for ParallelCluster scaling logic):
- `aws-parallelcluster-node-type` -> `parallelcluster:node-type`
- `ClusterName` -> `parallelcluster:cluster-name`
- `aws-parallelcluster-attributes` -> `parallelcluster:attributes`
- `Version` -> `parallelcluster:version`
- Remove tag: `Application`.
- Remove [runtime creation method](https://docs.aws.amazon.com/parallelcluster/latest/ug/tutorials_02_ami_customization.html)
of custom ParallelCluster AMIs.
- Retain CloudWatch logs on cluster deletion by default. If you want to delete the logs during cluster deletion, set
`Monitoring / Logs / CloudWatch / RetainOnDeletion` to False in the configuration file.
- Remove instance store software encryption option (encrypted_ephemeral) and rely on default hardware encryption provided
by NVMe instance store volumes.
- Add tag 'Name' to every shared storage with the value specified in the shared storage name config.
- Remove installation of MPICH and FFTW packages.
- Remove Ganglia support.
- Disable unattended packages update on Ubuntu.

2.11.3

Not secure
-----

**CHANGES**
- Upgrade EFA installer to version 1.14.1. Thereafter, EFA enables GDR support by default on supported instance type(s).
ParallelCluster does not reinstall EFA during node start.
Previously, EFA was reinstalled if `enable_efa_gdr` had been turned on in the configuration file.
The `enable_efa_gdr` parameter has no effect and should no longer be used.
- EFA configuration: ``efa-config-1.9-1``
- EFA profile: ``efa-profile-1.5-1``
- EFA kernel module: ``efa-1.14.2``
- RDMA core: ``rdma-core-37.0``
- Libfabric: ``libfabric-1.13.2``
- Open MPI: ``openmpi40-aws-4.1.1-2``
- Include tags from cluster configuration file in the RunInstances dry runs performed during configuration validation.

**BUG FIXES**
- Fix the create custom AMI functionality issues:
- SGE download URL no more reachable. Use Debian repository to download SGE source archive.
- Outdated CA certificates used by Cinc. Update ca-certificates package during AMI build time.
- Fix cluster update when using proxy setup.

2.11.2

Not secure
-----

**CHANGES**
- When using a custom AMI with a preinstalled EFA package, no actions are taken at node bootstrap time in case GPUDirect RDMA is enabled. The original EFA package deployment is preserved as during the createami process.

**BUG FIXES**
- Lock the version of ``nvidia-fabricmanager`` package to the installed NVIDIA drivers to prevent updates and misalignments.
- Slurm: fix issue that prevented powering-up nodes to be correctly reset after a stop and start of the cluster.

2.11.1

Not secure
-----

**CHANGES**
- Restore ``noatime`` option, which has positive impact on the performances of NFS filesystem.
- Upgrade EFA installer to version 1.12.3
- EFA configuration: ``efa-config-1.9`` (from ``efa-config-1.8-1``)
- EFA kernel module: ``efa-1.13.0`` (from ``efa-1.12.3``)

**BUG FIXES**
- Pin to version 1.247347 of the CloudWatch agent due to performance impact of latest CW agent version 1.247348.
- Avoid failures when building SGE using instance type with vCPU >=32.

2.11.0

Not secure
------

**ENHANCEMENTS**
- Add support for Ubuntu 20.04.
- Add support for using FSx Lustre in subnet with no internet access.
- Add support for building Centos 7 AMIs on ARM.
- Add support for FSx Lustre DataCompressionType feature.
- Add validation to prevent using a `cluster_resource_bucket` that is in a different region than the cluster.
- Install SSM agent on CentOS 7 and 8.
- Add support for `security_group_id` in packer custom builders. Customers can export `AWS_SECURITY_GROUP_ID` environment variable to specify security group for custom builders when building custom AMIs.
- SGE: always use shortname as hostname filter with `qstat`. This will make nodewatcher more robust when using custom DHCP option, where the full hostname seen by `SGE` might differ from the hostname returned from EC2 metadata(local-hostname).
- Transition from IMDSv1 to IMDSv2.

**CHANGES**
- Ubuntu 16.04 is no longer supported.
- Amazon Linux is no longer supported.
- Make `key_name` parameter optional to support cluster configurations without a key pair.
- Remove support for Python versions < 3.6.
- Remove dependency on `future` package and `__future__` module.
- Root volume size increased from 25GB to 35GB on all AMIs. Minimum root volume size is now 35GB.
- Add sanity check to prevent cluster creation in an AWS region not officially supported by ParallelCluster.
- Restrict IAM permissions to only allow cluster IAM instance role to launch instances via `run-instances` in cluster compute subnet.
- Upgrade EFA installer to version 1.12.2
- EFA configuration: ``efa-config-1.8-1`` (from ``efa-config-1.7``)
- EFA profile: ``efa-profile-1.5-1`` (from ``efa-profile-1.4``)
- EFA kernel module: ``efa-1.12.3`` (from ``efa-1.10.2``)
- RDMA core: ``rdma-core-32.1amzn`` (from ``rdma-core-31.2amzn``)
- Libfabric: ``libfabric-1.11.2amzon1.1-1`` (from ``libfabric-1.11.1amzn1.0``)
- Open MPI: ``openmpi40-aws-4.1.1-2`` (from ``openmpi40-aws-4.1.0``)
- Upgrade Slurm to version 20.11.7.
- Update slurmctld and slurmd systemd unit files according to latest provided by slurm.
- Add new SlurmctldParameters, power_save_min_interval=30, so power actions will be processed every 30 seconds.
- Add new SlurmctldParameters, cloud_reg_addrs, which will reset a node's NodeAddr automatically on power_down.
- Specify instance GPU model as GRES GPU Type in gres.conf, instead of previous hardcoded value ``Type=tesla`` for all GPU.
- Upgrade Arm Performance Libraries (APL) to version 21.0.0.
- Upgrade NICE DCV to version 2021.1-10557.
- Upgrade NVIDIA driver to version 460.73.01.
- Upgrade CUDA library to version 11.3.0.
- Upgrade NVIDIA Fabric manager to `nvidia-fabricmanager-460`.
- Install ParallelCluster AWSBatch CLI in dedicated python3 virtual env.
- Upgrade Python version used in ParallelCluster virtualenvs from version 3.6.13 to version 3.7.10.
- Upgrade Cinc Client to version 16.13.16.
- Upgrade third-party cookbook dependencies:
- apt-7.4.0 (from apt-7.3.0)
- iptables-8.0.0 (from iptables-7.1.0)
- line-4.0.1 (from line-2.9.0)
- openssh-2.9.1 (from openssh-2.8.1)
- pyenv-3.4.2 (from pyenv-3.1.1)
- selinux-3.1.1 (from selinux-2.1.1)
- ulimit-1.1.1 (from ulimit-1.0.0)
- yum-6.1.1 (from yum-5.1.0)
- yum-epel-4.1.2 (from yum-epel-3.3.0)
- Drop ``lightdm`` package install from Ubuntu 18.04 DCV installation process.

**BUG FIXES**
- Use ICP-compliant AL2 repo URLs when building Docker images in China
- Fix a bug that caused `clustermgtd` to not immediately replace instances with failed status check that are in replacement process.

Page 6 of 16

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.