v1.11.0: Usability Improvements for GPUs, Validation of use Field, & Miscellaneous Slurm Improvements

[nick-stroud]

Key New Features

• GPU type and count is automatically populated when using A2 series machines for vm-instance and Slurm v5 node-group, controller, & login-node.
• ghpc now validates that modules linked using the use field have common outputs and settings.

Resource Improvements

• startup-script: Added option to use an existing Google Cloud Storage bucket.
• Slurm v5 partition: Now supports partition level startup scripts.
• Slurm v5 controller & login-node: Now has the option to use instance templates.
• Slurm v5 node-group, controller, & login-node: Now supports labels on disks.
• Slurm v5 node-group: Added option to enable public IPs.
• Slurm v4 partition: Compute nodes pick up new version within image family.
• Slurm v4 partition, controller, & login-node: Image can now be specified by name, in addition to family.

Version updates

• Google Terraform Provider pinned to version 4.48.0 and will be bumped with each future release.

What's Changed

• Strip newlines chars before searching for startup failure by @nick-stroud in Strip newlines chars before searching for startup failure #783
• Allow local disk labels, merged with var.labels by @heyealex in Allow local disk labels, merged with var.labels #764
• Add PBS Pro integration test by @tpdownes in Add PBS Pro integration test #782
• Add a validator for unused modules in the "use" list by @heyealex in Add a validator for unused modules in the "use" list #760
• Bump google.golang.org/api from 0.104.0 to 0.105.0 by @dependabot in Bump google.golang.org/api from 0.104.0 to 0.105.0 #786
• Fix Quantum AI example by pinning to g++ 10 instead of 11 by @tpdownes in Fix Quantum AI example by pinning to g++ 10 instead of 11 #788
• Make URL for deployment tarball cut-and-paste-able. by @tpdownes in Make URL for deployment tarball cut-and-paste-able. #789
• Add no_comma_params option in "cloud_parameters" by @heyealex in Add no_comma_params option in "cloud_parameters" #765
• Add partition level startup script variables by @heyealex in Add partition level startup script variables #785
• Add slurm gcp v5 integration test with startup scripts by @heyealex in Add slurm gcp v5 integration test with startup scripts #790
• Increase HTCondor installation timeout by @tpdownes in Increase HTCondor installation timeout #792
• Run dependabot at repeatable weekly interval by @tpdownes in Run dependabot at repeatable weekly interval #793
• Add disable_public_ips option to node group module by @heyealex in Add disable_public_ips option to node group module #791
• Sourcereader wrapfs workaround by @thiagosgobe in Sourcereader wrapfs workaround #748
• Updating develop post-release of 1.10.1 by @nick-stroud in Updating develop post-release of 1.10.1 #801
• Add option to set instance template for login and controller slurm-gcp v5 modules by @heyealex in Add option to set instance template for login and controller slurm-gcp v5 modules #787
• Remove singularity install to avoid failed package install by @heyealex in Remove singularity install to avoid failed package install #804
• Bump github.com/go-git/go-billy/v5 from 5.3.1 to 5.4.0 by @dependabot in Bump github.com/go-git/go-billy/v5 from 5.3.1 to 5.4.0 #802
• Automate gpu guest accelerator in vm-instance if not set by @heyealex in Automate gpu guest accelerator in vm-instance if not set #805
• Bump google.golang.org/api from 0.105.0 to 0.106.0 by @dependabot in Bump google.golang.org/api from 0.105.0 to 0.106.0 #806
• Apply gpu_definition to slurm modules by @heyealex in Apply gpu_definition to slurm modules #807
• Bump cloud.google.com/go/serviceusage from 1.4.0 to 1.5.0 by @dependabot in Bump cloud.google.com/go/serviceusage from 1.4.0 to 1.5.0 #809
• Bump cloud.google.com/go/compute from 1.14.0 to 1.15.0 by @dependabot in Bump cloud.google.com/go/compute from 1.14.0 to 1.15.0 #808
• Modification to handling of django key to keep it local only to webse… by @mattstreet-nag in Modification to handling of django key to keep it local only to webse… #755
• Pass family through instead of looking up image to allow compute nodes to pick up new version within family by @nick-stroud in Pass family through instead of looking up image to allow compute nodes to pick up new version within family #810
• Fix broken link to application tutorial diagram by @nick-stroud in Fix broken link to application tutorial diagram #813
• Enable Slurm v4 image to be specified by name by @nick-stroud in Enable Slurm v4 image to be specified by name #814
• Add slash to network storage output for pre-existing file systems by @heyealex in Add slash to network storage output for pre-existing file systems #812
• Bump google provider max version to 4.47.0 by @cboneti in Bump google provider max version to 4.47.0 #818
• Enable cleanup of active compute nodes on destroy for high io test by @nick-stroud in Enable cleanup of active compute nodes on destroy for high io test #819
• Bump github.com/aws/aws-sdk-go from 1.15.78 to 1.33.0 by @dependabot in Bump github.com/aws/aws-sdk-go from 1.15.78 to 1.33.0 #821
• Move directory check to after embedded checks by @heyealex in Move directory check to after embedded checks #822
• Adding support for existing GCS bucket in startup script module. by @soumyapani in Adding support for existing GCS bucket in startup script module. #820
• Update TF google provider version to 4.48 by @heyealex in Update TF google provider version to 4.48 #823
• Rolling version to 1.11.0 by @nick-stroud in Rolling version to 1.11.0 #841
• Release v1.11.0 by @nick-stroud in Release v1.11.0 #837
• Allow Dependabot YAML parser to read time value by @tpdownes in Allow Dependabot YAML parser to read time value #842

New Contributors

• @soumyapani made their first contribution in Adding support for existing GCS bucket in startup script module. #820

Full Changelog: v1.10.1...v1.11.0

---

This discussion was created from the release v1.11.0: Usability Improvements for GPUs, Validation of `use` Field, & Miscellaneous Slurm Improvements.