HPC Cloud Updates WE 14 July 2024

Updates to AWS, Azure & GCP in the last week relevant for HPC practitioners

HPC Cloud Updates WE 14 July 2024

AWS

Ever wondered about running on AWS with YellowDog, especially in FSI? Well AWS have some details for you

Running FSI workloads on AWS with YellowDog | Amazon Web Services
Financial services firms: we stress-tested YellowDog’s HPC environment to see if it could handle a 10m task batch at 3,000 tasks per second. Check out the results.

AWS release r8g EC2 instance types. If you can run on ARM they might be worth a look. We will try them out with COREx soon!

Amazon EC2 R8g instances powered by AWS Graviton4 now generally available - AWS
Discover more about what’s new at AWS with Amazon EC2 R8g instances powered by AWS Graviton4 now generally available

AWS Batch on K8 with gang scheduling

AWS Batch now supports gang-scheduling on Amazon EKS using multi-node parallel jobs - AWS
Discover more about what’s new at AWS with AWS Batch now supports gang-scheduling on Amazon EKS using multi-node parallel jobs

If you’re using ValKey or Redis Amazon’s new client library GLIDE may be of interest

Announcing Valkey GLIDE, an open source client library for Valkey and Redis open source - AWS
Discover more about what’s new at AWS with Announcing Valkey GLIDE, an open source client library for Valkey and Redis open source

Azure

Azure Backup now supports bring your own key:

Generally Available: Encryption using Customer Managed Keys for Backup Vaults
Generally Available: Encryption using Customer Managed Keys for Backup Vaults

Running your HPC on AKS? Azure have some better observablilty for you:

Public Preview: Advanced Network Observability for your Azure Kubernetes Service clusters through Azure Monitor
Public Preview: Advanced Network Observability for your Azure Kubernetes Service clusters through Azure Monitor

GCP

Handy guide to IAM on GCP:

Scaling the IAM mountain: An in-depth guide to identity in Google Cloud | Google Cloud Blog
Identity and access management may seem like a gentle hill at first, but it gets steep fast. Here’s a guide to IAM terms and concepts to keep you on solid footing.