HPC Cloud Updates WE 08 Dec 2024

Updates to AWS, Azure & GCP in the last week relevant for HPC practitioners

HPC Cloud Updates WE 08 Dec 2024

AWS

There was no shortage of news this week from AWS having been the week of re:Invent. Just the HPC specific bits below though, see your usual favourite tech news site for an update on all the rest (including AI related news). Or just see AWS’ own post.

Top announcements of AWS re:Invent 2024 | Amazon Web Services
Don’t miss our biggest announcements! Visit this post throughout the week to stay up-to-date with quick recaps and links, organized by category, for all the most important AWS product news.

Want to build a high speed file cache on AWS for $4 an hour? They’ve got a handy blog for that now. Using just an EC2 instance instead of one of their service based offerings.

Accelerating file reads with a storage caching server | Amazon Web Services
Looking to boost storage performance for your #HPC workloads on AWS? Find out how to build a high-speed EC2 cache for under $4/hour that’s fit for purpose in this new blog post.

New NVIDIA H200 based p5en EC2 instances with EFAv3 networking

New Amazon EC2 P5en instances with NVIDIA H200 Tensor Core GPUs and EFAv3 networking | Amazon Web Services
Amazon EC2 P5en instances deliver up to 3,200 Gbps network bandwidth with EFAv3 for accelerating deep learning, generative AI, and HPC workloads with unmatched efficiency.
Amazon EC2 P5en instances, optimized for generative AI and HPC, are generally available - AWS
Discover more about what’s new at AWS with Amazon EC2 P5en instances, optimized for generative AI and HPC, are generally available

and trn2 based instances for AI training

Amazon EC2 Trn2 Instances and Trn2 UltraServers for AI/ML training and inference are now available | Amazon Web Services
With 4x faster speed, 4x more memory bandwidth, 3x higher memory capacity than predecessors, and 30% higher floating-point operations, these instances deliver unprecedented compute power for ML training and gen AI.
Amazon EC2 Trn2 instances are generally available - AWS
Discover more about what’s new at AWS with Amazon EC2 Trn2 instances are generally available

Not directly HPC related but possibly quite useful for shovelling data around in HPC contexts, S3 now has tabular data and queryable objects and you can also browse them a bit more easily now. Cheap results store anyone?

Introducing queryable object metadata for Amazon S3 buckets (preview) | Amazon Web Services
Unlock S3 data insights effortlessly with AWS’ rich metadata capture; query objects by key, size, tags, and more using Athena, Redshift, and Spark at scale.
New Amazon S3 Tables: Storage optimized for analytics workloads | Amazon Web Services
Amazon S3 Tables optimize tabular data storage (like transactions and sensor readings) in Apache Iceberg, enabling high-performance, low-cost queries using Athena, EMR, and Spark.
Storage Browser for Amazon S3 is now generally available - AWS
Discover more about what’s new at AWS with Storage Browser for Amazon S3 is now generally available

Paris gets some HPC specific EC2 instance, hpc6id and hpc7a more specifically

Amazon EC2 Hpc6id instances are now available in Europe (Paris) region - AWS
Discover more about what’s new at AWS with Amazon EC2 Hpc6id instances are now available in Europe (Paris) region
Amazon EC2 Hpc7a instances are now available in Europe (Paris) region - AWS
Discover more about what’s new at AWS with Amazon EC2 Hpc7a instances are now available in Europe (Paris) region

New storage optimised Graviton based i8 EC2 instances now also available but only N. Virginia and Oregon for now

Announcing Amazon EC2 I8g instances - AWS
Discover more about what’s new at AWS with Announcing Amazon EC2 I8g instances

Again, not HPC specific but this has the potential to make like and creating landing zones in large orgs (including those that run HPC in multiple applications for example) easier

Amazon Web Services announces declarative policies - AWS
Discover more about what’s new at AWS with Amazon Web Services announces declarative policies

Azure

Two weeks. That’s how long the new Azure updates site has managed to stay up for. It’s now dead. I’d like to tell you what’s new, but Microsoft don’t seem to want to tell me so I  can’t. 

Maybe they just figured with re:Invent going on now would be a good time to take a break.


Google Cloud

Registration for Google Cloud Next is now open if that’s your thing

Registration open for Google Cloud Next ’25 | Google Cloud Blog
Registration is open for Google Cloud Next, which returns to Las Vegas, April 9–11, 2025, with early bird pricing through February 14, 2025.

New region launched in Mexico!

Google Cloud announces 41st cloud region in Mexico | Google Cloud Blog
Google Cloud is excited to announce the launch of its 41st cloud region in Querétaro, Mexico.