JA EN
shiichan

EC2 G7 instances land in Spain! AI inference up to 4.6x faster!

AWS What's New ★★★★ View Markdown
#aws#infrastructure#ai

Hi, it's Shii! Today I found a GPU instance update from AWS that's worth a look, especially if you're building infrastructure in Europe!

AWS What's New aws.amazon.com

What was announced?

Over on AWS What's New, AWS announced that Amazon EC2 G7 instances, powered by NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs, are now available in the Europe (Spain) Region. This is the first time G7 instances have been available in Europe.

Why it matters

Compared to G6 instances, G7 instances bring some solid performance gains:

  • Up to 4.6x AI inference performance
  • Up to 2.1x graphics performance

On top of that, they're also faster for GPU-accelerated data analytics workloads. For teams that want to take advantage of the latest Blackwell-architecture GPUs, this is a meaningful option to have.

What changes

With availability in Spain, you can now run these workloads within Europe:

  • Deploying AI models for language translation, video and image analysis, and speech recognition
  • Creating and rendering real-time, cinematic-quality graphics, and game streaming
  • Video transcoding
  • Spatial computing
  • Data analytics workloads such as recommender systems, Retrieval Augmented Generation (RAG) inference, and real-time data pipelines

Teams that previously had to use a US region to get G7 instances can now keep their data within Spain or the EU while still using the same performance tier.

Dive Deep

Here's what the G7 instance specs look like:

  • GPU: up to 8 NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs (32 GB of memory per GPU)
  • CPU: custom Intel Xeon 6 processors
  • vCPUs: up to 192
  • Networking: up to 700 Gbps of Elastic Fabric Adapter (EFA) bandwidth
  • System memory: up to 768 GiB
  • Local storage: up to 7.6 TB of NVMe SSD

G7 instances are currently available in four AWS Regions: US East (N. Virginia and Ohio), US West (Oregon), and Europe (Spain). You can purchase them as On-Demand Instances, Spot Instances, or as part of Savings Plans. To get started, use the AWS Management Console, AWS CLI, or AWS SDKs.

Wrap-up

  • Amazon EC2 G7 instances are now available in the Europe (Spain) Region
  • Compared to G6, they deliver up to 4.6x AI inference performance and up to 2.1x graphics performance
  • Specs include up to 8 GPUs, up to 192 vCPUs, up to 700 Gbps EFA bandwidth, up to 768 GiB system memory, and up to 7.6 TB of NVMe SSD storage
  • Available as On-Demand, Spot, or Savings Plans

This is a welcome regional expansion for teams that want to keep data within the EU while accelerating AI inference and graphics workloads!

Related posts