# Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters

Source: [Artificial Intelligence](https://aws.amazon.com/blogs/machine-learning/introducing-amazon-sagemaker-hyperpod-global-inference-gateway-one-endpoint-across-regions-and-clusters/) · 2026-11-20 · AI
Page: https://themorning.dev/story/introducing-amazon-sagemaker-hyperpod-global-inference-gateway-one-endpoint-acro-62e6c491de1f0645
Kind: release · Impact: medium

## In brief

- Amazon SageMaker HyperPod Global Inference Gateway provides one endpoint across multiple HyperPod clusters and AWS Regions.
- It routes inference requests to clusters with available GPU capacity instead of leaving requests queued on a saturated cluster.
- The source describes the problem it targets: idle GPUs on another cluster, sometimes in another Region, cannot be reached during traffic peaks.

## Why it matters

Teams running inference on multiple HyperPod clusters can use spare capacity during traffic peaks without managing routing across endpoints themselves.

## Timeline

- 2026-11-20: AWS published the blog post introducing the HyperPod Global Inference Gateway

## Coverage

- [Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters](https://aws.amazon.com/blogs/machine-learning/introducing-amazon-sagemaker-hyperpod-global-inference-gateway-one-endpoint-across-regions-and-clusters/) — Artificial Intelligence, 2026-11-20

Tags: aws, sagemaker, inference, gpu, multi-region, machine-learning

---

Brief generated by AI (claude-haiku-5-5) from the reporting listed under Coverage. Headlines belong to their publishers. The Morning Dev – https://themorning.dev
