Accelerate agentic AI with NVIDIA Nemotron models on Amazon EKS and SageMaker HyperPod EKS

NVIDIA Nemotron 3.5 Super VL is a 120B-parameter mixture-of-experts model activating 12B parameters per token that handles text, image, document, and video input, joining other Nemotron models already on AWS. The post describes its hybrid Mamba-2, MoE, and attention architecture with a RADIO vision encoder and up to 1M-token context, then shows deployment on Amazon EKS, EKS Auto Mode, and SageMaker HyperPod EKS using NVIDIA Dynamo and vLLM, with validation and performance results on B200 and H200 instances.