Deploy frontier AI models on AWS Trainium with SGLang-Neuron

Amazon announced that SGLang-Neuron, released by RadixArk with Annapurna Labs, is publicly available through an AWS Deep Learning Container, letting users serve models and generate RL rollouts on Trainium via the same SGLang interface. The out-of-tree plugin runs on native PyTorch, is selected with SGLANG_PLATFORM=neuron, and supports PD disaggregation with KV-cache transfer via NIXL over EFA. The post includes a walkthrough on a Trainium3 EC2 instance using the pytorch-inference-sglang-neuronx container to serve openai/gpt-oss-120b.