AWS Machine Learning Blog· Muru Bhaskaran·· 20 hr agoAI score34
Using NVIDIA Run:ai GPU Fractioning on Amazon EKS
Using NVIDIA Run:ai GPU Fractioning on Amazon EKS
AI summary
This AWS post walks through configuring NVIDIA Run:ai GPU Fractioning on Amazon EKS using a custom Amazon Linux 2023 image, with a validated example of one g5.xlarge instance and an NVIDIA A10G GPU. It establishes a whole-GPU baseline, runs two Pods with 8 GiB memory contracts each allocating 6 GiB on the same GPU, inspects per-Pod metrics, and verifies rejection of a 9 GiB allocation. The walkthrough uses KAI Scheduler and GPU Fractioning Operator 0.1.7 with NVIDIA driver 615.71.10, and notes that fractioning adds enforced per-Pod memory limits but does not provide fault isolation or proportional compute.
Source: AWS Machine Learning Blog · aws.amazon.com