How Snorkel runs realistic agent simulations with Modal

Snorkel uses Modal to power inference for open-weight models it evaluates and to provide GPU and CPU sandboxes for millions of agent simulations per month, peaking at tens of thousands of sandboxes an hour. Modal's VM sandboxes let Snorkel recreate production-like environments, including multi-service systems and GPU-enabled workloads, and its memory bursting feature cut total sandbox costs by around 20% by avoiding over-provisioning. Snorkel also uses Modal's Shared and Dedicated Endpoints to stand up inference for new and fine-tuned models, and plans to evaluate Modal as a training solution.