Runway's open-source Praxis-1 turns video AI into a robot controller

Runway has released Praxis-1, a World Action Model that takes camera images, text instructions and robot position data to predict scene changes and derive robot movements, with weights and code under the Apache 2.0 license. Built on a video model fine-tuned with human action videos and robot data, it scored 46.2 percent on Nvidia's RoboLab-120 leaderboard, ahead of FLUX 3 Action at 42.9 percent, though Runway ran the tests itself and they have not been independently verified. The model still needs specialized robot data for adaptation, sometimes confuses similar-looking objects, and cannot reliably plan complex action sequences on its own.