Researchers release Remote Labor Index benchmark, AI automation rate only 2.5%
Understand this story
Researcher Mantas Mazeika and others proposed and released the Remote Labor Index (RLI), a benchmark covering multiple industries that uses real, economically valuable projects to evaluate the end-to-end performance of AI agents in practical scenarios. The results show that agents are near the lower bound on RLI, with the best-performing agent achieving an automation rate of only 2.5%. The authors say the results can provide an empirical basis for discussions about AI automation and make it easier to track AI's impact on the labor force.
AI overview based on source reports · Updated 2 days ago
Coverage timeline
Follow the coverage to explore different perspectives.
- Hacker News AIRemote Labor Index: Measuring AI Automation of Remote Work
The authors introduce the Remote Labor Index (RLI), a multi-sector benchmark of real-world, economically valuable projects designed to evaluate end-to-end AI agent performance in practical settings. AI agents perform near the floor on RLI, with the highest-performing agent achieving an automation rate of 2.5%. The authors state these results help ground discussions of AI automation in empirical evidence and provide a common basis for tracking AI impacts.
Activity for this story
- Current comparable activity
- 3
- Peak comparable activity
- 10Nov 12 20:00
- Change in the past 24 hours
- -50%
Trends compare the same fully observed participants, which may cover fewer participants than current activity. Move the pointer or tap the chart to inspect hourly activity; use the left and right arrow keys with a keyboard.