The Slop Index releases an AI writing style benchmark
Understand this story
The Slop Index has released a benchmark that measures how "AI-like" AI writing is, scoring 58 frontier models on a 0–100 "slop score," where a higher score means closer to an AI tone. Scoring is based on real human writing from before ChatGPT existed, combining 40% arena blind-test voting with 15% each for concision, templating, rhythm, and clichés, and no LLMs are used as judges at any point. The leaderboard covers 112 scenarios and 64,636 generations, and anyone can take part in the blind-test voting.
AI overview based on source reports · Updated 46 min ago
Coverage timeline
Follow the coverage to explore different perspectives.
- Hacker News AIThe Slop Index: Which AI Model Writes the Least Like AI?
The Slop Index is a live benchmark scoring 39 frontier models (the board lists 58 models across 112 scenarios and 64,636 generations) on how much their writing resembles AI slop, with higher scores meaning more chatbot-like. Scores blend a blind human arena vote (40%) with conciseness, templating, rhythm and tells (15% each), measured against genuine human writing collected before ChatGPT existed, including workplace email from 2000–2002 and pre-2022 tweets. No LLM judges anything; the arena lets anyone vote on two blind samples from the same task.
Activity for this story
Not enough continuous observations to show a trend yet.