iCreatAI News
Skip to content
Hacker News AI· maplet·· 1 days agoAI score58

Gemini Decision 1 can't separate AI voices made after 2024

Gemini Decision 1 can't separate AI voices made after 2024

AI summary

Testing Gemini Decision 1 against 30 clips each from 34 AI voice generators and 200 human LibriTTS audiobook clips, the author found pooled ROC-AUC of 0.67 for 2017–2024 generators but only 0.52, effectively chance, for 2025–2026 generators. The model also showed a strong bias toward labeling audio human-made, giving only 20 of 1,020 AI clips a 50% or higher chance of being AI-generated, and scored just 0.58 on Gemini 3.1 Flash TTS. Clips were re-encoded with ffmpeg to strip metadata and band-limited to 8 kHz before scoring.

Source: Hacker News AI · echo.ls