Testing 105 AI-built website contact forms: 27 falsely showed success
Understand this story
Formgong released a test targeting contact forms on AI-generated websites: it submitted 105 forms on public Lovable and Bolt sites while blocking all network requests so messages could not actually reach site owners. In the final round, 27 forms showed "Message sent!" but sent nothing, while 54 successfully sent the filled-in information. The test required Google Chrome to run, the site list and per-site results were not disclosed, and the article did not name any sites.
AI overview based on source reports · Updated 36 min ago
Coverage timeline
Follow the coverage to explore different perspectives.
- Hacker News AIShow HN: We submitted 105 AI-built contact forms – 27 said "sent", sent nothing
The author tested contact forms on public Lovable and Bolt sites by filling them out while recording and blocking all network requests, so no message could reach a site owner. On the final run, 27 of 105 forms displayed a success message while sending nothing, 54 of 105 sent the typed message, and on sites without demo signs 16 of 73 were fake. The write-up, preregistration, results, and a Playwright-based harness are published at the linked URL under an MIT license.
Activity for this story
Not enough continuous observations to show a trend yet.