‘Our assumptions are broken’: how fraudulent church data revealed AI’s threat to polling
TL;DR
A 2024 Bible Society report claimed church attendance in Britain was surging – but the underlying data was fraudulent.
Key Points
- Paid survey participants use AI tools to generate fake responses at scale, collecting payments without genuine input.
- Experts warn that automated bots and LLMs are systematically corrupting online surveys across industries.
- The problem extends far beyond religious studies – political polling and market research face the same threat.
- Researchers say core assumptions about survey data reliability are now fundamentally broken.
Nauti's Take
This is not a fringe problem caused by a handful of dishonest clickworkers – it is a structural attack on the data foundations of entire industries. When LLMs produce survey responses convincing enough to pass quality checks, trust in quantitative social research breaks down at a fundamental level.
The irony is almost too rich: the same AI technology marketed as a tool for uncovering truth is here industrially manufacturing falsehoods. The research industry urgently needs new verification standards – before the next polling disaster makes headlines.
Sources