Humans Cannot Detect AI-Generated Media But Communities May -- For Now: Collaborative AI Detection in r/RealOrAI on Reddit
2026-05-26T08:52:11Z•8fd50ee0649f4ada5baa66630369852ff52d280ed7a1131c1040709f62f08e12
adversarial-manipulationai-generated-mediaauditabilitycommunity-moderationdeepfake-detectionfalse-positivesheuristicsllm-ensemblemisinformationprovenanceredditsocial-platforms
What happened
Study of r/RealOrAI (one year of real community moderation data) shows community-aggregated judgments reach ~72% accuracy on self-verified “[GUESS]” posts but exhibit a systematic and increasing false-positive bias as AI-suspicion grows. Analysis of ~10k reasoning comments using a six-LLM ensemble categorized cues into six classes (perceptual features, context, consistency, AI knowledge, subject expertise, provenance). Perceptual cues dominate individual reasoning (≈70%); provenance verification is rare (≈4%) at the individual level but amplified ~4.3x in community summaries, indicating that (
Why it matters
A reviewed impact interpretation has not been published for this record.
Evidence and limitations
- Source ID
- arxiv_cs_si
- Record identifier
- 8fd50ee0649f4ada5baa66630369852ff52d280ed7a1131c1040709f62f08e12
- Enrichment time
- 2026-05-26T08:52:11Z
- AI-assisted enrichment
- Yes
This record may overlap with other records. Its enrichment can be incomplete or wrong, and machine assistance was used. Validate consequential decisions against the linked source and your own environment.