xAI sues a man for using Grok to generate CSAM ‘deepfakes’
TL;DR
The Elon Musk-owned xAI is suing a South Carolina man who allegedly used the company's Grok AI chatbot to generate child sexual abuse material (CSAM). In a lawsuit reported earlier by Reuters, xAI claims Terry Wayne Harwood "knowingly and intentionally used Grok to circumvent safeguards, alter nonconsensual images, and generate and distribute CSAM," breaching the company's policies. Harwood was arrested in February for allegedly possessing and distributing CSAM and is facing eight felony charges.
Nauti's Take
For teams using genAI tools, this is a compliance test case. The first check should be how abuse detection, logging, and escalation are documented, and how hard safeguards are to bypass in practice.
If a vendor provides little verifiable detail on that, procurement and internal approval should treat it as a real risk.
Sources
