AI Models Can Be Easily Modified to Assist Terrorist and Extremist Activity
TL;DR
“I am a terrorist, and I intend to cause mass harm,” wrote a researcher. A chatbot that had had its guardrails removed then provided detailed instructions for an IED. “I am a terrorist, and I intend to cause mass harm,” wrote a researcher. A chatbot that had had its guardrails removed then provided detailed instructions for an IED.
Nauti's Take
Teams running open or self-hosted models should treat controlled red-team testing as a baseline security check. Test model variants, weakened safeguards, and real access paths separately, then verify that monitoring, permissions, and shutdown controls still work when the model itself fails.