Today’s AI won’t achieve superintelligence. But catastrophic risk is real | Sunita Verma
TL;DR
The same technical limits that prevent superintelligence make these systems dangerous. But we know how to regulate them Many Silicon Valley leaders believe superintelligence is an imminent threat to society. The White House even published an accord about it. This isn’t enough.
Nauti's Take
Small teams should start with a concrete control check: which AI systems can act independently, what data can they access, and who can stop them immediately? Long-range extinction estimates remain difficult to verify from this source alone.
The control question can already be tested in every agent workflow today.
Sources