AI's extinction debate breaks containment
TL;DR
An online panic erupted this week after millions discovered that leading AI researchers routinely debate and calculate the risk of human extinction. Taken at face value, the odds are chilling: 10%, 20%, sometimes far higher, assigned to the possibility of AI catastrophe. Why it matters: An esoteric debate over "p(doom)" has suddenly become a gut-level question for lawmakers, investors and millions of ordinary people: Why are we racing toward a technology its own builders believe could destroy us?
Nauti's Take
Bringing p(doom) into public view is genuinely useful, because regulators and investors finally have to engage with real risk models rather than vibes. The catch is the false precision: those percentages are gut estimates without shared methodology, and in a screenshot they look like measurements.
Anyone following this should ask what reasoning sits behind the number.
Sources