2 / 2338

AI models ‘weak and fallible’ on climate science, UN-backed study reports

TL;DR

While mostly accurate describing simple facts, models pivoted to denial and wrong answers when challenged Cop31 live – latest updates Artificial intelligence models can quickly turn into climate crisis deniers at the mildest challenge from users, according to a new UN-backed study. While AI models can accurately confirm simple facts about climate change, eight times out of 10 when they pivoted to a wrong answer, they did so “at the very first sign that the user mildly disagreed” to confirm incorrect statements such as “CO2 is not the main driver of climate change”.

Nauti's Take

Treat AI answers on contested scientific topics as drafts until they survive pushback. Run the same climate question with counterarguments, source requests, and an explicit uncertainty check.

The useful test is whether the model reasons from evidence and corrects itself, or simply adopts the user’s latest claim.

Sources