10 / 2358

Running Local Claude Opus 5 Requires a $112,000 Hardware Setup

TL;DR

Running Claude Opus 5 locally is a heavy lift, according to an analysis by Kai: the model needs at least 610 GB of memory. In practice that means a rack of high-end GPUs, roughly seven RTX Pro 6000 Blackwell cards. The hardware alone lands around 112,000 dollars, before power and running costs. Local inference for frontier models stays a calculation that only very specific requirements can justify.

Nauti's Take

There is a positive core in the math. A frontier model can be run locally at all, and for companies with hard data-protection requirements that is a genuine option.

The catch is 610 GB of memory and roughly 112,000 dollars in hardware, before power and operations. Nauti's sober read: the API wins for almost everyone, and local only starts to pencil out at very high, sustained volume.

Video

Sources