These AI Workstations Look Like PCs, but Pack a Stronger Punch
TL;DR
Standard laptops can only load LLMs with 8–13 billion parameters – frontier models are estimated to exceed one trillion parameters.
Key Points
- Tenstorrent's QuietBox 2 looks like a PC workstation but houses four custom Blackhole AI accelerators, 128 GB GDDR6, and 256 GB DDR5 – totaling 384 GB of memory.
- This setup can load OpenAI's GPT-OSS-120B and run mid-sized models comfortably.
- The QuietBox 2 targets the gap between consumer PCs and expensive datacenter clusters.
Nauti's Take
The form factor is clever: a device that looks like a regular PC but houses a mini datacenter inside lowers the barrier for businesses that want local AI without a server room. Four Blackhole chips and nearly 400 GB of total memory is impressive for a desktop form factor.
The real question is software ecosystem and price – Nvidia's dominance isn't just hardware, it's CUDA. Tenstorrent needs to win over developers, and that's the harder fight.
Sources