9 / 170

Tiiny AI Pocket Lab Ships with 1TB PCIe 4.0 NVMe Storage

TL;DR

The Tiiny AI Pocket Lab is a portable device built to run AI models entirely offline, no cloud required.

Key Points

  • It features an Armv9.2 CPU paired with a Neural Processing Unit delivering up to 160 TOPS for deep learning workloads.
  • Storage comes as a 1TB PCIe 4.0 NVMe drive – unusually generous for a pocket-sized form factor.
  • The target audience is anyone needing local AI inference without relying on external servers.

Nauti's Take

160 TOPS sounds impressive, but the number alone means little – what matters is which quantization levels are supported and whether common frameworks like llama. cpp or ONNX Runtime run without friction.

The 1TB NVMe drive is a genuine differentiator: anyone storing multiple large models locally needs exactly that headroom. Until independent benchmarks appear, this remains a Kickstarter promise – and we know how that story often goes.

Video

Sources