What we know

A Reddit user reportedly purchased a nine-GPU Nvidia P106-100 crypto mining rig with a total of 54GB of VRAM for $35, equating to about 65 cents per GB, and successfully ran a large language model locally on the hardware. A Reddit user bought a nine-GPU Nvidia P106-100 mining rig with 54GB of VRAM for $35. 6-35B-A3B, a large language model, locally on the rig. The cost per GB of VRAM was about 65 cents.

Why it matters

The story, as reported by Tom's Hardware, centers on a Reddit user who found a disused crypto mining rig in a garage and bought it for $35. The rig consisted of nine Nvidia P106-100 GPUs, each with 6GB of VRAM, totaling 54GB. 6-35B-A3B language model locally.

What is still unknown

Independent tests of accuracy, supported languages, and a broader release date are not in the reporting.