
Engineering BlogOctober 2026
Sophon Puts 330 GB of Memory on the Chip: 100× Faster Than HBM, a Fifth the Heat, 44 °C While Generating Text
By PhantaField Architecture TeamAn HBM GPU has two thermal problems where Sophon, our chip design, has one. Its memory is a 775 µm stack of bonded DRAM dies standing beside a compute die of about 1,800 W, and DRAM must refresh twice as often above 85 °C, so the memory sets the coolant limit. Sophon's 330 GB sits in 22.4 µm of the same die as its logic: every tier is within 1.3 K of the base at 1,026 W, refreshing it costs 0.08 W at 25 °C and about 4 W at 85 °C, and the die runs at 44 °C on a standard cold plate while it writes. These are modeled figures from the whitepaper; here is the arithmetic.
Read more →