The Thermal Wall: Why Liquid Cooling Stopped Being Optional
For thirty years, air did the job. A fan, a heat sink, a raised floor, and cold air pushed under the racks kept servers alive. That era is closing, and not because anyone chose to close it. The chips forced the issue. When a single accelerator dissipates a thousand watts and a rack packs a hundred kilowatts, air physically cannot carry the heat away fast enough. Liquid holds roughly a thousand times more heat per unit volume than air, so the industry is following the thermodynamics, not a trend. The consequence I want you to hold onto is this: cooling has moved from a background utility to a first-order design constraint. Whoever controls the plumbing now shapes what the compute can do.
Knowledge check
Why is air cooling reaching a hard physical limit in modern AI racks, rather than simply becoming less convenient?
Show the answer
Because air carries very little heat per unit volume. As chip power draw and rack density climb past what moving air can remove, the coolant medium itself becomes the constraint. Liquid holds far more heat per unit volume, so the transition is driven by thermodynamics, not preference.