The System as Product: Software and the Operator's View
Silicon is inert until software drives it — kernels that fill the arithmetic array, a compiler that fights the memory wall and hides communication behind computation, and a scheduler that batches, packs, and recovers. Every lever on utilization and goodput is pulled here, in software, at runtime, which is why a mature stack is a compounding asset and a moat that raw silicon cannot cross. Assemble the whole course and the discipline is blunt: you buy systems, not chips. The unit of analysis is the integrated machine — chips, memory, interconnect, fabric, software, and the power and cooling beneath them — judged by sustained useful work per dollar and per watt, through failure. A chip only matters in the context of the system that feeds it.
Knowledge check
Why can an established accelerator with a mature software stack out-deliver a newer chip that has a higher headline throughput?
Show the answer
Because usable performance follows the software that drives the silicon, not the silicon's peak. The mature platform has tuned kernels that keep the arithmetic array full, a compiler that fuses operations and hides data movement, and a scheduler that batches and packs work — so it realizes a high fraction of its ceiling. The newer chip's immature kernels, compiler, and scheduler leave much of its higher ceiling unreached, so its delivered work can fall short despite the better datasheet.