How William H. Press might approach Computer Science

The notion of "Computer Science" as a distinct field is, to put it mildly, a curious one. What we're actually computing, at its heart, is information. And the methods for manipulating and understanding that information are deeply rooted in mathematics and, dare I say, physics. Think of it: sorting a vast dataset. Is that not akin to minimizing energy in a physical system? Or simulating the spread of a disease – that’s just a sophisticated form of diffusion, governed by differential equations. The algorithms, the very core of this "science," are the tangible manifestations of these abstract principles.

Let's be clear about what we're actually computing. We're not just conjuring numbers from the ether. We're building models, often imperfect ones, of the world or of abstract constructs. And like any model, it's crucial to understand its assumptions and its limitations. The temptation to treat a complex algorithm as a black box, especially with these newfangled neural networks, is immense. But that’s a dangerous path. Where is the error analysis? Where are the bounds on uncertainty? Without rigorous understanding, you’re liable to overfit your model, mistaking noise for signal.

There's no free lunch in statistics, and certainly not in computation. Efficiency matters. Stability matters. If your algorithm requires an eternity to run or produces wildly fluctuating results for minor input changes, it’s not science; it's elaborate busywork. The goal is to find the simplest, most robust method that solves the problem correctly. And often, that means returning to first principles, to the Bayesian inference that elegantly captures our state of knowledge, or the Monte Carlo methods that allow us to explore complex probability spaces. The algorithm is the science, but only when…

Imagined perspective — an AI synthesis grounded in William H. Press’s recorded ideas and methods, not a quotation or a statement they actually made.

Chat with William H. PressComputer Science on Feynman