Sometimes problems really are just large. Sometimes you need results faster than a single microcomputer's CPU(s) can produce them and UNIX was invented too early to come with solutions for doing that in ways that prevent complexity. HPC is paying the price.

We're fixing it (efforts like Kubernetes, Hadoop, Mesos), but it's tough and we have a long way to go.