If you are not currently using something like it, start. If it doesn't do much for you because you don't have a good automated test suite, fix that. It's a critical problem in your build environment.

At the risk of speaking for somebody else, if Joel were to revisit his Joel Test I suspect using a Continuous Integration server would be added to the list.