I've read a funny anecdote (no idea whether it is accurate) that von Neumann's loud gramophone music was a big source of frustration for his office neighbor, Albert Einstein.