I don't have to restart my machine often. And it might depend on which server you used exactly, since they have different machines (I'm using the bare metal machines). But that said: I don't remember at all that the server shutting down took a long time. Might it be possible that your server was broken?