I had some fun with a HP DL 380 G8 but it's also 110W idle or 75W with 25% reduced performance. The noise is is indeed bad, even with closed doors.

I've replaced it (lab) with a KVM kluster of tinyminimicro machines (1L pc).

Now I just need to throw away the G8.