Anything that requires what's basically video is probably going to be subpar. I believe Windows Server 2012 has much better handling for things like playback but it's still not going to be great for gaming.

Minecraft also benefits quite a bit from a decent video card, something that's going to be absent from most remote desktop servers (though I think that's changing).