That's just because your skin has water molecules that freeze on contact with the ice cube. If you use tongs to put an ice cube on your desk, it doesn't stick at all, right? And the friction is very low so it's easy to kick away -- things like a leather wallet stick much better to your desk.

I've dropped ice cubes on the floor before and they definitely slide a lot more than most objects of the same shape.