I just went clicking randomly on Vimeo links and I didn't find a single auto-playing video.

You are right about YouTube and I actually think they should handle visitors that come from outside YouTube differently than visitors from inside the site. In the first case auto-play is annoying in the second it is what is wanted.