But that's different, it will effectively send the URL of video to the Chromecast, which will directly get the compressed stream.

Screen casting with Youtube is a good benchmark of screen casting. Of course, for daily use you'd want to cast from the app directly.