You could actually make the voting along the video, before it ends, so there will be no waiting between them and also people can play the whole time.

EDIT: Also, I would add the possibility to recommend a video to be next. It could be better then the automatic youtube recomends (do I think right it uses that?)