If used to elect something like a president, yeah, that could be problematic. But if used to elect a legislative body then its not really a problem. Sure 1% of the body would be pro-dictatorship, and occasionally a bit more due to the randomness, but its not a serious risk that a majority of the body would turn out to be pro-dictatorship.