Also Monte Carlo Tree Search was decisive in bringing Go (the ancient board game) engines from unable to compete with advanced amateur players to successfully competing with the cream of the pros!
I find it remarkable how well MCTS works. Even without the value or policy net, the vanilla algorithm is capable of finding meaningful results by solving the MDP.