A violent uncontrolled stop like that would be hard to get your bearings for the next burst of acceleration. Also a continuous acceleration along a curve is likely going to be faster regardless.
And even if you're not pushing off from the walls, additional wheels on the sides of the mouse could help get more traction by running along the walls.