Not into astrophysics, but I guess "faster asteroids experience higher forces when going through the atmosphere, therefore burning faster". Another explanation could be "most of asteroid's speed comes from Earth's gravity, not from it's initial state".

These are just random guesses though, so I could be completely wrong.