If you start out with a velocity slightly slower than the Earth's, you end up with an elliptical orbit (instead of Earth's almost circular orbit). Barring some sort of drag (to further loose energy), there's no reason it would decay into the sun.