Isn't the main reason for us not having fission rockets the fact that we don't want to have radioactive material explode a few kms above our head aka a dirty bomb?
A DT fusion reactor would have a thrust/weight ratio much less than 1, so it could not be used in a launch vehicle. It would be purely for use up in space. So, none of this "a few kms above our heads" nonsense.