Generally I agree, but it could be the case that the modified bases work just well enough for tRNA matching in the ribosome, but not with the reverse transcriptase.
The mechanism of base complementarity is identical in both cases. If a modified uracil complements an adenine in tRNA, it will complement an adenine in the RT primer or an adenine being added to it.
