To reply to myself, the thrust you'd get from a laser that shoots at you would in fact diminish as you accelerate away from it, as the light would redshift and thus carry less energy to you.