"pain points" is a good expression here. Some code inflicts more pain on the developer than other and the psychological effects should not be underestimated (=reduction of productivity due to lower morale).

I also like your approach of time-boxing the fixes.