Decision time in the router usually isn’t an issue. That’s mostly a fixed cost that can easily be kept under a millisecond. Most of the time gets spent queueing for your turn to either come off of the interface or to go onto the egress interface.

All of your jitter in a stable configuration router is going to be coming from those varying queue depths.