They actively look for ways for infinity to happen. Look at Eli's irate response to Roko's basilisk. To him even being able to imagine that there is a trap means that it will necessarily be realised.

I've seen "rationalist" AI doomers who say things like "given enough time technology will be invented to teleport you into the future where you'll be horifically tortured forever".

It's just extrapolation, taken to the extreme, and believed in totally religiously.