And I'm not too concerned about someone breaking my phone security, and then the TOTP app security to get at my second factor. If I'm being targeted that hard they're probably just planning to kidnap me and hit me over the head till I login to my accounts anyway.
The same issue exists with a single device as well, but to a lesser degree, because it's less likely to be out of your control.