They just need to get the equivalent amount of light into each sensor as your TV remote gets into your TV.

I doubt it would get unsafe before rising the power by many orders of magnitude... Especially considering unshielded kW IR lamps are used everywhere for heating.