It's not clear yet but the dose makes the poison. The amount you get exposed to through Teflon clothing is unlikely to be enough to cause any issues. Animals and people having health problems were directly exposed to large amounts, such as working with them.

Besides, they've been phased out of new clothing. If you got something new they shouldn't have the same PFAS and PFOS, although it wouldn't be surprising if the new shorter chain replacements have similar issues.