By definition, a company or individual has no legal obligation to care about laws outside their jurisdiction. The EU can say anything it likes about what companies "must" do, but they have no jurisdiction over non-EU companies. (Unless their own country enters into some kind of mutual enforcement agreement, or unless they ship a physical item that has to go through EU customs.)
I think you've missed the point of the comment you replied to. You have no obligation to follow the laws (taxation or otherwise) of a country/territory that has no jurisdiction over you (and no other power of enforcement, such as customs for physical products).
Providing an electronic service to everyone in the world does not make you subject to the laws of every country in the world, as much as those countries might wish otherwise.
This is not true. You can read about VAT MOSS and the non union scheme for more info.