It is an issue, and it's a tricky one to solve. It's getting much harder to get a hold of public IPv4 addresses and lots of smaller providers are using NAT instead. It's not a total show stopper - the vast majority of customers don't even notice and only a few actually need it enough to not use the service, and for those you can probably come up with clever ways around it (like a VPN) but it's definitely a problem. I think the best way out is IPv6 (but of course we've been saying that for decades).
Just be ready with a story when Law Enforcement show up asking you to identify whoever used one of your IPs to commit a crime on such and such a date in the past.
That's true, I've been there! I've never had them be unreasonable about the situation but maybe I've just been lucky.
The real scary one was servicing a relay site on top of a bank late at night and the cops showing up guns blazing thinking the place was being robbed ;)
I had US Secret Service show up at my office once, demanding information on an external NAT IP. We had 10k NAT'd devices behind that IP. Apparently some doofus wrote on some govt. website they were threatening the president. A warrant later (which took < 1hr to get!) I told them everything I could, which was "Oh that traffic was to this entirely different legal entity, you need to go talk to them now."