Could this argument not be made for anything plugged in to OpenAI's API? If so, I don't see how it's a response to the point.

If you make an app for interacting with an LLM and in the app the user has access to all sorts of stolen databases, and other conveniences for black hats, then you've got what was described above. Or I'm missing something?