If a restaurant wants you to use your phone and proceeds to serve a website that doesn't work on people's phones, that's on them, full stop. Even if the user can accommodate the brokenness, it's still unacceptable that they should ever have to.
Sure, and with physical menus you can bring along a magnifying glass for when they are printed too small. But then, this sort of things are not considered acceptable in the real world, why should we accept them in restaurant websites?
On an iPhone you just tap an aA font icon in the URL bar and change the font size up or down from 100%.