I went to a public onsen in Hakone. More like a western spa than a bathhouse. They made me purchase a covering for my leg tattoo, even though I am not Japanese and therefore could never have been Yakuza.
I was also in Hakone, last month. There was a foreigner with pretty obvious tattoos on his body in the onsen I went to. It probably depends on the bathhouse.