It was illegal as recently as the 70s in many places. I think it was pretty much everywhere in the 50s. The cops would throw you in the slammer for "carrying on with a married woman."