IIRC, the smallpox vaccine is the one that scars you for life. I bet a lot of people would be afraid of it at first, but a 30% fatality rate is probably high enough to change a lot of antivaxers' minds.
I have a smallpox immunization scar on my upper arm. It's about the size of a quarter and not very ugly. It is trivial compared to the disfigurement that typically came with contracting actual smallpox.
Anecdata, but my smallpox vaccine scar is a small, ~1cm spot.
The risk of "inadvertent autoinoculation" was my bigger concern - if you touch the site before it's fully healed, you can spread the vaccina virus to other parts of your own body. In rare cases it's been known to cause blindness. Fortunately a Tegaderm dressing kept it contained to my shoulder, but damn did it itch like crazy for those few weeks.