Growing a garden and raising livestock are pretty different in practice & impact from my experience. Assuming you voluntarily moved into the zoning and "Karen" objected to you violating them, it's all on you.
The zoning change came after I moved in and after I got my chickens. If I had the time, money, and inclination I might have been able to find a lawyer willing to appeal on ex post facto[0] grounds, but it wasn't a battle worth fighting. I had had a year's worth of free eggs by then, and the chickens themselves didn't go to waste.