Factory farming generally means pigs, cows and chickens crammed into small spaces. I think you're confusing that with Industrial Agriculture, aka. "The Green Revolution".
It's quite possible to have non-factory farming and not starve to death.
I think the issues with inhumane animal treatment and overcrowding are going to solve themselves eventually. Nobody wants agribusinesses out of the animal-husbandry business more than the agribusinesses do. Feeding, confining, and slaughtering animals is a messy and expensive annoyance.
Before long, I think we'll see engineered meat being grown on scaffolds in vats, without no need for anyone to deal with animal maintenance at all. As I understand it, the biotech advances needed to make this happen are incremental, not revolutionary.
This will obviously be considered revolting at first, but it won't be hard to change peoples' minds. There simply aren't any downsides -- everybody from ordinary consumers to PETA nutcases to cigar-chomping Con-Agra executives will get what they want.
It's quite possible to have non-factory farming and not starve to death.