Make sure everyone has the skills and means to survive in the world. Don't expect the public to provide halfway houses, but instead provide that as part of your criminal justice system. If someone commits more crimes, punish them for the crimes and perhaps, take a different approach with the rehabilitation portion of their sentence the second time around.

I would also add that the means bit is rather important. If I was getting out and realized how slim my chances of actually getting a job and supporting myself were, I might plan on doing more crimes. There isn't much incentive not to. On the other hand, if I knew I'd be OK just by going through the program, I'm more likely to do that.