Having said that I agree also that there are also trust issues. Forming trust is a hard thing.
It's a shame, because programming (from at least my perspective) is one discipline, where the quality of work is so much higher when you are "in the zone" and can concentrate on a single task without interruptions.