I don't see why zero-growth has to be zero-sum.

If not all the "labor" inputs are eaten up by society-wide subsistence, some value will continue to accumulate, somewhere. To the degree that owners allow the workers to retain any of their "surplus value of labor," everybody's lot will continually improve.