I think of "move fast and break things" in a different context that most people(maybe). It doesn't say move fast and SHIP broken things.

To me it speaks to the fact that you shouldnt be afraid to completely change something if its to improve the product. Eliminate technical debt. Dont code around a workaround that doesnt always work.