I have never ever worked somewhere with one of these "cloud-like but custom on our own infrastructure" setups that didn't leak infrastructure concerns through the abstraction, to a significantly larger degree than AWS.

I believe it can work, so maybe there are really successful implementations of this out there, I just haven't seen it myself yet!