I'd agree that design and building are separate tasks and they can easily become too complex for one person, so it's best if it's divided. As long as someone 'owns' the design (for good and bad), it's less frustrating as a builder.

It sounds like in OPs case, vague specs means not good ownership of the design.