So the onus is on you to make yourself clear in spite of the ambiguity (a simple way would be to mention a unit early in the conversation). Really, the terminology isn't going to change no matter how much noise you make, so it would be worthwhile to save yourself the effort.