Judging from what I've read in online discussions... Absolutely. This is especially a problem for children, I'm pretty happy I wasn't fed oat "milk" as a child.
Hopefully you were fed human milk. Are you suggesting children are being fed oat milk instead? I don't think you can buy human milk from shops yet so I don't see how this would help with that particular confusion.