We can, but we lump them into three bins, L, M, and S. The usual red, green, and blue are derived from those. L, M, and S are sensed by different cells.

https://en.m.wikipedia.org/wiki/LMS_color_space

Similarly, our ears are sensitive to a rather larger number of frequency bins, and and each sensory cell senses one of these bins.

Neither of these sensory mechanisms is particularly sensitive to phase and, in fact, we can’t hear phase differences very well.