This is not usually the case. Initial resume reviews are often done by HR, some algorithm, or at least somebody who is not who you will actually be working with on the day-to-day. It is incredibly difficult to root out all of the biases in the job application process and even automated attempts have failed[1]. It is best to avoid any opportunity for bias to even enter the system. To say that you're okay being rejected from a job due to your appearance because you wouldn't want that job anyway is defeatist and hurts the cause of those who are truly disadvantaged and would very much like to be employed.
This attitude assumes that bias is present only as random individual instances, not consistently across groups. What percentage of jobs are you willing to say that e.g black people should be willing to pass by?