Well, you can easily statistically measure the funnel of applicants to interviews to hired by gender and verify this claim. I doubt you will find the problem is multiplied hidden biases in the interviewing process.

Really there usually aren't enough applicants that are diverse on any dimension. Mostly because most applications are by direct referral of existing staff. That's legitimate. Eventually your company will grow big enough to hire a recruiter to look in new talent markets.