Like it or not, many banks and other industries use it as a verification question. A collections agent is going to be explicitly and strictly forbidden by policy from disclosing it to an unknown person on the phone, and that's a good thing.

Yes, I'm pretty sure everyone has my SSN and other details, but collections agents should absolutely follow the rules. The ones that don't tend to be abusive.