As the employer, I wasn't cool with someone I didn't know delivering code to my clients or accessing their servers.

It's in most standard employee contracts that employees won't disclose confidential information for reasons like this.