I read that as a very polite way of saying that, historically speaking, they were widely regarded as thieves. As in, if you traveled in certain places of the desert without an armed escort, you would be robbed.