I think he means that mathematical objects are pure structure without substance. They are defined only in relation to other objects and there is no deeper meaning.