In fact they grab your whole contact list, and according to the updated policy, they share it with the other Facebook Companies. So even if you refuse to use the app, it's still very likely that your contact information will end up on their servers because you're friends are probably using the app.