Agreed, except that the marginal value of money is exponentially higher for the poorest people in the world. For example, the Against Malaria foundation can save a life for approximately $2838 [1] pre-tax dollars. The people closest to you do not need your money that badly.
[1] http://www.givewell.org/international/top-charities/amf#Cost...