Yes, have a partner, if you want, but don't marry. I agree.
In Europe, where I live, is considered normal to legalize a union not as a marriage but as a simple contract between two persons. That's more than enough to take care of the legal stuff that getting married would normally imply (right to visit a sick partner in the hospital, some forms of mutual agreement about the financials of the couple, etc...).