"It left a bunch of crap on my computer too, starting up some kind of server on startup."

That "crap somekind of server" would be MySQL server. Were you trying to install MySQL client instead.

I've never had a problem. `apt-get install mysq-server`and I'm done.