You also become responsible for any unpaid property taxes, because they are attached to the property rather than to the person who owned it when the debt was incurred.
From my understanding, there's also a caveat that you have to live in the home. Or have a tenant or something similar. I think it has (had?) something to do with preventing outside speculators from holding properties while the structures become (further) dilapidated and/or collapse.