IIRC, the reason plants linger so long after decommission is because (at least in the US) it's illegal to reprocess the waste, which really isn't waste and has lots of useful stuff in it.
It can't all be reprocessed (which itself is somewhat hazardous not least because of the transport required) so you'll still have a sizable chunk of stuff that needs to be contained for tens of thousands of years.
