What if the criminal is extremely wealthy and powerful and can continue to exert his influence even from within prison (and possibly have a corrupting influence on prison guards)? This actually happens with cartel heads and crime syndicate leaders...
Most such criminals are likely to be imprisoned for crimes other than murder, so you're going to have the problem anyway. Better to address the actual issue rather than use it as an excuse.