Most of the groups who strongly oppose this stuff are against any nuclear material whatsoever entering space. The reasons span beyond basic safety to opposing any combination of space programs with nuclear programs.