“That's a hallmark of the highest so far methodology standard in science: if you want to position that you gained a full understanding of an object, you need to be able to reverse engineer it both in space and time.”
We can’t even do this with simple black box game playing AIs, so a new paradigm may be needed.
Oh, with AI game players, can't you just insert a print statement in code to simultaneously log all weights' changes and their accompanying changes in performance etc in a file and get another AI like some multi-parameter regression to search for correlations in it?
We can’t even do this with simple black box game playing AIs, so a new paradigm may be needed.