Because the apparatus for remembering is emergent, derived from accumulated training data. Only when the person's brain has gpt-2 level training data is what we call memory available. Of course actual memory as in persistent storage, is there from before birth.