Each address is a random pseudonym. A wallet is a collection of pseudonyms but it's secret that they belong together. Except network analysis can infer that some of them do. Pseudonyms are persistent, can't "change them", only transfer coins out of the pseudonym to a different one, i.e. log a transaction.