> We already phisically change completely every few years.
That is not true at all. Please don't perpetuate these old wives' tales on HN.
A lot of your cells do die and are replaced, sperm cells for example have a life span of 3 days, white blood cells about a year, but brain cells (especially relevant to the context of this thread) are with you for life.
Sense of self is quite possibly an illusion a bunch of separate processes in the brain use to organize things. If this is true, changing some of those gradually enough will preserve your sense of self. This is what any experience does to you in various degrees. (Changing them rapidly might conflict with previous memory though.) Even remembering something rewrites that memory and you end up with a slightly different one.
So it is possible that not only your body gets completely replaced many times over, but your identity and memories and thinking processes get replaced by imperfect copies.
[0] https://en.m.wikipedia.org/wiki/Ship_of_Theseus