Like usual with us humans and our fickle minds, YMMV.

There are many factors that can impact this, though I would clarify - you aren’t losing memories, they’re there, just harder to access. You aren’t losing your sense of self, it’s evolving - who you are as a person is constantly changing.

For me personally, as someone with aphantasia I’ve never really been in touch with my memories in the first place. I’ve been very much a “in the moment” person - despite that my past experiences do define me, even if I don’t know why.