There a many valid places to use the word 'log'. Anything that you want to note can go in some kind of a log. A change log is a log of changes. Your users will want to see the changes that are relevant to them, and they vastly outnumber the developers who want to see a commit log.
Code may be read more than it is written, but it is not read far more than either. You really should have both logs: one detailed for development, and one for your users.
I never wrote that end users should be presented with change logs; of course, you give them release notes.
Release notes are not logs. They omit changes, and present selected changes in a different order. As soon as you have two sets of release notes for two releases in one file, then it's becoming a log: a log which captures sequences of release notes. I agree of keeping such a thing rather than giving end users just the notes for the current release.
In any case, developers should not be required to deposit any blurbs into any file as they are committing, regardless of its purpose and style.
Do go ahead and produce release notes, and then keep them in the repository. Do not mix code changes with changes to the release notes file.
Code may be read more than it is written, but it is not read far more than either. You really should have both logs: one detailed for development, and one for your users.