I have a similar anecdote — getting muddled between French and German when learning them back-to-back at school — but bringing sign into the mix blows mine away!
Makes a lot of sense actually. Just today I was forgetting the name of someone I had just written down in the morning, and visualising the japanese characters of their name as I had written them brought the name into clarity.