True, but they're definitely in the same realm if you will. Just like Great Britain is part of Europe, and New Zealand is part of Australia. (Continentally-speaking!! Don't flame me, Kiwis).
Madagascar is Africa, Japan is Asia. I don't know what to categorize Iceland as, though.
All continents have shifted in that timescale. Perhaps more relevant is the connection to Austronesia: the first human settlers arrived in Madagascar about 2000-2500 years ago on outrigger canoes from Borneo. Bantu people came later, around 1000 AD, so they are "colonists" somewhat in the same way as Europeans are in America, although they mixed with rather than replaced the Austronesian "first nations".
Madagascar is Africa, Japan is Asia. I don't know what to categorize Iceland as, though.