If someone starts looking they will find this layer containing plutonium-244 (which is made by nuclear explosions, 80 million year half life) and microplastics, and yeah that will make it pretty obvious. But I think you're right that if it was even 5 million years in the future you would really have to be looking for it.