> I understand the idea that "if im googleing I want the index" but there is a reason google is increasingly burying their search results.

Yes. The reason being that Google does not want you to ure other websites than Google.