Hopefully it's not people intentionally allowing the Google crawler and intentionally excluding Common Crawl with robots.txt?
Hopefully it's not people intentionally allowing the Google crawler and intentionally excluding Common Crawl with robots.txt?