Cloudflare sees a lot of the web traffic. I assume these are the biggest bots th... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		hennell 9 months ago \| parent \| context \| favorite \| on: Cloudflare Introduces Default Blocking of A.I. Dat... Cloudflare sees a lot of the web traffic. I assume these are the biggest bots they're seeing right now, and any new contenders would be added as they find them. Probably impossible to really block everything, but they've got the web-coverage to detect more than most.

TechDebtDevin 9 months ago [–]

They are lying. They cant detect crawlers unless we tell them we are who we are.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact