Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

OpenAI straight up DoSed a site I manage for my in-laws a few months ago.




What is it about? I'm curious what kinds of things people ask that floods sites.

The site is about a particular type of pipeline cleaning (think water/oil pipelines). I am certain that nobody was asking about this particular site or even the industry its in 15,000 times a minute 24 hours a day.

It's much more likely that their crawler is just garbage and got stuck into some kind of loop requesting my domain.


It's common to see them get stuck in a loop on online stores trying every combination of product filter over and over.

Even Googlebot has to be told to not crawl particular querystrings, but the AI crawlers are worse.


Not an online store just a bog standard Wordpress site

I suppose that they just keep referring to the website in their chats, and probably they have selected the search function, so before every reply, the crawler hits the website



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: