I deal(t) with the same thing. I made it so my web server would try to stream a page that never ends, and some bots would stay connected for hours and hours. But over time they seem to have adapted.
I've also noticed some of them used to make requests synchronously (waiting for the previous to finish before making another), but they have adapted to make requests in parallel and add timeouts so they don't have their time wasted quite as long.
I created a log of the ones who stayed connected the longest.
I've also noticed some of them used to make requests synchronously (waiting for the previous to finish before making another), but they have adapted to make requests in parallel and add timeouts so they don't have their time wasted quite as long.
I created a log of the ones who stayed connected the longest.
https://gist.github.com/scryptonite/5324724
I don't bother to maintain it anymore, but it was pretty interesting watching them change tactics over time.