Set up a tarpit, put it in the robots.txt as a global exclusion, watch hilarity ...

		xg15 5 months ago \| parent \| context \| favorite \| on: Robots.txt is a suicide note (2011) Set up a tarpit, put it in the robots.txt as a global exclusion, watch hilarity ensue for all the crawlers that ignore the exclusion.