> Question: do these bots not respect robots.txt? No they don't, because there i...

		throw_m239339 7 months ago \| parent \| context \| favorite \| on: Nepenthes is a tarpit to catch AI web crawlers > Question: do these bots not respect robots.txt? No they don't, because there is no potential legal liability for not respecting that file in most countries.