Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
smeggysmeg
7 months ago
|
parent
|
context
|
favorite
| on:
Amazon's AI crawler is making my Git server unstab...
I've seen this tarpit recommended for this purpose. it creates endless nests of directories and endless garbage content, as the site is being crawled. The bot can spend hours on it.
https://zadzmo.org/code/nepenthes/
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
https://zadzmo.org/code/nepenthes/