Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I wonder what would happen if they renamed the file to robots.txt and then did a redirect at the cloudflare level for the current URL to robots.txt.

I imagine some (many?) clients would handle it poorly, but it would then be cachable at least. It's not exactly easy to test though without a level of unknown damage to legitimate users.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: