Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
viddi
on Aug 15, 2017
|
parent
|
context
|
favorite
| on:
I Bought a Book About the Internet from 1994 and N...
To clear things up: robots.txt can retroactively
hide
content from the archive. If it's changed back to allowing the archive's crawler, content from before the ban can be accessed again.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: