Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
mkonecny
on Feb 23, 2014
|
parent
|
context
|
favorite
| on:
Google's robots.txt
It just issues a "HTTP/1.1 302 Moved Temporarily" directed to their homepage. Requesting an invalid file such as "robots.txtsdfa32r523" has the same effect, so they probably don't have a robots file at all.
blossoms
on Feb 23, 2014
|
next
[–]
http://i.imgur.com/Jmjf3y2.png
judk
on Feb 23, 2014
|
prev
[–]
Huh? No, it is a regular robots.txt file
tonyedgecombe
on Feb 23, 2014
|
parent
[–]
It redirects requests from the UK.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: