Hacker News new | past | comments | ask | show | jobs | submit login

To answer my own question, of course job listing sites want their sites to be discoverable. At least monster.com doesn't even have a robots.txt file.



Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: