Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

No, in our case they were indexing job posts by sending search requests. Ie instead of pulling down the JSON files of jobs, they would search for them by sending stuff like “New York City, New York software engineer” to our search. Generally not cached because the searches weren’t something humans would search for (they’d use the location drop down).

I didn’t work on search, but yeah, something like Elasticsearch. Googlebot was a majority of our search traffic at times.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: