It would help if Yelp allowed new, emerging search engines (potential google com... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

AznHisoka on July 4, 2017 | parent | context | favorite | on: Yelp’s Six-Year Conflict with Google

It would help if Yelp allowed new, emerging search engines (potential google competitors) to crawl their site. But their robots.txt only allows Google, Bing and a few others to crawl them (https://yelp.com/robots.txt)

allow all crawlers and I would have at least a little sympathy for Yelp.

bdcravens on July 4, 2017 | [–]

Presumably they want a legal defense against scrapers.

anindha on July 5, 2017 | [–]

There are probably food delivery and restaurant reservation startups complaining that Yelp has a monopoly position on restaurant search.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact