Hacker News new | past | comments | ask | show | jobs | submit login

Just wondering, if you don't want the information to be public, then why make it public? Put your website behind a login form, after which you can enforce (meaningless) terms of service as well as real technical solutions to prevent abusive scraping like rate limits or captchas.

Seems like you're trying to have your cake and eat it too. You're presumably happy for Google to scrape your website (and collect your customers' data for their purposes like ad tracking), but when a smaller site does it you're not happy? Make up your mind.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: