Hacker News new | past | comments | ask | show | jobs | submit login

Any particular libraries or techniques you used for the crawling / parsing, or just coded up something from scratch for each site you crawl? (I think I noticed you even do kijiji.)



All of it is from scratch. Yep, I do Kijiji, but only in Canada, because I was told it's more important than CL in some parts there.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: