That's odd - Selenium has been my go-to when I need to scrape and Scrapy won't s... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

CalRobert on Nov 10, 2022 | parent | context | favorite | on: Web automation: Don't use Selenium, use Playwright

That's odd - Selenium has been my go-to when I need to scrape and Scrapy won't suffice (I'm not doing anything too huge in scale) and it handles web apps well. I do have a lot of waiting for elements to be visible, admittedly.

Finnucane on Nov 10, 2022 [–]

Testing, scraping, and automating are not really the same tasks.

epolanski on Nov 10, 2022 | [–]

I'm a heavy user of playwright and I find it by far the best tool for all of three.

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact