I have implemented a scaled down version of this that just identifies the select... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

pstorm on March 25, 2023 | parent | context | favorite | on: Experimental library for scraping websites using O...

I have implemented a scaled down version of this that just identifies the selectors needed for a scraper suite to use. for my single use case, I was able to optimize it to nearly 100% accuracy.

Currently, I am only triggering the GPT portion when the scraper fails, which I assume means the page has changed.

rengler33 on March 25, 2023 [–]

That sounds really useful, can you provide a link if it's publicly hosted?

pstorm on March 25, 2023 | [–]

It's intimately tied to the rest my repo, but I'll spend some time tonight and try to pull it out into it's own library.

acapybara on March 25, 2023 | | | [–]

Very interested to see this.

danr4 on March 26, 2023 | | | | [–]

Very interested too!

malborodog on March 25, 2023 | | | [–]

+1 for interest there

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact