Hacker News new | past | comments | ask | show | jobs | submit login

Furthermore, what you mean with `Javascript pages supported`? Could I just specify where it has to click or do I need to make a reverse engineering of the ajax calls?



http://demo.pyspider.org/debug/js_test_sciencedirect is a sample for this.

There is a phantomjs fetcher that can render the page as WebKit did. Furthermore, you can have some JavaScript running before/after page loaded to simulate a mouse click.


But will it not be slow? Assuming downloading css/images etc?


Images not downloaded default. Both the fetcher and the phantomjs proxy is totally async.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: