Hacker News new | past | comments | ask | show | jobs | submit login

We're seriously considering this option (maybe for scrapy 2.0?), but no concrete plans yet. It can't be just asyncio - we'll need e.g. aiohttp and other packages.

Some links:

* POC for aiohttp as a http handler: https://github.com/scrapy/scrapy/pull/1455

* some thought about how to make async/await API for Scrapy; it is not all roses: https://github.com/scrapy/scrapy/issues/1144#issuecomment-14...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: