Maybe instead of selling scraping to end users, invert the problem and sell data to AI companies:
1. Pay users to install a browser extension that scrapes social media content they browse. Or ask them in exchange for a service, e.g. "remember everything I browse and make it searchable", etc.
2. Ship the data you scrape to your servers.
3. Sell training data to companies at a discount.
This gets past the new rate limiters and blocks that Reddit and others have installed.
1. Pay users to install a browser extension that scrapes social media content they browse. Or ask them in exchange for a service, e.g. "remember everything I browse and make it searchable", etc.
2. Ship the data you scrape to your servers.
3. Sell training data to companies at a discount.
This gets past the new rate limiters and blocks that Reddit and others have installed.