I figure collaborate on answering the easy questions, is the website online, is it chock full of spam, is it a blog about horses or about keyboards, etc. Some of that could be automated (like onlineness, large change detection, etc.), but some of it needs manual supervision.

Right now everyone who is running any sort of curated discovery service needs to answer these same questions about roughly the same site.