I wish google would let me crawl blogger pages for my index. I don't think that is fair that google can index the web, but has created a walled garden for the content they host.
Basically, if you start indexing the web, and some sites are hosted in blogger, google will block your crawler if I remember correctly
Woah, that is surprising. I note Bing has blogspot in its index anyway. Perhaps they use the ATOM API when they see a Blogspot URL? (technically not 'crawling')
Googled for "blogspot", picked first random domain I saw, "weliveyoung.blogspot.com", fetched "weliveyoung.blogspot.com/robots.txt" with curl, got a redirect to "weliveyoung.blogspot.co.uk/robots.txt", fetched that, voila.
I'm not entirely sure, I don't work there and don't know all that many people that do. I think that core ads is like search, a heavily data-driven, scientific, Stanford-based culture.
Actually, I'm nearing 500 premium users. That's the number of premium users using NewsBlur in the past 24 hours. In fact, all of those stats are aggregate for the past 24 hours.
It's the kind of transparency that I think goes hand-in-hand with being open-source. Why bother hiding it? I'm constantly watching those stats, so maybe other folks may also be interested. It also helps to know when there's a ton of activity, in case the site feels slow. Although it's been a long time that having a huge spike in traffic has made the site slow. Check that average load time graph. Notice how even though the number of feeds loaded has spiked in the past 3 hours, the average load time has actually gone down. Stats, for those who care, are endlessly fascinating.
They now have a pretty small Palo Alto office (<100 people) and over 3,000 in Chicago. I don't actually think it's that relevant as they started and got huge (Google wanted to buy them for $6Bn huge) without the presence in SV