Noam said it best :-)

http://twitter.com/FakeChomsky

> there is a relatively low barrier to entry for new search engines

WTF??

I guess this is just asking for negative karma, but I too thought that the conventional wisdom was that the barrier to entry for search engines was relatively high.

No, not telecom high, but it does take a pretty significant amount of hardware to index and deliver that much data. No?

> it does take a pretty significant amount of hardware to index and deliver that much data. No?

That's a barrier due to the intrinsic nature of the technology in question. It's not a barrier due to legal, political, social, etc difficulties.

Duck Duck Go has been doing a pretty good job of it, and from what I can tell, it's just one guy, self-financed.

He primarily relies on Y!BOSS, which uses a $300M infrastructure.

New search engines pop up often. Off the top of my head: Cuil and Powerset. How often do new telecommunications companies pop up? The key word was relatively. Search engines aren't lemonade stands, but they aren't telecom companies either.

Crawling a few million pages, making some sort of searchable index, and building a simple frontend is a nice exercise for anyone, and building a new search engine as such is nothing special.

Getting something up and running that has a good enough coverage of the web, constantly has fresh enough content, is able to catch up on sudden events (ie. Michael Jackson's death) and show relevant content within a maximum of a couple of minutes, is scalable and can handle the load if it becomes popular, has a low enough latency for the end user (a single server in a basement halfway around the world does not do the trick), AND offers something of significance that makes users actually want to change their habits and switch from their current search engine... Now, that's a whole different story.

Especially the last one is tricky. Even though I agree that in theory the cost of switching search engines is pretty close to zero, these habits die hard unless you have something to offer that is obviously much better.

So while Cuil and Powerset got a little bit of IT media attention, I don't think it is fair to say that they actually grabbed that much of Google's market share? And I'm not really sure it is that easy to make a new search engine that will be able to get the market share of ie. Yahoo!, Bing or Ask. Unless you can do most of the things mentioned above AND you have that extra special feature on top that makes everyone stop and stare. (Which then would have to be something the other search engines could not easily implement too and roll out within months :)

Disclaimer: I work for Yahoo!, but these opinions are mine alone.