Hacker News new | past | comments | ask | show | jobs | submit login

Actually Doug Cutting himself (who created Hadoop) tweeted about this. I guess Spark gets some of his blessing :)

As pointed out in the article multiple times, we are comparing with MR here. We are not comparing with Hadoop as an ecosystem. Spark plays nicely with Hadoop. As a matter of fact, this experiment ran on HDFS.

In terms of vibrant community, Spark is now the largest open source Big Data project by community/contributor count. More than 300 people have contributed code to the project.




I remember Nathan Marz saying that Storm is the most active project on Github about a year ago. ;)


That may well have been true a year ago, but it is not true as of a few weeks ago [1], and hasn't been true since around Spring of this year.

[1] http://youtu.be/zW0Pqfb8ij0?t=3m50s





Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: