It is mainly the cost of getting nodes from EC2 at that point. It becomes hard t... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

rxin on Oct 10, 2014 | parent | context | favorite | on: Spark Breaks Previous Large-Scale Sort Record

It is mainly the cost of getting nodes from EC2 at that point. It becomes hard to get a huge number of i2.8xl instances.

Spark runs fine on thousands of nodes.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact