Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
chad_walters
on Oct 10, 2014
|
parent
|
context
|
favorite
| on:
Spark Breaks Previous Large-Scale Sort Record
Your post mentions "single root IO virtualization" as a factor in maximizing network performance. I am wondering what the impact of this was in your sorting. Do you have data for runs where you didn't enable this?
rxin
on Oct 10, 2014
[–]
It was part of the enhanced networking. Without enhanced networking, we were getting about 600MB/s, vs 1.1GB/s with.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: