Thats the thing, So I get that it gives you network aware Fork() Its just the scheduling is a bit, well, lacking.

In my datacenter, we run dirty cheap iron. The only thing special are the core switches(lots and lots of ten gig ports, to cope with the petabytes that we shove across it daily)

we use standard linux tools, sharded posix file systems with a decent task dispatcher that understands dependencies.