PySpark does not run Python code on the JVM. It uses py4j and it is slow as mola...

enigmo on Feb 12, 2015 | parent | context | favorite | on: Let's Build a Modern Hadoop

PySpark does not run Python code on the JVM. It uses py4j and it is slow as molasses. This has the benefit of supporting native Python libraries like NumPy. If you're not using such libraries you'd be better off using a JVM language, including Jython.