My guess is that it depends on the buildpack. The Python one wraps everything nicely in a virtual environment.

If my information is correct Heroku is using Linux containers to keep everything nice and sperate.