I prefer one package manager for OS-wide system tools. Then I can just do "brew upgrade" and have everything in sync.
I'm not a Python dev, so I don't care what Pip has installed. I would want to be able to blow my Python installation and not worry about my system tools disappearing.