All that mass is already orbiting (on a galactic scale) right on top of the mass. It'll affect our solar system's orbits in the same way that the sun moving a few microns affects them, I'd imagine.