It is pretty crowded, actually. We've had satellites literally colliding with each other before. Filling it up with chunks of asteroid isn't the best use of limited room, especially when space farther away is genuinely empty and since you're coming from outside the Earth/Moon system you can put the goods anywhere you want.