It also assumes that the density of stars is constant in an infinite universe.

You can have an infinite universe, but with all the stars located in just part of it, i.e. finite mass, infinite space.

Most of the light heads off into empty space, never to be seen again.