Manufacturing a solar panel does have carbon impact, but the amount of that impact, relative to the total amount of energy it produces over its lifetime, is an order of magnitude smaller than that of coal, and several times smaller than even natural gas.

Ref.: http://www.parliament.uk/documents/post/postpn268.pdf