You do know we actively use geothermal plants right now, right? It has almost no effect? Let alone compared to the effect of climate change.

The biggest concerns are specific techniques for pumping water, which (sometimes) can cause small earthquakes.