In this specific use case I think we should avoid any creative aspect in the behavior of the LLM. Compiling might look like a "word-for-word" translation in a certain manner. Isn't it ?

I see no inherent conflict between creativity and determinism. You could give the compiler a seed value to perturbate the solution space.

Why vote down a rhetorical question?