"What the set of real numbers contains can't be defined in any strict formal way."

On the contrary. There are multiple ways to rigorously define the Real Numbers. The most popular way is perhaps Cauchy sequence: https://en.wikipedia.org/wiki/Cauchy_sequence

There are also Dedekind cuts: https://en.wikipedia.org/wiki/Dedekind_cut