"Refined sugar" is sugar in fruit. It is literally the same thing. That's how we get sugar in the first place - from plants. You are dealing with glucose, fructose, and sucrose in both cases.
It’s not refined while it’s in the fruit. High content, but not refined.
Even with oranges which have very high sugar content, you cannot easily eat four oranges but you can drink their orange juice along with most of the sugar and none of the fiber.
The sugar lobby’s talking points steer the conversation toward equalizing refined and non refined sugars, and calories from refined sugars vs calories from non refined sugars.
