Would be interested to hear a bit more about your experience. Is your software experience with low level firmware/ kernel stuff? Are you finding the math for EE hard to pick up?
My software experience is partly low level firmware stuff but I have also designed databases and done backend/frontend work. I'm mostly doing FPGA and PCB design. Where you do need a little bit of math but it's all pretty basic stuff. Nothing I didn't get during my software degree.
What math do EEs actually use? I have an EE degree and I didn't find the math content in it particularly daunting and in the actual EE courses I felt hardly any math was used beyond at most basic calculus.