Well, if you want to try something different, here's a modified camera that removes the microlens array along with color filters to make the sensor monochrome.[1]
Alternatively, you could tilt the sensor as you move it to compensate. Perhaps moving it on a curved path to match the optical center? I don't know how well that would work with variable focal length lenses, though.
If you've ever seen a ball cutter attachment for a lathe, or one of those parallax eliminating camera mounts, you could step the sensor along a sphere instead of a plane.
[1] https://maxmax.com/maincamerapage/uvcameras/raspberry-pi-hq-...