This was fixed for me in November 2017 when Async Pan/Zoom (APZ) was implemented:

https://hacks.mozilla.org/2017/11/async-panzoom-apz-lands-in...

Also, Firefox 79+ on Android (August 2020) performs significantly better than older versions, despite having lost many features in the rewrite. The current version might meet your expectations.