We need either an app that can compile LaTeX source (+all included libs, which sounds like a lot, but it's equivalent to a JS-heavy web page) on all the clients (preferably as a browser plugin or integrated feature!)

or authors should distribute their PDFs as bundles that include formatted versions for all of paper, large screen, and small screen.