Feels like science papers need a comment section. Replace peer-review with public-review. A way for authors to interact with the larger (science) community.
Openreview is nice. I guess it could integrate with arxiv to allow preprints but someone needs to pay for moderation if we are to keep a high standard of comments.
https://www.papertalk.xyz/ was on HN Frontpage but seems to not have gained any traction (yet).
Maybe arxiv should consider implementing it or integrating with some 3rd party?