I dig everything you’re saying and think the way forward is something like that. But right now implementations are very limited by screens, in my experience. Like, even if there’s 360 of a virtual space avail to me by dragging the screen, it ends up having the same issues — it seems like, for me, a persistent space is needed. There’s also some research to suggest that having such permanence is helpful to learning — it’s easier to remember info from a physical book because your brain can associate the CONTENT with the actual physical experience of the book itself, which leads to greater retention (I think it’s similar to how mind palaces are meant to function).

A mix of AR glasses and physical simulacra is where I expect it to go eventually. As in, I have 10 book “blanks”, and when I use AR glasses, they become whatever I wish (from my library). Ideally I could then flip around the blanks and see the content of the books — making it much more like my actual physical workflow.

Tl;dr you’re 100% right that the means and method of viewing are critical to what I’m after. But I think the main through line for me is that if I’m having to manipulate the camera AND the content, it leads back to the same issues I currently face. The point for me is being able to interact as I usually do, but with access to “physical” versions of everything I have digital (albeit with digital convenience — such as exif data readily available on the “back” of a photograph).

Hope that all makes sense and thanks for treating this so seriously!