I have seen this. Its pretty cool and I do want to learn it.
What I am thinking of is much more of programming language though. The fundemental object is something like a composable tree with some additional state.
What I mean is that the react core library does not assume an html target but rather builds a virtual component tree that can be mapped to various semantics (the two I know of are react-dom that produces a DOM and react native that produces whatever is used in mobile UIs)
You could sorta recycle the idea or maybe check if React with SVG might be enough for a (low frame rate) prototype.
It does indeed sound like a very infectious obsession, I hope I can forget about the idea :-)
https://derivative.ca/