https://en.m.wikipedia.org/wiki/Croquet_Project is basically what you described. Dynamicland also has similarities. Neither are mixed reality like Hololens but long-term I think it will be the application model that wins for MR.