This idea in physics that information is conserved, neither created nor destroyed, just transformed seems awfully similar to a computer to me. A classical computer is not the right metaphor really when you think of the universe as a possible computational process, but the parallels are striking to me.
I suspect it may be just necessarily true that information is preserved in a consistent universe. I don't know though, maybe someone could come up with a model for a consistent universe with information loss, but it seems to me that would lead to physically possible states that are not derivable from consistent laws of physics.