It's not really that linear because of compression. As an example, I shrunk a bunch of photos to 1/4 the resolution, and they only dropped in size about 1/4.

Plus, video can get even more aggressive about compression because it can reference between frames.