>Linear motion is still a problem, because, if all you have is accelerometers, position and velocity error accumulates rapidly.

An INS will usually need some kind of sensor fusion to become accurate anyways. Like how certain intercontinental ballistic missiles use stars (sometimes only a single one) as reference. But all these things are based on the assumption of clear sight and even this google maps image based navigation will fail if the weather is bad.