The patent application describes a process that uses sensors (compass, gyro and the like) to correct photographs. That's a lot like what's done with aerial photos.
It's titled: Image Capture Device Having Tilt and/or Perspective Correction
Methods and apparatuses are disclosed to correct for tilt and/or perspective distortion in image capture devices. In some embodiments, the method may include reading an orientation measurement associated with a relative position of an image capture device with respect to an object, determining if the orientation measurement is less than a threshold, and in the event that the orientation measurement is less than the threshold, correcting an image obtained by the image capture device. In some embodiments, the apparatus may include an image sensor, a memory coupled to the image sensor, an orientation measurement device coupled to the image sensor, and a distance measurement device coupled to the image sensor, where the image data may be stored in the memory along with a measurement from the accelerometer and along with a measurement from the distance measurement device.
- via CNET