DETERMINING POSE FOR USE WITH DIGITAL WATERMARKING, FINGERPRINTING AND AUGMENTED REALITY
Image recognition and augmented reality experiences utilize auxiliary data extracted from an image or video, or image fingerprints, or a combination of both. One claim recites a method of controlling a device, the device comprising a camera and a display screen. The method comprises: receiving image data captured by the camera; modifying received image data to compensate for distortion caused by capture positioning of the camera relative to an imaged subject; analyzing modified imagery to detect an encoded signal therefrom; extracting a digital fingerprint from the modified imagery, the digital fingerprint corresponding to an image area hosting the encoded signal; determining a relative spatial position of the image area based on the digital fingerprint; and providing the relative spatial position of the image area to an augmented reality (AR) system, in which the AR system overlays graphics or video on the display screen corresponding to the image area. Of course other claims and combinations are provided as well.
1 . A method of controlling a device, the device comprising a camera and a display screen, said method comprising:
receiving image data captured by the camera;
modifying received image data to compensate for distortion caused by capture positioning of the camera relative to an imaged subject;
analyzing modified imagery to detect an encoded signal therefrom;
extracting a digital fingerprint from the modified imagery, the digital fingerprint corresponding to an image area hosting the encoded signal;
determining a relative spatial position of the image area based on the digital fingerprint; and
providing the relative spatial position of the image area to an augmented reality (AR) system, in which the AR system overlays graphics or video on the display screen corresponding to the image area.
2 . The method of claim 1 in which said extracting utilizes a linear projection.
3 . The method of claim 1 in which said determining compares the digital fingerprint to a plurality of digital fingerprints, with each of the plurality of digital fingerprint corresponding to a different spatial image area of the received image data.
4 . The method of claim 3 in which the AR system overlays graphics or video on the display screen corresponding to the different spatial image areas.
5 . The method of claim 3 in which the plurality of digital fingerprints are stored in a remote server.
6 . The method of claim 1 in which the encoded signal comprises orientation attributes, said method further comprising providing the orientation information to the AR system, the orientation information obtained from analysis of the orientation attributes, in which the AR system utilizes the orientation attributes to overlay graphics or video on the display screen.
7 . The method of claim 6 in which the encoded signal comprises digital watermarking.
8 . The method of claim 1 in which the encoded signal comprises digital watermarking.
9 . A method comprising:
receiving imagery captured by a camera incorporated into a device, the device comprising a display screen;
analyzing the imagery to decode an encoded signal therefrom, in which the encoded signal comprises orientation attributes;
determining orientation information from the orientation attributes, the orientation information being associated with a capture position of the device sensor relative to an imaged subject;
utilizing the orientation information as pose input for use by an augmented reality (AR) system, the pose input updating or resetting pose information being used by the AR system;
based on spatial information provided by the AR system, displaying graphics or video over the imagery on the display screen.
10 . The method of claim 9 in which the pose information utilizes key points within the imagery.
11 . The method of claim 9 in which the pose input comprises an input to a homography generator.
12 . The method of claim 9 further comprising:
modifying the imagery based on the orientation information, said modifying yielding modified imagery; and
extracting a digital fingerprint from a spatial area hosting the encoded signal within the modified imagery.
13 . The method of claim 9 in which the encoded signal comprising digital watermarking.
14 . An apparatus comprising:
a camera for capturing image data;
a display screen; and
one or more processors configured for:
transforming captured image data to compensate for distortion caused by capture positioning of said camera relative to an imaged subject;
detecting an encoded signal from the transformed imagery;
generating a digital fingerprint from the transformed imagery, the digital fingerprint corresponding to an image area hosting the encoded signal;
determining a relative spatial position of the image area based on the digital fingerprint; and
providing the relative spatial position of the image area to an augmented reality (AR) system, in which the AR system overlays graphics or video on said display screen corresponding to the image area.
15 . The apparatus of claim 14 in which the generating utilizes a linear projection.
16 . The apparatus of claim 15 in which said determining compares the digital fingerprint to a plurality of digital fingerprints, with each of the plurality of digital fingerprint corresponding to a different spatial image area of the captured image data.
17 . The apparatus of claim 16 in which the AR system overlays graphics or video on the display screen corresponding to the different spatial image areas.
18 . The apparatus of claim 16 in which the plurality of digital fingerprints are stored in a remote server.
19 . The apparatus of claim 14 in which the encoded signal comprises orientation attributes, and in which said one or more electronic processor are configured for providing the orientation information to the AR system, the orientation information obtained from analysis of the orientation attributes, in which the AR system utilizes the orientation attributes to overlay graphics or video on the display screen.
20 . The apparatus of claim 19 in which the encoded signal comprises digital watermarking.