Salient point-based arrangements
View Patent ↗A variety of methods and systems involving sensor-equipped portable devices, such as smartphones and tablet computers, are described. One particular embodiment decodes a digital watermark from imagery captured by the device and, by reference to watermark payload data, obtains salient point data corresponding to an object depicted in the imagery. Other embodiments obtain salient point data for an object through use of other technologies (e.g., NFC chips). The salient point data enables the device to interact with the object in a spatially-dependent manner. Many other features and arrangements are also detailed.
1. A method comprising:
receiving a first set of data corresponding to imagery captured by a camera-equipped portable device, the imagery depicting an object;
decoding steganographically-encoded digital watermark payload data from the first set of data; and
by reference to said payload data, obtaining a previously-established second set of data;
wherein the second set of data comprises salient point data, said salient point data comprising, for each of plural salient points on the object:
location information for said point on the object; and
orientation information for said point on the object, and/or information representing a feature vector associated with said location.
2. The method of claim 1 wherein the object comprises a poster.
3. The method of claim 1 that further includes determining location of the portable device relative to the object, through use of the salient point data.
4. The method of claim 1 that further includes determining 3D pose information that details position of the device relative to the object, through use of the salient point data.
5. The method of claim 1 that includes identifying a sub-part of the object depicted in the imagery, through use of the salient point data.
6. The method of claim 5 that includes, by reference to said identified sub-part, obtaining a third set of data, the third set of data including auxiliary data useful for presenting a display of information to a user that relates to said sub-part of the subject.
7. The method of claim 1 that further includes sizing or positioning a graphical feature presented on a screen of the portable device in accordance with the salient point data.
8. The method of claim 1 that further includes controlling an operation of the device based on the salient point data.
9. The method of claim 1 wherein the second set of data further comprises reference position data associated with the object, and the method includes determining position data for the portable device by reference to said reference position data and said salient points, wherein a user of the device can interact with the object in a position-dependent manner.
10. A system including a camera, a processor, and a memory, the memory including software instructions configuring the system to perform acts including:
receiving a first set of data corresponding to imagery captured by the camera, the imagery depicting an object;
decoding steganographically-encoded digital watermark payload data from the first set of data; and
by reference to said payload data, obtaining a previously-established second set of data;
wherein the second set of data comprises salient point data, said salient point data comprising, for each of plural salient points:
location information for said point on the object; and
orientation information for said point on the object, and/or information representing a feature vector associated with said location.
11. The system of claim 10 in which said acts further include determining location of the camera relative to the object, through use of the salient point data.
12. The system of claim 10 in which said acts further include determining 3D pose information that details position of the camera relative to the object, through use of the salient point data.
13. The system of claim 10 in which said acts further include identifying a sub-part of the object depicted in the imagery, through use of the salient point data.
14. The system of claim 13 in which said acts further include, by reference to said identified sub-part, obtaining a third set of data, the third set of data including auxiliary data useful for presenting a display of information to a user that relates to said sub-part of the subject.
15. The system of claim 10 in which said acts further include sizing or positioning a graphical feature presented on a screen of the system in accordance with the salient point data.
16. The system of claim 10 in which said acts further include controlling an operation of the system based on the salient point data.
17. The system of claim 10 wherein the second set of data further comprises reference position data associated with the object, and the method includes determining position data for the camera by reference to said reference position data and said salient points, wherein a user of the system can interact with the object in a position-dependent manner.
18. A non-transitory computer readable medium containing software instructions for configuring a programmable, camera-equipped device to perform acts including:
receiving a first set of data corresponding to imagery captured by the camera, the imagery depicting an object;
decoding steganographically-encoded digital watermark payload data from the first set of data; and
by reference to said payload data, obtaining a previously-established second set of data;
wherein the second set of data comprises salient point data, said salient point data comprising, for each of plural salient points:
location information for said point on the object; and
orientation information for said point on the object, and/or information representing a feature vector associated with said location.
19. The computer readable medium of claim 18 wherein the second set of data further comprises reference position data associated with the object, and wherein said acts further include determining position data for the device by reference to said reference position data and said salient points, wherein a user of the device can interact with the object in a position-dependent manner.
20. The computer readable medium of claim 19 in which the acts further include controlling an operation of the device based on the second set of data.