Systems & Methods for Variant Payloads in Augmented Reality Displays
Augmented-reality systems provide additional information to users, beyond what they can normally perceive with their own senses. Embodiments of the invention establish “cover objects” having an identifiable visual appearance, and provide systems and infrastructure to deliver the additional information to multiple users via a live digital-camera image when each user directs his or her camera at the cover object. Different users may receive different additional information when scanning the same cover object at the same time, and a single user may receive different additional information when scanning the same cover object at different times. Methods and systems for accomplishing this are described, and a number of applications using the capabilities of such systems are suggested.
1 . A method comprising:
imaging a scene containing a cover object using a digital camera having a live display;
identifying the cover object within the live display;
constructing an identifier associated with a user of the digital camera;
selecting an augmented data asset associated with both the identifier and the cover object from among a plurality of augmented data assets associated with the cover object; and
modifying the live display to include the augmented data asset near the cover object depicted on the live display.
2 . The method of claim 1 wherein the augmented data asset is a video depicting the user of the digital camera.
3 . The method of claim 1 wherein the augmented data asset is a first video advertisement for the cover object.
4 . The method of claim 3 , further comprising:
repeating the imaging, identifying and constructing operations;
selecting a second, different video advertisement from among the plurality of augmented data assets associated with the cover object; and
modifying the live display to include the second, different video advertisement near the cover object depicted on the live display.
5 . A system comprising for delivering different augmented reality (“AR”) content to different users, comprising:
a cover object;
a recognizer for the cover object in digital images of scenes including the cover object; and
a database containing a plurality of AR assets corresponding to the cover object, wherein
the system receives a sample image of a scene including the cover object captured by a digital camera of a user and an auxiliary datum,
identifies the plurality of AR assets associated with the cover object in the database,
selects one of the plurality of AR assets according to the auxiliary datum, and
delivers the selected one of the plurality of AR assets to the digital camera of the user so that the digital camera will composite the selected one of the plurality of AR assets on a live display of the digital camera near the cover object shown on the live display.
6 . The system of claim 5 wherein the sample image is a first sample image, the digital camera is a first digital camera and the auxiliary datum is a first auxiliary datum, and further wherein the system
receives a second sample image from a second digital camera of a similar scene including the cover object and a second auxiliary datum,
selects a different one of the plurality of AR assets according to the second auxiliary datum, and
delivers the different selected one of the plurality of AR assets to the second digital camera so that the second digital camera will composite the different selected one of the plurality of AR assets on a second live display of the second digital camera near the cover object shown on the second live display.
7 . The system of claim 5 wherein the cover object is a tangible physical object.
8 . The system of claim 7 wherein the cover object is a poster or a billboard.
9 . The system of claim 7 wherein the cover object is a photograph.
10 . The system of claim 7 wherein the cover object is a vehicle.
11 . A tangible computer-readable medium containing data and instructions that, when executed by a programmable processor, cause a system including the programmable processor to perform operations comprising:
receiving a first digital image transmitted from a first digital camera of a first user at a first time;
receiving a second digital image transmitted from a second digital camera of a second user near the first time, wherein the first digital image and the second digital image depict a similar scene in which a cover object is present in both the first and the second images;
receiving, in connection with the first digital image, a first non-image selector;
receiving, in connection with the second digital image, a second non-image selector;
identifying the cover object in both the first and second digital images;
retrieving a plurality of augmented data objects associated with the cover object;
selecting a first augmented data object from the plurality of augmented data objects according to the first non-image selector;
selecting a second augmented data object from the plurality of augmented data objects according to the second non-image selector;
transmitting the first augmented data object to the first digital camera of the first user; and
transmitting the second augmented data object to the second digital camera of the second user.
12 . The tangible computer-readable medium of claim 11 , wherein the first digital image and the second digital image are first and second hash fingerprints prepared from the first digital image and the second digital image, respectively, said first and second hash fingerprints encoding significant features of the first and second digital images to permit identification of the cover object within the first and second digital images.
13 . The tangible computer-readable medium of claim 11 , containing additional data and instructions to cause the system including the programmable processor to perform further operations comprising:
updating a first live display of the first digital camera to include the first augmented data object, said first augmented data object composited near the cover object on the first live display; and
updating a second live display of the second digital camera to include the second augmented data object, said second augmented data object composited near the cover object on the second live display, wherein
the updating operations of the first live display and the second live display occur substantially simultaneously.
14 . The tangible computer-readable medium of claim 11 , containing additional data and instructions to cause the system including the programmable processor to perform further operations comprising:
receiving a third digital image transmitted from the first digital camera of the first user at a second, different time, said third digital image depicting a scene in which the cover object is present;
receiving, in connection with the third digital image, a third non-image selector;
identifying the cover object in the third digital image;
repeating the retrieving operation to retrieve the plurality of augmented data objects associated with the cover object;
selecting a third augmented data object, different from the first augmented data object, according to the third non-image selector;
transmitting the third augmented data object to the first digital camera of the first user; and
updating the first live display of the first digital camera to include the third augmented data object, said third augmented data object composited near the cover object on the first live display.
15 . The tangible computer-readable medium of claim 11 wherein the cover object is a tangible object.
16 . The tangible computer-readable medium of claim 15 wherein the cover object is a landmark.
17 . The tangible computer-readable medium of claim 15 wherein the cover object is a magazine page.
18 . The tangible computer-readable medium of claim 11 wherein the cover object is an intangible object.
19 . The tangible computer-readable medium of claim 18 wherein the cover object is an illuminated pattern on a surface.
20 . The tangible computer-readable medium of claim 11 wherein the cover object is a person who can be recognized by an automatic image recognizer.