Augmented reality display of scene behind surface
Embodiments are disclosed that relate to augmenting an appearance of a surface via a see-through display device. For example, one disclosed embodiment provides, on a computing device comprising a see-through display device, a method of augmenting an appearance of a surface. The method includes acquiring, via an outward-facing image sensor, image data of a first scene viewable through the display. The method further includes recognizing a surface viewable through the display based on the image data and, in response to recognizing the surface, acquiring a representation of a second scene comprising one or more of a scene located physically behind the surface viewable through the display and a scene located behind a surface contextually related to the surface viewable through the display. The method further includes displaying the representation via the see-through display.
1. On a computing device comprising an outward-facing image sensor, a method comprising:
acquiring, via the outward-facing image sensor, image data of a first scene;
recognizing a surface based on the image data;
in response to recognizing the surface, acquiring a representation of a second scene comprising one or more of a scene located physically behind the surface and a scene located behind a surface contextually related to the surface; and
displaying the representation via a display device.
2. The method of claim 1 , wherein recognizing the surface comprises identifying a location of the computing device based on one or more of location data from a location sensor and the image data from the outward-facing image sensor, and recognizing the surface based upon the location of the computing device.
3. The method of claim 1 , wherein recognizing the surface comprises recognizing whether the surface is a movable surface or an unmovable surface, and displaying the representation only if the surface is a movable surface.
4. The method of claim 1 , wherein the second scene is located behind the surface contextually related to the surface, and wherein recognizing the surface comprises determining a context of the surface by identifying one or more of an object incorporating the surface and an object located physically behind the surface.
5. The method of claim 4 , wherein acquiring the representation of the second scene comprises selecting the representation from a plurality of representations of scenes comprising surfaces related by context to the surface.
6. The method of claim 1 , wherein the second scene is physically located behind the surface, and wherein the method further comprises:
receiving an input to acquire a representation of a third scene physically located behind a surface in the second scene;
in response to the input, acquiring the representation of the third scene; and
displaying the representation of the third scene via the display device.
7. The method of claim 1 , wherein the display device is a see-through display-device, and wherein displaying the representation comprises displaying an image comprising a representation of the second scene in spatial registration with the surface to augment an appearance of the surface.
8. The method of claim 1 , further comprising detecting a trigger to display the representation, the trigger comprising one or more of a direct voice command, a contextual trigger, a programmatically-generated trigger, and a gesture.
9. The method of claim 1 , wherein acquiring the representation of the second scene comprises determining a most recent representation of the second scene and acquiring the most recent representation of the second scene.
10. A computing device, comprising:
a see-through display device;
an outward-facing image sensor configured to acquire image data of a scene viewable through the see-through display device;
a logic subsystem configured to execute instructions; and
a data-holding subsystem comprising instructions stored thereon that are executable by a logic subsystem to:
recognize a surface viewable through the display based on the image data,
in response to recognizing the surface, acquire a representation of one or more of a scene located physically behind the surface viewable through the display and a scene located behind a surface contextually related to the surface viewable through the display, and
display the representation via the see-through display.
11. The computing device of claim 10 , wherein the image sensor comprises one or more two-dimensional cameras.
12. The computing device of claim 10 , wherein the image sensor comprises one or more depth cameras.
13. The computing device of claim 10 , wherein the instructions are executable to retrieve the representation from a remote device over a computer network.
14. The computing device of claim 13 , wherein the instructions executable to acquire the representation comprise instructions executable to acquire image data previously collected by a device other than the computing device.
15. The computing device of claim 13 , wherein the instructions executable to acquire the representation comprise instructions executable to acquire real-time image data collected by a device other than the computing device.