IP Library Granted Patent US 10,163,049
Granted Patent B2
US 10,163,049 · App. 13/789,943 · Granted Dec 25, 2018

Inconspicuous tag for generating augmented reality experiences

Inventors: Nigel David Tout (Woodinville, WA); Aditya Goteti (Issaquah, WA); Jack Clevenger (Woodinville, WA)
Assignee: Microsoft Technology Licensing, LLC
G06K19/0614G06K19/06046G06K19/06159
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,163,049
App. No.
13/789,943
Granted
Dec 25, 2018
Kind
B2
Abstract

A system and method for generating virtual objects, the data for the virtual object is retrieved at least in part from a tag. The tag comprises a transparent physical surface and a visually imperceptible structure constructed in the transparent physical surface. The tag encodes the data for the virtual objects in the visually imperceptible structure. When detected by the appropriately configured capture devices, the visually imperceptible structure produces a depth pattern that is reflected in phase shifts between regions in the tag.

Claims (54)

1. A method for generating a virtual object on a display device, the method comprising:

scanning a physical environment;

detecting a physical tag associated with a physical object in the physical environment;

obtaining data relating to display of the virtual object from the detecting of the physical tag; and

rendering the virtual object on the display device as at least a partial overlay to the physical object.

2. The method of claim 1 , wherein the physical tag comprises a depth pattern reflected in a phase shift between regions, the method further comprising decoding the depth pattern to obtain the data relating to the display of the virtual object.

3. The method of claim 1 , wherein the rendering of the virtual object comprises adjusting colors of the virtual object to improve visibility of the virtual object against a viewing location.

4. The method of claim 1 , wherein the rendering of virtual object comprises displaying the virtual object in accordance with user interactions.

5. The method of claim 1 , further comprising determining a rendering location for the virtual object relative to an image of the physical environment.

6. The method of claim 5 , wherein the determining the rendering location comprises:

acquiring a three-dimensional map of the physical environment;

identifying one or more regions in the acquired three-dimensional map;

associating the physical tag with the one or more regions; and

associating the virtual object corresponding to the physical tag with the rendering location relative to the one or more regions.

7. The method of claim 6 , wherein the one or more regions comprise one or more objects in the physical environment.

8. The method of claim 5 , wherein the determining the rendering location comprises:

acquiring a three-dimensional map of the physical environment;

identifying a location of the physical tag within the acquired three-dimensional map;

associating the virtual object corresponding to the physical tag with the rendering location relative to the location of the physical tag.

9. The method of claim 6 , wherein the rendering location comprises a location relative to a location of the physical tag.

10. The method of claim 6 , wherein the rendering location comprises a location relative to a feature of the physical environment.

11. The method of claim 1 , wherein the rendering of the virtual object on the display device as at least the partial overlay to the physical object comprises rendering the virtual object within a predefined area of the physical object.

12. The method of claim 1 , further comprising:

accessing a user profile that includes user interests; and

selecting content for the virtual object based at least in part on the user interests.

13. A method implemented by a processor and a depth sensing capture device, comprising

scanning a physical environment using the depth sensing capture device;

detecting, in the physical environment, a static tag associated with a physical object, the static tag including a transparent physical surface, and a visually imperceptible depth pattern constructed in the transparent physical surface, the visually imperceptible depth pattern encoding data related to a display of a virtual object;

obtaining the data related to the display of the virtual object based on the detecting of the static tag;

retrieving a virtual object definition associated with the virtual object; and

rendering, based at least in part on the virtual object definition, the virtual object on a display device as at least a partial overlay to the physical object.

14. The method of claim 13 , wherein the static tag is attached to one or more surfaces in the physical environment.

15. The method of claim 13 , wherein the detecting includes detecting the visually imperceptible depth pattern by determining a phase shift to electromagnetic waves reflected by materials.

16. The method of claim 13 , wherein the rendering the virtual object includes determining a rendering location by:

acquiring a three-dimensional map of the physical environment;

identifying one or more regions in the acquired three-dimensional map;

associating the static tag with the one or more regions; and

associating the virtual object with the rendering location relative to the one or more regions associated with the static tag.

17. The method of claim 13 wherein the rendering the virtual object includes determining a rendering location by:

acquiring a three-dimensional map of the physical environment;

identifying a location of the static tag within the acquired three-dimensional map;

associating the virtual object with the rendering location relative to the location of the static tag.

18. A device comprising:

a display;

a processor; and

memory storing instructions that, when executed by the processor, cause the device to perform operations comprising:

scanning a physical environment;

detecting a physical tag associated with a physical object in the physical environment;

obtaining, from the physical tag, data describing a display of a virtual object; and

rendering the virtual object on the display as at least a partial overlay to the physical object based at least in part on the obtained data.

19. The device of claim 18 , wherein the rendering of the virtual object on the display as at least the partial overlay to the physical object comprises rendering the virtual object within a predefined area of the physical object.

20. The device of claim 18 , wherein the operations further comprise:

accessing a user profile that includes user interests; and

selecting content for the virtual object based at least in part on the user interests.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 4, 2015
From: TOUT, NIGEL DAVID; GOTETI, ADITYA; CLEVENGER, JACK
To: MICROSOFT CORPORATION
Reel/Frame 035789/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →
Continuity (1)
Related Publication 20140253589A1 · Sep 11, 2014
Cited By (1)
US 12,204,111