IP Library Granted Patent US 9,129,430
Granted Patent B2
US 9,129,430 · App. 13/927,056 · Granted Sep 8, 2015

Indicating out-of-view augmented reality images

Inventors: Thomas George Salter (Seattle, WA); Ben Sugden (Woodinville, WA); Daniel Deptford (Redmond, WA); Robert Crocco, Jr. (Seattle, WA); Brian Keane (Bellevue, WA); Laura Massey (Redmond, WA); Alex Kipman (Redmond, WA); Peter Tobias Kinnebrew (Seattle, WA); Nicholas Kamuda (Seattle, WA); Zachary Quarles (Seattle, WA); Michael Scavezze (Bellevue, WA); Ryan Hastings (Seattle, WA); Cameron Brown (Redmond, WA); Tony Ambrus (Seattle, WA); Jason Scott (Kirkland, WA); John Bevis (Seattle, WA); Jamie B. Kirschenbaum (Redmond, WA); Nicholas Gervase Fajt (Seattle, WA); Michael Klucher (Santa Clara, CA); Relja Markovic (Seattle, WA); Stephen Latta (Seattle, WA); Daniel McCulloch (Kirkland, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06T19/006G06F3/011G06F3/013G06F3/04815G06T13/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,129,430
App. No.
13/927,056
Granted
Sep 8, 2015
Kind
B2
Abstract

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.

Claims (31)

1. A wearable augmented reality computing device, comprising:

a see-through display device;

a graphical user interface displayed via the see-through display device;

a sensor system including one or more sensors;

a logic subsystem; and

a storage subsystem comprising instructions stored thereon that are executable by the logic subsystem to:

detect one or more objects located outside a field of view of the see-through display device available for the display of augmented reality imagery; and

for each object of the one or more objects, providing indications to the user of presence and direction of the object located outside the field of view, the indications including a virtual map representing a physical area greater than the field of view in a vertical user gaze direction and a horizontal user gaze direction; and

vary the indications provided to the user based on one or more of a change in a location of the object relative to the see-through display device, a distance of the object from the see-through display device, and a property of the object.

2. On an augmented reality computing device comprising a display system, a method for operating a user interface, the method comprising:

identifying one or more virtual objects located outside a field of view available for a display of augmented reality information; and

for each object of the one or more virtual objects, providing to the user an indication of positional information associated with the virtual object within the field of view adjacent to a periphery of the field of view.

3. The method of claim 2 , wherein the indication of positional information associated with the virtual object includes an indication of a position of the virtual object relative to a position of the user.

4. The method of claim 3 , wherein the indication of positional information associated with the virtual object is displayed on a see-through display system.

5. The method of claim 3 , wherein the indication of positional information associated with the virtual object is displayed on a see-through display system within the field of view of a user as a marker indicating a presence of the virtual object and a direction to turn to view the virtual object.

6. The method of claim 5 , wherein the marker comprises a tendril extending from a location within the field of view to the virtual object.

7. The method of claim 5 , further comprising varying a display of the marker based on one or more of a property of the virtual object, a distance from the virtual object to the user, and an orientation of the virtual object relative to the user.

8. The method of claim 7 , wherein varying a display of the marker comprises one or more of varying a color of the marker, varying an opacity of the marker, varying a size of the marker, varying a shape of the marker, and varying a movement of the marker.

9. The method of claim 2 , wherein the indication of positional information associated with the virtual object comprises one or more sounds emitted from speakers indicating a presence of the virtual object.

10. The method of claim 9 , further comprising varying the one or more sounds emitted from speakers based on one or more of a property of the virtual object, a density of objects, a distance from the virtual object to the user, and an orientation of the virtual object relative to the user.

11. The method of claim 10 , wherein varying the one or more sounds emitted from speakers comprises one or more of varying a volume of the one or more sounds, varying one or more frequencies of the one or more sounds, varying a position of the one or more sounds, and varying a tactile response.

12. The method of claim 2 , wherein the display system comprises a see-through display system, and wherein the indication of positional information associated with the virtual object is displayed on the see-through display system as a virtual map.

13. The method of claim 2 , wherein the indication of positional information associated with the virtual object is provided in response to user input.

14. On an augmented reality computing device comprising a see-through display system, a method for operating a user interface, the method comprising:

identifying an object located outside a field of view of the see-through display system available for a display of augmented reality information; and

displaying via the see-through display system a tendril that leads from a location within the field of view toward the object, the tendril indicating a visual path to follow to locate the object.

15. The method of claim 14 , wherein the tendril extends to the object.

16. The method of claim 14 , further comprising animating an appearance of the tendril based upon user interaction with the object.

17. The method of claim 14 , further comprising emitting a sound from one or more speakers to indicate creation of the tendril.

18. The method of claim 14 , further comprising ceasing to display the tendril when the object enters the field of view.

19. The method of claim 18 , further comprising varying a display of the tendril based on one or more of a property of the object, a distance from the object to the user, and an orientation of the object relative to the user, wherein varying a display of the tendril comprises one or more of varying a color of the tendril, varying an opacity of the tendril, varying a size of the tendril, varying a shape of the tendril, and varying a movement of the tendril.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2015
From: SALTER, THOMAS GEORGE; SUGDEN, BEN; DEPTFORD, DANIEL; JR., ROBERT CROCCO; KEANE, BRIAN; MASSEY, LAURA; KIPMAN, ALEX; KINNEBREW, PETER TOBIAS; KAMUDA, NICHOLAS; QUARLES, ZACHARY; SCAVEZZE, MICHAEL; HASTINGS, RYAN; BROWN, CAMERON; AMBRUS, TONY; SCOTT, JASON; BEVIS, JOHN; KIRSCHENBAUM, JAMIE B.; FAJT, NICHOLAS GERVASE; KLUCHER, MICHAEL; MARKOVIC, RELJA; LATTA, STEPHEN; MCCULLOCH, DANIEL
To: MICROSOFT CORPORATION
Reel/Frame 035672/0512 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →
Continuity (1)
Related Publication 20140375683A1 · Dec 25, 2014