IP Library Granted Patent US 9,501,873
Granted Patent B2
US 9,501,873 · App. 14/805,762 · Granted Nov 22, 2016

Indicating out-of-view augmented reality images

Inventors: Thomas George Salter (Seattle, WA); Ben Sugden (Woodinville, WA); Daniel Deptford (Redmond, WA); Robert Crocco, Jr. (Seattle, WA); Brian Keane (Bellevue, WA); Laura Massey (Redmond, WA); Alex Kipman (Redmond, WA); Peter Tobias Kinnebrew (Seattle, WA); Nicholas Kamuda (Seattle, WA); Zachary Quarles (Seattle, WA); Michael Scavezze (Bellevue, WA); Ryan Hastings (Seattle, WA); Cameron Brown (Redmond, WA); Tony Ambrus (Seattle, WA); Jason Scott (Kirkland, WA); John Bevis (Seattle, WA); Jamie B. Kirschenbaum (Redmond, WA); Nicholas Gervase Fajt (Seattle, WA); Michael Klucher (Santa Clara, CA); Relja Markovic (Seattle, WA); Stephen Latta (Seattle, WA); Daniel McCulloch (Kirkland, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06T19/006G02B27/0172G06F3/011G06F3/013G06F3/04815G06T13/20G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,501,873
App. No.
14/805,762
Granted
Nov 22, 2016
Kind
B2
Abstract

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.

Claims (33)

1. On a see-through display device, a method comprising:

detecting one or more objects located outside a field of view of the see-through display device available for the display of augmented reality imagery;

for each object of the one or more objects, providing indications to the user of presence and direction of the object located outside the field of view, the indications including a virtual map representing a physical area greater than the field of view in a vertical user gaze direction and a horizontal user gaze direction; and

varying the indications provided to the user based on one or more of a change in a location of the object relative to the see-through display device, a distance of the object from the see-through display device, and a property of the object.

2. The method of claim 1 , wherein the indications comprise one or more of markers displayed on the see-through display device and sounds emitted from speakers.

3. An augmented reality computing device comprising:

a display system;

a logic device; and

a storage device comprising instructions executable by the logic device to

identify one or more virtual objects located outside a field of view available for a display of augmented reality information, and

for each object of the one or more virtual objects, provide to the user an indication of positional information associated with the virtual object within the field of view adjacent to a periphery of the field of view.

4. The augmented reality computing device of claim 3 , wherein the indication of positional information associated with the virtual object includes an indication of a position of the virtual object relative to a position of the user.

5. The augmented reality computing device of claim 4 , wherein the instructions are executable to display the indication positional information associated with the virtual object on the display system.

6. The augmented reality computing device of claim 4 , wherein the instructions are executable to display the indication positional information associated with the virtual object on the display system within the field of view of a user as a marker indicating a presence of the virtual object and a direction to turn to view the virtual object.

7. The augmented reality computing device of claim 6 , wherein the instructions are executable to display the marker as a tendril extending from a location within the field of view to the virtual object.

8. The augmented reality computing device of claim 6 , wherein the instructions are further executable to vary a display of the marker based on one or more of a property of the virtual object, a distance from the virtual object to the user, and an orientation of the virtual object relative to the user.

9. The augmented reality computing device of claim 8 , wherein the instructions are executable to vary the display of the marker by one or more of varying a color of the marker, varying an opacity of the marker, varying a size of the marker, varying a shape of the marker, and varying a movement of the marker.

10. The augmented reality computing device of claim 3 , wherein the instructions are executable to provide the indication of positional information associated with the virtual object as one or more sounds emitted from speakers indicating a presence of the virtual object.

11. The augmented reality computing device of claim 10 , wherein the instructions are further executable to vary the one or more sounds emitted from speakers based on one or more of a property of the virtual object, a density of objects, a distance from the virtual object to the user, and an orientation of the virtual object relative to the user.

12. The augmented reality computing device of claim 11 , wherein the instructions are executable to vary the one or more sounds emitted from speakers by one or more of varying a volume of the one or more sounds, varying one or more frequencies of the one or more sounds, varying a position of the one or more sounds, and varying a tactile response.

13. The augmented reality computing device of claim 3 , wherein the display system comprises a see-through display system, and wherein the instructions are executable to display the indication of positional information associated with the virtual object on the see-through display system as a virtual map.

14. The augmented reality computing device of claim 3 , wherein the instructions are executable to provide the indication of positional information associated with the virtual object in response to user input.

15. An augmented reality computing device comprising:

a see-through display system,

a logic device; and

a storage device comprising instructions executable by the logic device to

identify an object located outside a field of view of the see-through display system available for a display of augmented reality information; and

display via the see-through display system a tendril that leads from a location within the field of view toward the object, the tendril indicating a visual path to follow to locate the object.

16. The augmented reality computing device of claim 15 , wherein instructions are executable to display the tendril as extending to the object.

17. The augmented reality computing device of claim 15 , wherein the instructions are further executable to animate an appearance of the tendril based upon user interaction with the object.

18. The augmented reality computing device of claim 15 , wherein the instructions are further executable to emit a sound from one or more speakers to indicate creation of the tendril.

19. The augmented reality computing device of claim 15 , wherein the instructions are further executable to cease displaying the tendril when the object enters the field of view.

20. The augmented reality computing device of claim 19 , wherein the instructions are further executable to vary a display of the tendril based on one or more of a property of the object, a distance from the object to the user, and an orientation of the object relative to the user, and wherein the instructions are executable to vary a display of the tendril by one or more of varying a color of the tendril, varying an opacity of the tendril, varying a size of the tendril, varying a shape of the tendril, and varying a movement of the tendril.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 036153/0343 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2015
From: SALTER, THOMAS GEORGE; SUGDEN, BEN; DEPTFORD, DANIEL; CROCCO, ROBERT, JR.; KEANE, BRIAN; MASSEY, LAURA; KIPMAN, ALEX; KINNEBREW, PETER TOBIAS; KAMUDA, NICHOLAS; QUARLES, ZACHARY; SCAVEZZE, MICHAEL; HASTINGS, RYAN; BROWN, CAMERON; AMBRUS, TONY; SCOTT, JASON; BEVIS, JOHN; KIRSCHENBAUM, JAMIE B.; FAJT, NICHOLAS GERVASE; KLUCHER, MICHAEL; MARKOVIC, RELJA; LATTA, STEPHEN; MCCULLOCH, DANIEL
To: MICROSOFT CORPORATION
Reel/Frame 036159/0042 →
Continuity (2)
Continuation 13927056 · Jun 25, 2013
Related Publication 20150325054A1 · Nov 12, 2015