IP Library Granted Patent US 9,761,057
Granted Patent B2
US 9,761,057 · App. 15/357,826 · Granted Sep 12, 2017

Indicating out-of-view augmented reality images

Inventors: Thomas George Salter (Seattle, WA); Ben Sugden (Woodinville, WA); Daniel Deptford (Redmond, WA); Robert Crocco, Jr. (Seattle, WA); Brian Keane (Bellevue, WA); Laura Massey (Redmond, WA); Alex Kipman (Redmond, WA); Peter Tobias Kinnebrew (Seattle, WA); Nicholas Kamuda (Seattle, WA); Zachary Quarles (Seattle, WA); Michael Scavezze (Bellevue, WA); Ryan Hastings (Seattle, WA); Cameron Brown (Redmond, WA); Tony Ambrus (Seattle, WA); Jason Scott (Kirkland, WA); John Bevis (Seattle, WA); Jamie B. Kirschenbaum (Redmond, WA); Nicholas Gervase Fajt (Seattle, WA); Michael Klucher (Santa Clara, CA); Relja Markovic (Seattle, WA); Stephen Latta (Seattle, WA); Daniel McCulloch (Kirkland, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06T19/006G02B27/0172G06F3/011G06F3/013G06F3/04815G06T13/20G02B2027/0178G06F3/017G06F3/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,761,057
App. No.
15/357,826
Granted
Sep 12, 2017
Kind
B2
Abstract

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.

Claims (37)

1. An augmented reality computing device comprising:

a display system;

a logic device; and

a storage device comprising instructions executable by the logic device to

identify a virtual object located outside a field of view available for a display of augmented reality information, the virtual object being world-locked and related to a real-world object,

display, within the field of view adjacent to a periphery of the field of view, a first marker providing an indication of positional information associated with the virtual object, the first marker comprising a first set of information associated with the real-world object,

detecting a change in position of the augmented reality computing device that brings the virtual object into the field of view, and

displaying a second marker within the field of view comprising a second set of information displayed regarding the real-world object.

2. The augmented reality computing device of claim 1 , wherein the instructions are executable to display the first marker based upon a query provided by user input to the computing device.

3. The augmented reality computing device of claim 1 , wherein the instructions are further executable to display the first maker based upon a location of the computing device and a location of the real-world object.

4. The augmented reality computing device of claim 1 , wherein the instructions are further executable to display the first marker with an appearance that varies based upon a quantity of objects associated with the first marker.

5. The augmented reality computing device of claim 1 , wherein the instructions are further executable to display the first marker with an appearance that varies based upon changes in location between the virtual object and the computing device.

6. The augmented reality computing device of claim 1 , wherein the instructions are further executable to display the first marker within the field of view adjacent to the periphery of the field of view at a side that indicates a relative location of the corresponding out-of-view object.

7. The augmented reality computing device of claim 1 , wherein the instructions are further executable to display the first marker comprising the first set of information as including less information than the second marker.

8. The augmented reality computing device of claim 7 , wherein the second set of information comprises a link to content stored externally and/or content retrieved from an external source.

9. An augmented reality computing device comprising:

a display system;

a logic device; and

a storage device comprising instructions executable by the logic device to

identify a virtual object located outside a field of view available for display of augmented reality information,

display a marker associated with the virtual object on a virtual map at a first location, the virtual map representing a physical area greater than the field of view, the field of view represented as a subregion within the virtual map, and the marker displayed outside of the subregion within the virtual map,

detect movement of the augmented reality computing device to bring the virtual object within the field of view available for display of augmented reality information, and

update the virtual map to display the marker associated with the virtual object on the virtual map within the subregion within the virtual map.

10. The augmented reality computing device of claim 9 , wherein the subregion comprises a center region of the virtual map.

11. The augmented reality computing device of claim 9 , further comprising a global positioning system, and wherein the instructions are executable to determine the location of the augmented reality computing device and display the marker based upon global positioning system data.

12. The augmented reality computing device of claim 9 , wherein the instructions are further executable configure an appearance of the marker based upon a type of real-world object.

13. The augmented reality computing device of claim 9 , wherein the instructions are executable to display the virtual map in a lower portion of the field of view.

14. On an augmented reality computing device comprising a see-through display, a method comprising:

identifying a virtual object located within a field of view available for display of augmented reality information,

displaying an animation within the field of view in response to an action performed on the virtual object to illustrate movement of the virtual object along a virtual path from a location within the field of view to a location outside the field of view, and

display a marker adjacent to a periphery of the field of view after the virtual object moves outside the field of view, the marker comprising an indication of a positional of the virtual object outside of the field of view.

15. The method of claim 14 , wherein the object comprises a photograph, user interface control, or an application interface.

16. The method of claim 14 , wherein the action performed on the virtual object comprises a gestural input.

17. The method of claim 14 , wherein the action performed on the virtual object comprises a speech input.

18. The method of claim 14 , wherein a velocity of the animation indicates a distance from the field of view at which the virtual object comes to rest.

19. The method of claim 14 , wherein the animation comprises a representation of a tendril leading toward a location of the object outside of the field of view.

20. The method of claim 19 , further comprising displaying an animation of a pulse moving along the tendril.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2016
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 040395/0156 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2016
From: SALTER, THOMAS GEORGE; SUGDEN, BEN; DEPTFORD, DANIEL; CROCCO, ROBERT, JR.; KEANE, BRIAN; MASSEY, LAURA; KIPMAN, ALEX; KINNEBREW, PETER TOBIAS; KAMUDA, NICHOLAS; QUARLES, ZACHARY; SCAVEZZE, MICHAEL; HASTINGS, RYAN; BROWN, CAMERON; AMBRUS, TONY; SCOTT, JASON; BEVIS, JOHN; KIRSCHENBAUM, JAMIE B.; FAJT, NICHOLAS GERVASE; KLUCHER, MICHAEL; MARKOVIC, RELJA; LATTA, STEPHEN; MCCULLOCH, DANIEL
To: MICROSOFT CORPORATION
Reel/Frame 040661/0233 →
Continuity (3)
Continuation 14805762 · Jul 22, 2015
Continuation 13927056 · Jun 25, 2013
Related Publication 20170069143A1 · Mar 9, 2017