IP Library › Granted Patent US 9,430,038
Granted Patent B2
US 9,430,038 · App. 14/267,625 · Granted Aug 30, 2016

World-locked display quality feedback

Inventors: Michael John Ebstyne (Seattle, WA); Frederik Schaffalitzky (Bellevue, WA); Drew Steedly (Redmond, WA); Ethan Eade (Seattle, WA); Martin Shetter (Bellevue, WA); Michael Grabner (Seattle, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06F3/011G02B27/0093G02B27/017G06T19/006G02B2027/014G02B2027/0178G02B2027/0187G06F2200/1637
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,430,038
App. No.
14/267,625
Filed
May 1, 2014
Granted
Aug 30, 2016
Kind
B2
Art Unit
2613
USPC
345/633
Abstract

Embodiments that relate to communicating to a user of a head-mounted display device an estimated quality level of a world-lock display mode are disclosed. For example, in one disclosed embodiment a sensor data is received from one or more sensors of the device. Using the sensor data, an estimated pose of the device is determined. Using the estimated pose, one or more virtual objects are displayed via the device in either the world-lock display mode or in a body-lock display mode. One or more of input uncertainty values of the sensor data and pose uncertainty values of the estimated pose are determined. The input uncertainty values and/or pose uncertainty values are mapped to the estimated quality level of the world-lock display mode. Feedback of the estimated quality level is communicated to a user via device.

Claims (43)

1. A method for communicating to a user of a head-mounted display device an estimated quality level of a world-lock display mode in which a position of one or more virtual objects appears to be fixed relative to real-world objects viewable through the head-mounted display device, the method comprising:

receiving sensor data from one or more sensors of the head-mounted display device;

using the sensor data, determining an estimated pose of the head-mounted display device;

using the estimated pose, displaying the one or more virtual objects via the head-mounted display device in either the world-lock display mode or in a body-lock display mode in which the position of each of the virtual objects appears to be fixed relative to the user of the head-mounted display device;

determining one or more input uncertainty values of the sensor data;

mapping the one or more input uncertainty values to the estimated quality level of the world-lock display mode; and

communicating feedback of the estimated quality level to the user via the head-mounted display device.

2. The method of claim 1 , wherein communicating feedback of the estimated quality level further comprises displaying one or more graphical representations of the estimated quality level via the head-mounted computing device.

3. The method of claim 2 , wherein displaying the one or more graphical representations comprises altering an appearance of a field of view viewable through the head-mounted display device.

4. The method of claim 2 , wherein displaying the one or more graphical representations comprises altering an appearance of the one or more virtual objects.

5. The method of claim 1 , wherein communicating feedback of the estimated quality level further comprises:

providing the estimated quality level to an application that utilizes the world-lock display mode and the body-lock display mode; and

conveying the feedback of the estimated quality level to the user via the application and the head-mounted display device.

6. The method of claim 1 , wherein communicating feedback of the estimated quality level further comprises refraining from communicating the feedback of the estimated quality level until a user input is received that calls for the world-lock display mode.

7. The method of claim 1 , further comprising disabling the world-lock display mode when the estimated quality level is below a quality level threshold.

8. The method of claim 1 , wherein determining the input uncertainty values further comprises analyzing image data for one or more of illumination of the real-world objects, a scene depth, scene motion, feature density, hair of the user, a hand of the user, and a hat worn by the user.

9. The method of claim 1 , further comprising:

determining pose uncertainty values of the estimated pose; and

mapping the pose uncertainty values to the estimated quality level.

10. A head-mounted display device operatively connected to a computing device, the head-mounted display device comprising:

a tracking system executed by a processor of the computing device, the tracking system configured to:

receive sensor data from one or more sensors of the head-mounted display device;

using the sensor data, determine an estimated pose of the head-mounted display device;

determine one or more input uncertainty values of the sensor data;

map the one or more input uncertainty values to an estimated quality level of a world-lock display mode in which a position of one or more virtual objects appears to be fixed relative to real-world objects viewable through the head-mounted display device; and

communicate feedback to a user via the head-mounted display device of the estimated quality level; and

a display program executed by a processor of the computing device, the display program configured to display the one or more virtual objects using the estimated pose in either the world-lock display mode or in a body-lock display mode in which the position of each of the virtual objects appears to be fixed relative to the user of the head-mounted display device.

11. The head-mounted display device of claim 10 , wherein the tracking system is configured to communicate the feedback of the estimated quality level by causing the display program to display one or more graphical representations of the estimated quality level via the head-mounted computing device.

12. The head-mounted display device of claim 11 , wherein causing the display program to display one or more graphical representations comprises causing the display program to display one or more graphical representations in the body-lock display mode in which the one or more graphical representations appear to be fixed relative to the user of the head-mounted display device.

13. The head-mounted display device of claim 11 , wherein causing the display program to display one or more graphical representations comprises altering an appearance of the one or more virtual objects.

14. The head-mounted display device of claim 10 , wherein the tracking system is configured to communicate the feedback of the estimated quality level by providing the estimated quality level to an application that utilizes the world-lock display mode and the body-lock display mode, wherein the application conveys the feedback of the estimated quality level to the user via the head-mounted display device.

15. The head-mounted display device of claim 10 , wherein the tracking system is configured to communicate the feedback of the estimated quality level by refraining from communicating the feedback until a user input is received that calls for the world-lock display mode.

16. The head-mounted display device of claim 10 , wherein the tracking system is further configured to disable the world-lock display mode when the estimated quality level is below a quality level threshold.

17. The head-mounted display device of claim 10 , wherein the tracking system is configured to:

determine both the input uncertainty values and pose uncertainty values of the estimated pose; and

map both the input uncertainty values and the pose uncertainty values to the estimated quality level.

18. A method for communicating to a user of a head-mounted display device an estimated quality level of a world-lock display mode in which a position of one or more virtual objects appears to be fixed relative to real-world objects viewable through the head-mounted display device, the method comprising:

receiving sensor data from one or more sensors of the head-mounted display device;

using the sensor data, determining an estimated pose of the head-mounted display device;

using the estimated pose, displaying the one or more virtual objects via the head-mounted display device in either the world-lock display mode or in a body-lock display mode in which the position of each of the virtual objects appears to be fixed relative to the user of the head-mounted display device;

determining one or more input uncertainty values of the sensor data;

mapping the one or more input uncertainty values to the estimated quality level of the world-lock display mode; and

displaying one or more graphical representations of the estimated quality level to the user via the head-mounted computing device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2016
From: EBSTYNE, MICHAEL JOHN; SCHAFFALITZKY, FREDERIK; STEEDLY, DREW; EADE, ETHAN; SHETTER, MARTIN; GRABNER, MICHAEL
To: MICROSOFT CORPORATION
Reel/Frame 039169/0903 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →
Continuity (1)
Related Publication 20150317832A1 · Nov 5, 2015