IP Library › Granted Patent US 9,746,675
Granted Patent B2
US 9,746,675 · App. 14/724,486 · Granted Aug 29, 2017

Alignment based view matrix tuning

Inventors: Quentin Simon Charles Miller (Sammamish, WA); Drew Steedly (Redmond, WA); Denis Demandolx (Bellevue, WA); Youding Zhu (Sammamish, WA); Qi Kuan Zhou (Bellevue, WA); Todd Michael Lyon (Seattle, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G02B27/0172G02B27/0179G06T19/006H04N13/0022H04N13/044H04N13/0497G02B2027/014G02B2027/0118G02B2027/0138G02B2027/0174G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,746,675
App. No.
14/724,486
Granted
Aug 29, 2017
Kind
B2
Abstract

A head-mounted display device is disclosed, which includes an at least partially see-through display, a processor configured to detect a physical feature, generate an alignment hologram based on the physical feature, determine a view of the alignment hologram based on a default view matrix for a first eye of a user of the head-mounted display device, display the view of the alignment hologram to the first eye of the user on the at least partially see-through display, output an instruction to the user to enter an adjustment input to visually align the alignment hologram with the physical feature, determine a calibrated view matrix based on the default view matrix and the adjustment input, and adjust a view matrix setting of the head-mounted display device based on the calibrated view matrix.

Claims (57)

1. A head-mounted display device for alignment based view matrix tuning comprising:

an at least partially see-through display;

a processor;

a non-volatile storage device holding instructions executable by the processor to:

detect a physical feature having a physical location that is at least a threshold distance away from a rendering focal plane of the head-mounted display device, wherein the physical feature is indicia on a 2D surface of a physical object;

generate an alignment hologram based on the physical feature, wherein the alignment hologram corresponds in shape to the indicia and is programmatically generated for display or pre-stored on the non-volatile storage device and retrieved for display;

determine a view of the alignment hologram based on a default view matrix for a first eye of a user of the head-mounted display device;

display the view of the alignment hologram to the first eye of the user on the at least partially see-through display;

output an instruction to the user to enter an adjustment input to visually align the alignment hologram with the physical feature;

determine a calibrated view matrix based on the default view matrix and the adjustment input; and

adjust a view matrix setting of the head-mounted display device based on the calibrated view matrix.

2. The head-mounted display device of claim 1 , further comprising instructions to:

increase an opacity of a region of the at least partially see-through display corresponding to a second eye of the user, such that the physical feature and the alignment hologram are not viewed by the second eye of the user.

3. The head-mounted display device of claim 1 , wherein the physical feature is an optical tag that is located in a central region of the 2D surface.

4. The head-mounted display device of claim 3 , wherein the physical feature is one of a plurality of physical features, and a second physical feature of the plurality of physical features is a second optical tag that is located in a peripheral region of the 2D surface.

5. The head-mounted display device of claim 1 , wherein the physical feature is a physical object viewed by the head-mounted display device, and the alignment hologram is generated in real time based on a captured image received at an outward facing camera of the head-mounted display device.

6. The head-mounted display device of claim 1 , wherein the threshold distance is between 20-40% of the distance from the head-mounted display device to the rendering focal plane.

7. The head-mounted display device of claim 1 , wherein the adjustment input includes inputs to translate the alignment hologram along one or more of an x, y, or z axis.

8. The head-mounted display device of claim 7 , wherein the adjustment input further includes input to rotate the alignment hologram in one or more of a pitch, yaw, or roll rotation.

9. The head-mounted display device of claim 1 , further comprising instructions to:

determine a second view of the alignment hologram based on a second default view matrix for a second eye of the user of the head-mounted display device;

display the second view of the alignment hologram to the second eye of the user on the at least partially see-through display;

output a second instruction to the user to enter a second adjustment input to visually align the alignment hologram with the physical feature;

determine a second calibrated view matrix based on the second default view matrix and the second adjustment input; and

adjust the view matrix setting of the head-mounted display device based on the second calibrated view matrix.

10. A method for alignment based view matrix tuning of a head-mounted display device comprising:

detecting a physical feature having a physical location that is at least a threshold distance away from a rendering focal plane of the head-mounted display device, wherein the physical feature is indicia on a 2D surface of a physical object;

generating an alignment hologram based on the physical feature, wherein the alignment hologram corresponds in shape to the indicia and is programmatically generated for display or pre-stored and retrieved for display;

determining a view of the alignment hologram based on a default view matrix for a first eye of a user of the head-mounted display device;

displaying the view of the alignment hologram to the first eye of the user on an at least partially see-through display of the head-mounted display device;

outputting an instruction to the user to enter an adjustment input to visually align the alignment hologram with the physical feature;

determining a calibrated view matrix based on the default view matrix and the adjustment input; and

adjusting a view matrix setting of the head-mounted display device based on the calibrated view matrix.

11. The method of claim 10 , further comprising:

increasing an opacity of a region of the at least partially see-through display corresponding to a second eye of the user, such that the physical feature and the alignment hologram are not viewed by the second eye of the user.

12. The method of claim 10 , wherein the physical feature is one of a plurality of physical features that are optical tags located in a central region and a peripheral region of the 2D surface.

13. The method of claim 10 , wherein the physical feature is a physical object viewed by the head-mounted display device, and the alignment hologram is generated real time based on a captured image received at an outward facing camera of the head-mounted display device.

14. The method of claim 10 , wherein the threshold distance is between 20-40% of the distance from the head-mounted display device to the rendering focal plane.

15. The method of claim 10 , wherein the adjustment input includes inputs to translate the alignment hologram along one or more of an x, y, or z axis.

16. The method of claim 15 , wherein the adjustment input further includes input to rotate the alignment hologram in one or more of a pitch, yaw, or roll rotation.

17. The method of claim 10 , further comprising:

determining a second view of the alignment hologram based on a second default view matrix for a second eye of the user of the head-mounted display device;

displaying the second view of the alignment hologram to the second eye of the user on the at least partially see-through display;

outputting a second instruction to the user to enter a second adjustment input to visually align the alignment hologram with the physical feature;

determining a second calibrated view matrix based on the second default view matrix and the second adjustment input; and

adjusting the view matrix setting of the head-mounted display device based on the second calibrated view matrix.

18. A head-mounted display device for alignment based view matrix tuning comprising:

a display;

a processor;

a non-volatile storage device holding instructions executable by the processor to:

detect a physical feature having a physical location that is at least a threshold distance away from a rendering focal plane of the head-mounted display device, wherein the physical feature is indicia on a 2D surface of a physical object;

generate an alignment hologram based on the physical feature, wherein the alignment hologram corresponds in shape to the indicia and is programmatically generated for display or pre-stored on the non-volatile storage device and retrieved for display;

determine a view of the alignment hologram based on a default view matrix for a first eye of a user of the head-mounted display device;

display the view of the alignment hologram to the first eye of the user on the display;

receive an adjustment input from the user to visually align the alignment hologram with the physical feature;

determine a calibrated view matrix based on the default view matrix and the adjustment input; and

adjust a view matrix setting of the head-mounted display device based on the calibrated view matrix.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2017
From: MILLER, QUENTIN SIMON CHARLES; STEEDLY, DREW; DEMANDOLX, DENIS; ZHU, YOUDING; ZHOU, QI KUAN; LYON, TODD MICHAEL
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 042034/0811 →
Continuity (1)
Related Publication 20160349510A1 · Dec 1, 2016