IP Library Granted Patent US 10,216,263
Granted Patent B2
US 10,216,263 · App. 15/263,220 · Granted Feb 26, 2019

Display active alignment systems utilizing test patterns for calibrating signals in waveguide displays

Inventors: Steven John Robbins (Redmond, WA); Drew Edward Steedly (Woodinville, WA); Michael Edward Samples (Redmond, WA); Zhiqiang Liu (Redmond, WA); Andrew K. Juenger (Woodinville, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/012G02B27/0172G06T11/001G06T11/60G09G3/003G09G5/00G02B2027/014G02B2027/0138G02B2027/0178G09G2320/0693G09G2320/08G09G2340/0457G09G2340/0464G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,216,263
App. No.
15/263,220
Granted
Feb 26, 2019
Kind
B2
Abstract

A display system includes a display alignment tracker configured track the position of a first signal in a first waveguide and the position of a second signal in a second waveguide. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal. The differential is used to adjust the position, dimensions, or a color attribute of the first signal relative to the second signal.

Claims (48)

1. A method of display alignment tracking for a head-mounted device, the method comprising:

sampling a first signal from a first waveguide;

sampling a second signal from a second waveguide;

combining the first signal and second signal optically into a combined optical signal;

detecting a test pattern within the combined optical signal, the test pattern being included within each of the first signal and the second signal, wherein the test pattern is provided by at least tagging image frames with test pattern metadata, wherein the test pattern is provided separately from the image frames, and wherein the test pattern is provided in response to detecting receipt of the test pattern metadata during rendering of the image frames; and

comparing at least a first physical position corresponding to the test pattern within the first signal and a second physical position corresponding to the test pattern with the second signal to identify a differential between the first physical position and the second physical position.

2. The method of claim 1 , wherein comparing the first and second physical positions includes comparing pixel locations of the test pattern within the first signal and the second signal at a subpixel level and thereafter adjusting a rendering position for at least one of the first signal and the second signal.

3. The method of claim 1 , wherein the method further includes comparing a color level associated with a rendering of the first signal to a color level associated with a rendering of the second signal and thereafter adjusting a color level for rendering at least one of the first signal and the second signal.

4. The method of claim 1 , wherein the method further includes: providing the test pattern during a startup procedure of a display module assembly.

5. The method of claim 1 , wherein the method further includes providing the test pattern to a display pixel array, the display pixel array being configured to render the first signal and second signal, the display pixel array having active pixels and border pixels, and wherein providing the test pattern includes the display pixel array rendering the test pattern in the border pixels.

6. The method of claim 5 , wherein the method further includes: shifting a location of the active pixels within the display pixel array based at least partially upon a differential in a rendering position of the first signal and the second signal.

7. The method of claim 1 , wherein method further includes providing the test pattern with a display module assembly in the first signal and the second signal includes and by interleaving at least one test pattern frame within a plurality of other image frames being provided with the display module assembly.

8. The method of claim 1 , wherein the method further includes providing the test pattern in a blue channel.

9. The method of claim 1 , wherein the method includes detecting a predetermined movement of the head-mounted device and in response to the predetermined movement, providing the test pattern for rendering with the first signal and the second signal.

10. The method of claim 1 , wherein the method further includes: identifying a first color attribute associated with rendering the first signal and a corresponding second color attribute associated with rendering the second signal; calculate a differential between the first and second color attribute; and use the differential to adjust at least one of the first signal and the second signal.

11. A display alignment tracking system for tracking signal alignment in waveguides, the system comprising:

at least one display module assembly configured to provide a first signal and a second signal;

a first waveguide configured to guide the first signal therethrough;

a second waveguide configured to guide the second signal therethrough;

an optical multiplexer in optical communication with the first waveguide and the second waveguide, the optical multiplexer configured to combine at least a portion of the first signal and at least a portion of the second signal; an imaging sensor in optical communication with the optical multiplexer and configured to receive a combined signal from the optical multiplexer that includes at least a portion of the first signal and at least a portion of second signal;

one or more processors in data communication with the imaging sensor; and

one or more computer-readable media having stored thereon instructions that are executable by the one or more processors to perform at least the following:

receive at least a portion of the first signal and at least a portion of the second signal from the imaging sensor, wherein a test pattern is provided by the at least one display module assembly in the first signal and the second signal;

identify a first pattern included in the first signal and a second pattern included in the second signal;

compare at least physical positioning of the first pattern relative to at least physical positioning of the second pattern; and

cause a display pixel array to be in communication with the at least one display module assembly, wherein providing the test pattern includes providing the test pattern to the display pixel array, the display pixel array being configured to render the first signal and the second signal, the display pixel array having active pixels and border pixels, and wherein providing the test pattern with the at least one display module assembly in the first signal and the second signal includes the display pixel array rendering the test pattern in the border pixels.

12. The system of claim 11 , wherein one or more computer-readable media further have stored thereon instructions that are executable by the one or more processors to configure the computer system to perform at least the following: calculate a displacement value of the first pattern and second pattern; and provide the displacement value to a display module assembly.

13. The system of claim 11 , wherein providing the test pattern with the display module assembly in the first signal and the second signal includes providing the test pattern during a startup procedure of the display module assembly.

14. The system of claim 11 , wherein providing the test pattern with the display module assembly in the first signal and the second signal includes interleaving a test pattern frame within a plurality of other image frames being provided with the display module assembly.

15. The system of claim 11 , wherein providing the test pattern with the display module assembly in the first signal and the second signal includes providing the test pattern in a blue channel.

16. The system of claim 11 , wherein one or more computer-readable media further have stored thereon instructions that are executable by the one or more processors to configure the computer system to perform at least the following: identify a color attribute of the first pattern and a corresponding color attribute of the second pattern; calculate a differential between the color attribute of the first pattern and the corresponding color attribute of the second pattern; and use the differential to adjust at least one of the first signal and the second signal.

17. A display alignment tracking system for tracking signal alignment in waveguides, the system comprising:

at least one display module assembly configured to provide a first signal and a second signal;

a first waveguide configured to guide the first signal therethrough;

a second waveguide configured to guide the second signal therethrough;

an optical multiplexer in optical communication with the first waveguide and the second waveguide, the optical multiplexer configured to combine at least a portion of the first signal and at least a portion of the second signal;

an imaging sensor in optical communication with the optical multiplexer and configured to receive a combined signal from the optical multiplexer that includes at least a portion of the first signal and at least a portion of second signal;

one or more processors in data communication with the imaging sensor; and

one or more computer-readable media having stored thereon instructions that are executable by the one or more processors to perform at least the following:

receive at least a portion of the first signal and at least a portion of the second signal from the imaging sensor, wherein a test pattern is provided by the at least one display module assembly in the first signal and the second signal;

identify a first pattern included in the first signal and a second pattern included in the second signal;

compare at least physical positioning of the first pattern relative to at least physical positioning of the second pattern;

cause a display pixel array to be in communication with the at least one display module assembly, wherein providing the test pattern includes providing the test pattern to the display pixel array, the display pixel array being configured to render the first signal and the second signal, the display pixel array having active pixels and border pixels, and wherein providing the test pattern with the at least one display module assembly in the first signal and the second signal includes the display pixel array rendering the test pattern in the border pixels;

calculate a displacement value of the first pattern and second pattern; provide the displacement value to the at least one display module assembly; and

shift a location of the active pixels within the display pixel array based at least partially upon the displacement value.

18. The method of claim 1 , wherein combining the first signal and the second signal optically is performed using a prism.

19. The method of claim 1 , wherein combining the first signal and the second signal optically is performed by directing the first signal from a first prism to a second prism through an optical medium.

20. The display alignment tracking system of claim 11 , wherein providing the test pattern with the at least one display module assembly in the first signal and the second signal includes the display pixel array rendering the test pattern at least partially in the border pixels and at least partially in the active pixels.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2018
From: ROBBINS, STEVEN JOHN; STEEDLY, DREW EDWARD; SAMPLES, MICHAEL EDWARD; LIU, ZHIQIANG; JUENGER, ANDREW K.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 046131/0738 →
Continuity (1)
Related Publication 20180074578A1 · Mar 15, 2018
Cited By (1)
US 12,474,577