System and method for optical calibration of a head-mounted display

1. A method for display calibration comprising:

generating an image pattern to encode display image pixels;

transmitting the image pattern to be rendered on a target display;

rendering the image pattern on a display panel of a head-mounted device (HMD);

capturing, using at least one image sensor of the HMD and through a lens of the HMD, the image pattern on the target display and the image pattern on the display panel with a same alignment as the image pattern on the target display;

determining a distortion of the image pattern resulting from the lens of the HMD based on differences between the image pattern on the target display and the image pattern on the display panel; and

providing a compensation factor for the distortion.

2. The method of claim 1 , wherein determining the distortion comprises:

comparing pixel positions of the image pattern on the target display and the image pattern on the display panel; and

determining the distortion based on the compared pixel positions.

3. The method of Claim 2 , wherein providing the compensation factor comprises:

decoding the pixel positions for portions of the image pattern on the display panel that match portions of the image pattern on the target display;

creating a lookup table of angular distortion based on computing angular correction for the decoded pixel positions; and

creating distortion correction based on the lookup table of angular distortion.

4. The method of claim 3 , wherein providing the compensation factor further comprises:

creating a distortion model based on the lookup table of angular distortion, wherein the distortion model comprises a mathematic form including a polynomial model, a cubic model, or a spline model.

5. The method of claim 3 , wherein providing the compensation factor comprises:

creating different models for different color channels, wherein each model comprises a corresponding lookup table of angular distortion for chromatic aberration correction.

6. The method of claim 3 , further comprising:

extracting a distortion center based on the lookup table of angular distortion, wherein the distortion center is a point with no distortion;

finding a field of view based on the distortion center; and

constructing a distortion model based on the field of view.

7. The method of claim 1 , wherein the HMD comprises one of:

a virtual display device; or

an optical see-through (OST) augmented reality (AR) headset.

8. An apparatus, comprising:

a display panel;

a lens;

at least one image sensor; and

at least one processor configured to:

generate an image pattern to encode display image pixels;

transmit the image pattern to be rendered on a target display;

render the image pattern on the display panel;

capture, using the at least one image sensor and through the lens, the image pattern on the target display and the image pattern on the display panel with a same alignment as the image pattern on the target display;

determine a distortion of the image pattern resulting from the lens based on differences between the image pattern on the target display and the image pattern on the display panel; and

provide a compensation factor for the distortion.

9. The apparatus of claim 8 , wherein, to determine the distortion, the at least one processor is configured to:

compare pixel positions of the image pattern on the target display and the image pattern on the display panel; and

determine the distortion based on the compared pixel positions.

10. The apparatus of claim 9 , wherein, to provide the compensation factor, the at least one processor is configured to:

decode the pixel positions for portions of the image pattern on the display panel that match portions of the image pattern on the target display;

create a lookup table of angular distortion based on computing angular correction for the decoded pixel positions; and

create distortion correction based on the lookup table of angular distortion.

11. The apparatus of claim 10 , wherein, to provide the compensation factor, the at least one processor is configured to:

create a distortion model based on the lookup table of angular distortion, wherein the distortion model comprises a mathematic form including a polynomial model, a cubic model, or a spline model.

12. The apparatus of claim 10 , wherein, to provide the compensation factor, the at least one processor is configured to:

create different models for different color channels, wherein each model comprises a corresponding lookup table of angular distortion for chromatic aberration correction.

13. The apparatus of claim 10 , wherein the at least one processor is further configured to:

extract a distortion center based on the lookup table of angular distortion, wherein the distortion center is a point with no distortion;

find a field of view based on the distortion center; and

construct a distortion model based on the field of view.

14. The apparatus of claim 8 , wherein the apparatus comprises one of:

a virtual display device; or

an optical see-through (OST) augmented reality (AR) headset.

15. A non-transitory computer-readable medium containing instructions that, when executed by at least one processor, cause the at least one processor to:

generate an image pattern to encode display image pixels;

transmit the image pattern to be rendered on a target display;

render the image pattern on a display panel of a head-mounted device (HMD);

capture, using at least one image sensor of the HMD and through a lens of the HMD, the image pattern on the target display and the image pattern on the display panel with a same alignment as the image pattern on the target display;

determine a distortion of the image pattern resulting from the lens of the HMD based on differences between the image pattern on the target display and the image pattern on the display panel; and

provide a compensation factor for the distortion.

16. The non-transitory computer-readable medium of claim 15 , wherein the instructions that when executed cause the at least one processor to determine the distortion comprise instructions that when executed cause the at least one processor to:

compare pixel positions of the image pattern on the target display and the image pattern on the display panel; and

determine the distortion based on the compared pixel positions.

17. The non-transitory computer-readable medium of claim 16 , wherein the instructions that when executed cause the at least one processor to provide the compensation factor comprise instructions that when executed cause the at least one processor to:

decode the pixel positions for portions of the image pattern on the display panel that match portions of the image pattern on the target display;

create a lookup table of angular distortion based on computing angular correction for the decoded pixel positions; and

create distortion correction based on the lookup table of angular distortion.

18. The non-transitory computer-readable medium of claim 17 , wherein the instructions that when executed cause the at least one processor to provide the compensation factor comprise instructions that when executed cause the at least one processor to:

create a distortion model based on the lookup table of angular distortion, wherein the distortion model comprises a mathematic form including a polynomial model, a cubic model, or a spline model.

19. The non-transitory computer-readable medium of claim 17 , further containing instructions that, when executed by the at least one processor, cause the at least one processor to:

create different models for different color channels, wherein each model comprises a corresponding lookup table of angular distortion for chromatic aberration correction.

20. The non-transitory computer-readable medium of claim 17 , further containing instructions that, when executed by the at least one processor, cause the at least one processor to:

extract a distortion center based on the lookup table of angular distortion, wherein the distortion center is a point with no distortion;

find a field of view based on the distortion center; and

construct a distortion model based on the field of view.