Granted Patent B2

US 12,657,804 · App. 18/424,911 · Granted Jun 16, 2026

Inventor: Xingtong Jiang (Shanghai, CN)

Assignee: Hue Inc.

G06T15/00G06T7/90G06V10/25G06V10/56G06V10/60H04N1/6005G06T2207/10024

Abstract

Claims (61)

1 . A method for compensating a virtual image displayed by a near eye display based on a source image, comprising:

acquiring virtual images displayed by the near eye display for three primary color channels, wherein each of the virtual images is based on a primary color test pattern;

obtaining an image data matrix for the three primary color channels based on the virtual images, and inverting the image data matrix to obtain an inverted image data matrix;

determining a target image data matrix for the three primary color channels;

obtaining a correction factor matrix by multiplying the inverted image data matrix and the target image data matrix; and

performing compensation on the source image based on the correction factor matrix;

wherein obtaining the image data matrix for the three primary color channels based on the virtual images comprises obtaining the image data matrix in a first color space; and

determining the target image data matrix for the three primary color channels further comprises:

converting the image data matrix from the first color space to a second color space to obtaining a second image data matrix;

determining a first target image data matrix in the second color space based on the second image data matrix; and

converting the first target image data matrix from the second color space to the first color space to obtain the target image data matrix.

2 . The method according to claim 1 , wherein the correction factor matrix comprises luminance and chromaticity components of the three primary color channels.

3 . The method according to claim 1 , wherein the first color space is a CIE-XYZ color space, and the second color space is a CIE-xyY color space.

4 . The method according to claim 1 , wherein obtaining the image data matrix for the three primary color channels further comprises:

extracting grey values of the acquired virtual image for each of the primary color channels, respectively; and

determining a luminance component and chromaticity components from the grey value for each of the primary color channels.

5 . The method according to claim 1 , wherein the three primary color channels comprise a green primary color channel, a blue primary color channel, and a red primary color channel.

6 . The method according to claim 1 , wherein after acquiring the virtual images, the method further comprising:

determining a region of interest (ROI) in each of the virtual images;

identifying pixels in the ROI of each of the virtual images; and

extracting image data of each of the virtual images based on the identified pixels.

7 . The method according to claim 6 , wherein identifying the pixels in the ROI of each of the virtual images further comprises:

positioning the pixels in the ROI of each of the virtual images under a partial on-off pattern; and

identifying the pixels.

8 . The method according to claim 1 , wherein the correction factor matrix is a non-diagonal matrix.

9 . A method for compensating a virtual image displayed by a near eye display based on a source image, comprising:

acquiring virtual images displayed by the near eye display for three primary color channels, wherein each of the virtual images is based on a primary color test pattern;

obtaining a correction factor matrix comprising luminance and chromaticity components of the three primary color channels; and

performing compensation on the source image with the correction factor matrix;

wherein obtaining the correction factor matrix comprising the luminance and chromaticity components of the three primary color channels further comprises:

obtaining first image data of each of the primary color channels;

determining target image data for each of the primary color channels based on the first image data; and

obtaining the correction factor matrix based on the first image data and the target image data, wherein the first image data comprises a luminance component and chromaticity components, and the target image data comprise a target luminance component and target chromaticity components.

10 . The method according to claim 9 , wherein obtaining the first image data of each primary color channel comprises:

obtaining a first luminance component and first chromaticity components of each of the primary color channels in a first color space; and

converting the first luminance component and the first chromaticity components from the first color space to a second color space to obtain a second luminance component and second chromaticity components;

wherein determining the target image data of each of the primary color channels based on the first image data further comprises:

determining a first target luminance component and first target chromaticity components of each of the primary color channels in the second color space based on the second luminance component and the second chromaticity components; and

converting the first target luminance component and the first target chromaticity components from the second color space to the first color space to obtain the target luminance component and the target chromaticity components; and

wherein obtaining the correction factor matrix based on the first image data and the target image data further comprises:

obtaining the correction factor matrix based on the first luminance component, the first chromaticity components, the target luminance component, and, the target chromaticity components.

11 . The method according to claim 10 , wherein the first color space is a CIE-XYZ color space and the second color space is a CIE-xyY color space.

12 . The method according to claim 9 , wherein obtaining the first image data of each of the primary color channels further comprises:

extracting grey values of the acquired virtual image for each primary color channel, respectively; and

determining the luminance component and the chromaticity components from the grey value for the each of the primary color channels.

13 . The method according to claim 9 , wherein the three primary color channels comprise a green primary color channel, a blue primary color channel, and a red primary color channel.

14 . The method according to claim 9 , wherein after acquiring the virtual images, the method further comprises:

determining a region of interest (ROI) in each of the virtual images;

identifying pixels in the ROI of each of the virtual images; and

extracting image data of each of the virtual images based on the identified pixels.

15 . The method according to claim 14 , wherein identifying the pixels in the ROI of each of the virtual images further comprises:

positioning the pixels in the ROI of each of the virtual images under a partial on-off pattern; and

identifying the pixels.

16 . The method according to claim 9 , wherein the correction factor matrix is a non-diagonal matrix.

17 . The method according to claim 9 , wherein determining the target image data for each of the primary color channels based on the first image data further comprises:

determining a first color triangle formed by first chromaticity components of the first image data of each of the primary color channels;

determining a second color triangle formed by target chromaticity components of the target image data of each of the primary color channels, wherein an area of the second color triangle is less than an area of the first color triangle; and

determining values of the target chromaticity components for each of the primary color channels based on the second color triangle.

18 . The method according to claim 17 , wherein the second color triangle is within the first color triangle.

19 . The method according to claim 17 , wherein determining the values of the target chromaticity components for each of the primary color channels based on the second color triangle comprises:

determining the values of the target chromaticity components for each primary color channel based on coordinate values of vertexes of the second color triangle.

Assignments (2)

Continuity (1)

References Cited (13)