IP Library Granted Patent US 11,435,289
Granted Patent B2
US 11,435,289 · App. 16/956,886 · Granted Sep 6, 2022

Optical distortion measuring apparatus and optical distortion measuring method, image processing system, electronic apparatus and display apparatus

Inventors: Hongzhen Xue (Beijing, CN); Fuqiang Ma (Beijing, CN); Yali Liu (Beijing, CN); Lili Chen (Beijing, CN); Jiankang Sun (Beijing, CN); Shuo Zhang (Beijing, CN)
Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
G01N21/66G01M11/02G01N21/8851H04N9/3191G01N2021/8887G02B27/0172G02B2027/014
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,435,289
App. No.
16/956,886
Granted
Sep 6, 2022
Kind
B2
Abstract

An optical distortion measurement method that including receiving target field of view information; processing the target field of view information using a coordinate conversion model to obtain screen coordinates of a target angle of view, wherein the coordinate conversion model may be configured to convert image plane coordinates of the target angle of view to screen coordinates of the target angle of view; and outputting at least the screen coordinates of the target angle of view.

Claims (113)

1. An optical distortion measurement method, comprising:

receiving target field of view information;

processing the target field of view information using a coordinate conversion model to obtain screen coordinates of a target angle of view, wherein the coordinate conversion model is configured to convert image plane coordinates of the target angle of view to screen coordinates of the target angle of view; and

outputting at least the screen coordinates of the target angle of view.

2. The optical distortion measurement method according to claim 1 , wherein processing the target field of view information using the coordinate conversion model to obtain the screen coordinates of the target angle of view, comprising:

obtaining the image plane coordinates of the target angle of view; and

processing the image plane coordinates of the target angle of view using the coordinate conversion model to obtain the screen coordinates of the target angle of view.

3. The optical distortion measurement method according to claim 2 ,

wherein outputting at least the screen coordinates of the target angle of view further comprising:

outputting the image plane coordinates of the target angle of view.

4. The optical distortion measuring method according to claim 1 , before the receiving the target field of view information, further comprising:

receiving distortion sample information, which comprises image plane sample coordinates of a plurality of sample angles of view and corresponding screen sample coordinates;

training a neural network as the coordinate conversion model using the distortion sample information; and

storing the coordinate conversion model.

5. The optical distortion measuring method according to claim 4 , further comprising:

receiving image size information after receiving the distortion sample information; the image size information comprising M 0 pixels along X axis direction of a screen coordinate system and N 0 pixels along Y axis direction of the screen coordinate system; and

performing normalization processing on the distortion sample information, so that the image plane sample coordinates included in the distortion sample information before the normalization processing are (X s10 , Y s10 ) the image plane sample coordinates included in the distortion sample information after the normalization processing are (X s1 , Y s1 ), the screen sample coordinates included in the distortion sample information before the normalization processing are (X p10 , Y p10 ), the screen sample coordinates included in the distortion sample information after the normalization processing are (X p1 , Y p1 ); wherein X s1 =X s10 /M 0 , Y s1 =Y s10 /N 0 , X p1 =X p10 /M 0 , Y p1 =Y p10 /N 0 .

6. The optical distortion measuring method according to claim 4 , wherein an activation function f(y) of the neural network is

f

(

y

)

=

1

1

+

e

-

y

;

y is an input value of a neuron;

a loss function of the neural network E total is

E

total

=

i

-

1

n

(

T

i

-

O

i

)

n

,

n is a number of neurons in a last layer of neurons, i is the i-th neuron contained in the last layer of neurons, T i is an actual output value of the i-th neuron contained in the last layer of neurons, and O i is a predicted output value of the i-th neuron contained in the last layer of neurons.

7. An electronic apparatus, comprising: a processor and a memory, wherein the memory stores calculation instruction, the processor is configured to execute the calculation instructions to perform the optical distortion measurement method of claim 1 .

8. A display apparatus, comprising the electronic apparatus of claim 7 .

9. An optical distortion measuring apparatus, comprising:

a receiving module, configured to receive target field of view information;

a processing module, configured to process the target field of view information; using a coordinate conversion model to obtain screen coordinates of a target angle of view, the coordinate conversion model is configured to convert image plane coordinates of the target angle of view to the screen coordinates of the target angle of view; and

a coordinate output module, configured to output at least the screen coordinates of the target angle of view.

10. The optical distortion measuring apparatus according to claim 9 , wherein the processing module is configured to obtain the image plane coordinates of the target angle of view, and process the image plane coordinates of the target angle of view using the coordinate conversion model to obtain the screen coordinates of the target angle of view.

11. The optical distortion measuring apparatus according to claim 10 , wherein the coordinate output module is further configured to output the image plane coordinates of the target angle of view.

12. The optical distortion measuring apparatus according to claim 9 , wherein the receiving module is further configured to receive distortion sample information before receiving the target field of view information, the distortion sample information comprising image plane sample coordinates of a plurality of sample angles of view and corresponding screen sample coordinates;

the processing module is further configured to train a neural network as the coordinate conversion model using the distortion sample information; and

the optical distortion measuring apparatus further comprising a model storage module for storing the coordinate conversion model.

13. The optical distortion measuring apparatus according to claim 12 , wherein the receiving module is further configured to receive image size information after receiving the distortion sample information, the image size information comprising M 0 pixels along X axis direction of a screen coordinate system and No pixels along Y axis direction of the screen coordinate system;

the processing module is further configured to perform normalization processing on the distortion sample information before training the neural network, so that the image plane sample coordinates included in the distortion sample information before the normalization processing are X s10 , Y s10 ), the image plane sample coordinates included in the distortion sample information after the normalization processing are (X s1 , Y s1 ); the screen sample coordinates included in the distortion sample information before the normalization processing are (X p10 , Y p10 ), the screen sample coordinates included in the distortion sample information after the normalization processing are (X p1 , Y p1 ); wherein X s1 =X s10 /M 0 , Y s1 =Y s10 /N 0 , X p1 =X p10 /M 0 , Y p1 =Y p10 /N 0 .

14. The optical distortion measuring apparatus according to claim 12 , wherein an activation function f(y) of the neural network is

f

(

y

)

=

1

1

+

e

-

y

;

y is an input value of a neuron;

a loss function of the neural network E total is

E

total

=

i

-

1

n

(

T

i

-

O

i

)

n

,

n is a number of neurons in a last layer of neurons, i is the i-th neuron contained in the last layer of neurons, T i is an actual output value of the i-th neuron contained in the last layer of neurons, and O i is a predicted output value of the i-th neuron contained in the last layer of neurons.

15. An image processing system, comprising a sample collection apparatus and the optical distortion measurement apparatus according to claim 12 , wherein the sample collection apparatus is configured to provide the distortion sample information to the optical distortion measurement apparatus; the sample collection apparatus comprising:

a display setting module, configured to set the screen sample coordinates of the plurality of sample angles of view;

a sample collection assembly, comprising a display screen, an image collector, and an optical lens located between the display screen and the image collector; wherein the display screen is configured to display a plurality of screen sample spots according to the screen sample coordinates of the plurality of sample angles of view, the image collector is configured to collect a plurality of imaging sample spots formed after the plurality of screen sample spots passing through the optical lens;

an image analysis module, configured to analyze the image plane sample coordinates of the plurality of sample angles of view according to the plurality of imaging sample spots; and

a sample output module connected to the receiving module included in the optical distortion measuring apparatus, configured to transmit the screen sample coordinates of the plurality of sample angles of view and the corresponding image plane sample coordinates as the distortion sample information to the receiving module.

16. The image processing system according to claim 15 , wherein an optical axis of the optical lens, an optical axis of a lens of the image collector, and a geometric center of the display screen are coaxial.

17. The image processing system according to claim 15 , wherein the display setting module is configured to set screen coordinates of testing angles of view before setting the screen sample coordinates of the plurality of sample angles of views;

the display screen is configured to obtain a screen test spot according to the screen coordinates of the testing angles of view;

the image collector is further configured to collect an image testing spot formed by the screen testing spot after passing through the optical lens; and

the image analysis module is further configured to test the image plane coordinates of the angle of view according to the image testing spot analysis; distortion the lens of the image collector is corrected based on the screen coordinates of the testing angle of view and the image plane coordinates of the testing angles of view.

18. The optical distortion measuring apparatus according to claim 9 , further comprising a distortion calculation module, wherein an input of the distortion calculation module is coupled to the coordinate output module, and configured to calculate a distortion coefficient of an optical lens according to the image plane coordinates of a plurality of target angles of view and the corresponding screen coordinates.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2022
From: BOE TECHNOLOGY GROUP CO., LTD.
To: BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
Reel/Frame 060626/0867 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2020
From: XUE, HONGZHEN; MA, FUQIANG; LIU, YALI; CHEN, LILI; SUN, JIANKANG; ZHANG, SHUO
To: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 053003/0205 →
Priority Claims (1)
CN 201910113048.6 · Feb 13, 2019 · national
Continuity (1)
Related Publication 20210247320A1 · Aug 12, 2021