IP Library Granted Patent US 11,003,243
Granted Patent B2
US 11,003,243 · App. 16/474,079 · Granted May 11, 2021

Calibration method and device, storage medium and processor

Inventors: Dongchun Ren (Beijing, CN); Wei Liu (Beijing, CN); Zhijiang Lou (Beijing, CN); Xiaohu Gong (Beijing, CN); Jian Wang (Beijing, CN); Fengmei Nie (Beijing, CN); Meng Yang (Beijing, CN)
Assignee: BEIJING 7INVENSUN TECHNOLOGY CO., LTD.
G06F3/013G06T7/246G06T7/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,003,243
App. No.
16/474,079
Granted
May 11, 2021
Kind
B2
Abstract

The disclosure discloses a calibration method and device, a storage medium and a processor. The method includes that: a calibration point is controlled to move on a predetermined motion track; a gaze track of a target object is acquired in a movement process of the calibration point; and a specified parameter is calibrated according to the predetermined motion track and the gaze track, the specified parameter is configured to predict a gaze point of the target object.

Claims (91)

1. A calibration method, comprising:

controlling a calibration point to move on a predetermined motion track;

acquiring a gaze track of a target object in a movement process of the calibration point; and

calibrating a specified parameter according to the predetermined motion track and the gaze track, the specified parameter is configured to predict a gaze point of the target object;

wherein calibrating the specified parameter according to the predetermined motion track and the gaze track comprises: regulating the specified parameter; and determining the gaze track according to the regulated specified parameter, the gaze track determined by the regulated specified parameter is matched with the predetermined motion track;

wherein regulating the specified parameter comprises at least one of: regulating a radius of curvature R of a cornea; regulating a distance K between a center of the eyeball and a center of curvature of the cornea; regulating a refractive index n 1 of aqueous humor and the cornea; and regulating two compensation angles α and β in a gazing direction.

2. The method as claimed in claim 1 , wherein acquiring the gaze track of the target object in the movement process of the calibration point comprises:

acquiring a pupil center position and a glint center position on an eyeball in the movement process of the calibration point; and

determining the gaze track of the target object according to the pupil center position and the glint center position.

3. The method as claimed in claim 2 , wherein acquiring the pupil center position of the target object and the glint center position on the eyeball in the movement process of the calibration point comprises:

acquiring an eye image of the target object at a predetermined time interval in the movement process of the calibration point, the eye image comprises a pupil and a glint; and

extracting the pupil center position and the glint center position from the eye image.

4. The method as claimed in claim 3 , wherein calibrating the specified parameter according to the predetermined motion track and the gaze track comprises:

regulating the specified parameter; and

determining the gaze track according to the regulated specified parameter, the gaze track determined by the regulated specified parameter is matched with the predetermined motion track.

5. The method as claimed in claim 2 , wherein determining the gaze track of the target object according to the pupil center position and the glint center position comprises:

obtaining positions of multiple gaze points of a gaze of the target object through a gaze calculation formula according to the pupil center position and the glint center position;

calculating an average value and standard deviation of the positions of the multiple gaze points;

selecting multiple gaze points of which the positions are three standard deviations smaller than the average value as first reference points; and

determining the gaze track according to the positions of the first reference points.

6. The method as claimed in claim 5 , wherein, under the condition that the predetermined motion track is a circumferential locus, the gaze track is also a circumferential locus, and determining the gaze track according to the first reference points comprises:

determining a first radius and first circle center position of the circumferential locus according to the first reference points; and

determining the gaze track according to the first radius and first circle center position of the circumferential locus.

7. The method as claimed in claim 6 , wherein determining the first radius and first circle center position of the circumferential locus according to the first reference points comprises:

determining a circumferential locus formula, wherein the circumferential locus formula is (x i′ −x 0 ′) 2 +(y i′ −y 0 ′) 2 =r′ 2 , the first circle center position is O′=[x 0 ′,y 0 ′], the first radius is r′, the first reference point meets the circumferential locus formula, and a coordinate of the first reference point is (x i′ ,y i′ );

determining a first matrix and a second matrix according to the circumferential locus formula, wherein the circumferential locus formula may be converted into [1,−2x i′ ,−2y i′ ][x 0 ′ 2 +y 0 ′ 2 −r′ 2 ,x 0 ′,y 0 ′] T =−x i′ 2 −y i′ 2 , the first matrix is

A

=

[

1

,

-

2

x

i

,

-

2

y

i

]

,

and the second matrix is

B

=

[

-

x

i

2

-

y

i

2

]

;

and

determining the first radius and first circle center position of the circumferential locus by use of a least square method according to the first matrix and the second matrix, where [x 0 ′ 2 +y 0 ′ 2 −r′ 2 ,x 0 ′,y 0 ′] T =(A T A) −1 A T B.

8. The method as claimed in claim 7 , after determining the first radius and first circle center position of the circumferential locus according to the first reference points, further comprising:

calculating distances between the multiple first reference points and the circumferential locus and a distance average value and distance standard deviation of the distances;

selecting multiple first reference points of which the distances are smaller than three distance standard deviations than the distance average value as second reference points; and

determining a second radius and second circle center position of the circumferential locus by taking the second reference points as the first reference points.

9. The method as claimed in claim 5 , wherein calibrating the specified parameter according to the predetermined motion track and the gaze track comprises:

regulating the specified parameter; and

determining the gaze track according to the regulated specified parameter, the gaze track determined by the regulated specified parameter is matched with the predetermined motion track.

10. The method as claimed in claim 6 , wherein calibrating the specified parameter according to the predetermined motion track and the gaze track comprises:

regulating the specified parameter; and

determining the gaze track according to the regulated specified parameter, the gaze track determined by the regulated specified parameter is matched with the predetermined motion track.

11. The method as claimed in claim 2 , wherein calibrating the specified parameter according to the predetermined motion track and the gaze track comprises:

regulating the specified parameter; and

determining the gaze track according to the regulated specified parameter, the gaze track determined by the regulated specified parameter is matched with the predetermined motion track.

12. A non-transitory storage medium, comprising a stored program, the program running to execute the method as claimed in claim 1 .

13. A calibration device, wherein the device has a hardware processor configured to execute program instructions stored on a memory, the program instructions comprise:

controlling a calibration point to move on a predetermined motion track;

acquiring a gaze track of a target object in a movement process of the calibration point; and

calibrating a specified parameter according to the predetermined motion track and the gaze track, the specified parameter is configured to predict a gaze point of the target object;

wherein calibrating the specified parameter according to the predetermined motion track and the gaze track comprises: regulating the specified parameter; and determining the gaze track according to the regulated specified parameter, the gaze track determined by the regulated specified parameter is matched with the predetermined motion track;

wherein regulating the specified parameter comprises at least one of: regulating a radius of curvature R of a cornea; regulating a distance K between a center of the eyeball and a center of curvature of the cornea; regulating a refractive index n 1 of aqueous humor and the cornea; and regulating two compensation angles α and β in a gazing direction.

14. The device as claimed in claim 13 , wherein acquiring the gaze track of the target object in the movement process of the calibration point comprises:

acquiring a pupil center position and a glint center position on an eyeball in the movement process of the calibration point; and

determining the gaze track of the target object according to the pupil center position and the glint center position.

Priority Claims (1)
CN 201711061169.8 · Nov 1, 2017 · national
Continuity (1)
Related Publication 20200257357A1 · Aug 13, 2020