IP Library Granted Patent US 11,385,710
Granted Patent B2
US 11,385,710 · App. 16/498,822 · Granted Jul 12, 2022

Geometric parameter measurement method and device thereof, augmented reality device, and storage medium

Inventors: Dianmeng Li (Beijing, CN); Wei Wei (Beijing, CN)
Assignee: BOE TECHNOLOGY GROUP CO., LTD.
G06F3/013G06T7/13G06T7/60G06T7/73G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,385,710
App. No.
16/498,822
Granted
Jul 12, 2022
Kind
B2
Abstract

A geometric parameter measurement method and a device thereof, an augmented reality device, and a storage medium are provided. The geometric parameter measurement method includes: acquiring a left eye image and a right eye image upon a user gazing at a target object, and determining a left eye sight line and a right eye sight line based on the left eye image and the right eye image, which images are acquired upon the user gazing at the target object; determining, according to the left eye sight line and the right eye sight line, a convergence point of the left eye sight line and the right eye sight line; and calculating geometric parameters of the target object in a case where the convergence point coincides with a desired position on the target object.

Claims (42)

1. A geometric parameter measurement method, comprising:

acquiring a left eye image and a right eye image upon a user gazing at a target object, and determining a left eye sight line and a right eye sight line based on the left eye image and the right eye image, which images are acquired upon the user gazing at the target object;

determining, according to the left eye sight line and the right eye sight line, a convergence point of the left eye sight line and the right eye sight line; and

calculating geometric parameters of the target object in a case where the convergence point coincides with a desired position on the target object,

wherein determining the left eye sight line and the right eye sight line based on the left eye image and the right eye image, which images are acquired upon the user gazing at the target object, comprises:

based on the left eye image and the right eye image, which images are acquired upon the user gazing at the target object, determining a left eye pupil position, a right eye pupil position, a left eye center position, and a right eye center position; and

determining the left eye sight line and the right eye sight line according to the left eye pupil position, the right eye pupil position, the left eye center position, and the right eye center position, wherein calculating the geometric parameters of the target object comprises:

respectively calculating a plurality of distances between positions of a plurality of convergence points and the user in a case where the positions of the plurality of convergence points coincide with a plurality of desired positions on the target object; and

determining the geometric parameters of the target object according to the plurality of distances, which are calculated, between the positions of the plurality of convergence points and the user, and a sight line deflection angle upon the user gazing at different desired positions on the target object.

2. The method according to claim 1 , wherein calculating the distance between the position of the convergence point and the user comprises:

calculating the distance between the position of the convergence point and the user according to a complementary angle of an included angle between the left eye sight line and a straight line passing through the left eye center position and the right eye center position, a complementary angle of an included angle between the right eye sight line and the straight line passing through the left eye center position and the right eye center position, and a linear distance between the left eye center position and the right eye center position.

3. The method according to claim 1 , wherein the plurality of distances between the positions of the plurality of convergence points and the user comprise: a first distance between a position of a convergence point, that coincides with a desired position on a first edge of the target object, and the user, and a second distance between a position of a convergence point, that coincides with a desired position on a second edge of the target object, and the user; and

the first edge is an edge, which is opposite to the second edge, of the target object.

4. The method according to claim 3 , wherein the sight line deflection angle, upon the user gazing at the different desired positions on the target object, is an angle between the first distance and the second distance.

5. The method according to claim 1 , wherein the geometric parameters of the target object comprise: a height of the target object, a width of the target object, or a thickness of the target object.

6. The method according to claim 1 , wherein the geometric parameters of the target object are calculated in a case of receiving an instruction which is used to indicate that the position of the convergence point, which is marked, coincides with the desired position on the target object.

7. The method according to claim 1 , wherein the geometric parameter measurement method is applied to an augmented reality device.

8. A geometric parameter measurement device, comprising:

a processor;

a machine readable storage medium, storing one or more computer program modules, wherein the one or more computer program modules are stored in the machine readable storage medium and configured to be executed by the processor, and the one or more computer program modules comprise instructions which are used to be executed to achieve the geometric parameter measurement method according to claim 1 .

9. A non-transitory storage medium, non-transitorily storing computer readable instructions, wherein in a case where the computer readable instructions, which are non-transitorily stored, are executed by a computer, the geometric parameter measurement method according to claim 1 is executed.

10. The method according to claim 1 , wherein determining the left eye sight line and the right eye sight line based on the left eye image and the right eye image, which images are acquired upon the user gazing at the target object, comprises:

based on the left eye image and the right eye image, which images are acquired upon the user gazing at the target object, determining a left eye pupil position, a right eye pupil position, a left eye center position, and a right eye center position; and

determining the left eye sight line and the right eye sight line according to the left eye pupil position, the right eye pupil position, the left eye center position, and the right eye center position.

11. The method according to claim 1 , further comprising:

marking a position of the convergence point in a case where a retention time period of the convergence point is greater than a preset threshold.

12. The method according to claim 11 , wherein the geometric parameters of the target object are calculated in a case where the position of the convergence point, which is marked, coincides with the desired position on the target object.

13. A geometric parameter measurement device, comprising:

a sight line determination unit, configured to acquire a left eye image and a right eye image upon a user gazing at a target object and determine a left eye sight line and a right eye sight line based on the left eye image and the right eye image, which images are acquired upon the user gazing at the target object;

a convergence point determination unit, configured to determine, according to the left eye sight line and the right eye sight line, a convergence point of the left eye sight line and the right eye sight line; and

a geometric parameter calculation unit, configured to calculate geometric parameters of the target object in a case where the convergence point coincides with a desired position on the target object;

wherein the sight line determination unit comprises:

a determination sub-unit of pupil positions and center positions of a left eye and a right eye, configured to, based on the left eye image and the right eye image, which images are acquired upon the user gazing at the target object, determine a left eye pupil position, a right eye pupil position, a left eye center position, and a right eye center position; and

a sight line acquisition sub-unit, configured to determine the left eye sight line and the right eye sight line according to the left eye pupil position, the right eye pupil position, the left eye center position, and the right eye center position;

wherein the geometric parameter calculation unit comprises:

a distance calculation sub-unit, configured to respectively calculate a plurality of distances between positions of a plurality of convergence points and the user in a case where the positions of the plurality of convergence points coincide with a plurality of desired positions on the target object; and

a geometric parameter calculation sub-unit, configured to determine the geometric parameters of the target object according to the plurality of distances, which are calculated, between the positions of the plurality of convergence points and the user, and a sight line deflection angle upon the user gazing at different desired positions on the target object.

14. The device according to claim 13 , further comprising:

a convergence point position marking unit, configured to mark a position of the convergence point in a case where a retention time period of the convergence point is greater than a preset threshold,

wherein the geometric parameter calculation unit is configured to calculate the geometric parameters of the target object in a case where the position of the convergence point, which is marked, coincides with the desired position on the target object.

15. The device according to claim 13 , wherein the distance calculation sub-unit is configured to calculate the distance between the position of the convergence point and the user according to a complementary angle of an included angle between the left eye sight line and a straight line passing through the left eye center position and the right eye center position, a complementary angle of an included angle between the right eye sight line and the straight line passing through the left eye center position and the right eye center position, and a linear distance between the left eye center position and the right eye center position.

16. An augmented reality device, comprising the geometric parameter measurement device according to claim 13 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2023
From: BOE TECHNOLOGY GROUP CO., LTD.
To: BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
Reel/Frame 064397/0480 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2019
From: LI, DIANMENG; WEI, WEI
To: BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 050580/0576 →
Priority Claims (1)
CN 201810401274.X · Apr 28, 2018 · national
Continuity (1)
Related Publication 20210357024A1 · Nov 18, 2021
Cited By (1)
US 12,551,099