IP Library Granted Patent US 11,847,797
Granted Patent B2
US 11,847,797 · App. 17/279,289 · Granted Dec 19, 2023

Calibration method for multi-degree-of-freedom movable vision system

Inventors: Kaifang Wang (Shanghai, CN); Dongdong Yang (Shanghai, CN); Xiaolin Zhang (Shanghai, CN)
Assignee: ANHUI EYEVOLUTION TECHNOLOGY CO., LTD.
G06T7/85G06F17/16G06T7/44G06T7/579G06T7/97G06T2207/30208G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,847,797
App. No.
17/279,289
Granted
Dec 19, 2023
Kind
B2
Abstract

In a calibration method for a multi-degree-of-freedom movable vision system, a calibration template is placed in front of a camera component, each degree of freedom of movement of the camera component is rotated, several images including features of the calibration template are recorded using the camera component, position information of each degree of freedom of movement when the corresponding images are acquired is also recorded, and calibration results of the camera component and each degree of freedom of movement are calculated using a calculation component. The movable vision system comprises the camera component, the calculation component and a control component.

Claims (86)

1. A calibration method of a multi-degree-of-freedom movable vision system, wherein the multi-degree-of-freedom movable vision system comprises:

an imaging device comprising at least one camera each capable of capturing a sequence of consecutive images, the imaging device having at least one rotatable axis and mounted on a base, wherein each rotatable axis is provided with a position acquisition sensor capable of acquiring rotation or translation information;

a calculation circuit capable of calculating and processing information of images and information of movement in each rotatable axis; and

a control circuitry capable of controlling movement in each rotatable axis, and

wherein the calibration method comprises:

1) Obtaining a position information of each rotatable axis at a reference position;

2) fixedly placing a calibration template, rotating an a-th rotatable axis for multiple times, and for each rotation: capturing an image by the camera, and simultaneously recording a position information of the rotatable axis by the position acquisition sensor, where a=1 . . . N, a is a serial number of the rotatable axis, and N is a number of the rotatable axis;

3) Calculating rotation and translation transformation matrices of the camera of each captured image relative to the camera at the reference position through a calibration algorithm based on the sequence of images obtained by the multiple rotations; and

4) converting rotation angles of the rotatable axis relative to the reference position into rotation matrices, putting the rotation matrices into a relationship model between a rotatable axis coordinate system and a camera coordinate system to obtain calibration results, wherein the calibration results comprise rotation and translation matrices for each rotatable axis relative to the camera coordinate system.

2. The calibration method of a multi-degree-of-freedom movable vision system according to claim 1 , wherein the calibration template includes one of a natural static scene and an artificial standard target, wherein the natural static scene when serving as the calibration template provides invariant features and known information of position relationship between the features, and wherein the artificial standard target includes at least one of a two-dimensional (2D) planar target and a three-dimensional (3D) stereoscopic target.

3. The calibration method of a multi-degree-of-freedom movable vision system according to claim 1 , wherein a relative positional relationship between a current position of the camera and the reference position is calculated from the calibration results and a current position information of the camera in each rotatable axis and the relationship model, and wherein the relative positional relationship is expressed by rotation and translation matrices.

4. The calibration method of a multi-degree-of-freedom movable vision system according to claim 3 , wherein the relationship model is

W

a

=

[

R

B

C

a

T

B

C

a

0

1

]

-

1

[

R

p

a

0

0

1

]

[

R

B

C

a

T

B

C

a

0

1

]

,

a

=

1

N

[

R

T

0

1

]

=

W

1

W

2

*

*

W

N

where R′ and 7″ are rotation and translation matrices of the current position of the camera relative to the reference position, respectively, R BCa and T BCa are rotation and translation matrices of the a-th rotatable axis relative to the camera coordinate system, N is a number of rotatable axis of the movable vision system, and R pa , is a rotation matrix converted from a rotation angle of the a-th rotatable axis relative to the reference position.

Assignments (3)
CHANGE OF NAME Recorded Mar 27, 2023
From: SHANGHAI EYEVOLUTION TECHNOLOGY CO., LTD.
To: ANHUI EYEVOLUTION TECHNOLOGY CO., LTD.
Reel/Frame 063104/0815 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S STREET ADDRESS PREVIOUSLY RECORDED AT REEL: 055711 FRAME: 0570. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Apr 1, 2021
From: WANG, KAIFANG; YANG, DONGDONG; ZHANG, XIAOLIN
To: SHANGHAI EYEVOLUTION TECHNOLOGY CO., LTD
Reel/Frame 055804/0094 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2021
From: WANG, KAIFANG; YANG, DONGDONG; ZHANG, XIAOLIN
To: SHANGHAI EYEVOLUTION TECHNOLOGY CO., LTD
Reel/Frame 055711/0570 →
Priority Claims (1)
CN 201811141453.0 · Sep 28, 2018 · national
Continuity (1)
Related Publication 20210407135A1 · Dec 30, 2021