IP Library Granted Patent US 10,009,595
Granted Patent B2
US 10,009,595 · App. 14/849,618 · Granted Jun 26, 2018

Image calibration system and calibration method of a stereo camera

Inventors: Wen-Kuo Lin (Taipei, TW); Ming-Che Ho (Kaohsiung, TW)
Assignee: eYs3D Microelectronics, Co.
H04N13/0246G06T7/85H04N13/0239G06T2207/10021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,009,595
App. No.
14/849,618
Granted
Jun 26, 2018
Kind
B2
Abstract

A calibration method of a stereo camera includes transmitting a group of system parameters of the stereo camera to a server; downloading calibration pattern corresponding to the group of system parameters from the server; calculating a plurality of camera calibration parameters corresponding to the stereo camera according to the calibration pattern; and executing an image rectification operation on a left eye image capture unit and a right eye image capture unit of the stereo camera according to the plurality of camera calibration parameters, respectively.

Claims (36)

1. A calibration method of a stereo camera, wherein the stereo camera comprises a first image capture unit and a second image capture unit, the calibration method comprising:

transmitting a group of default system parameters of the stereo camera from the stereo camera to a server;

downloading a calibration pattern corresponding to the group of default system parameters from the server;

calculating a plurality of camera calibration parameters corresponding to the stereo camera according to the calibration pattern; and

executing an image rectification operation on the first image capture unit and the second image capture unit according to the plurality of camera calibration parameters, respectively, wherein the server does not change the group of default system parameters transmitted from the stereo camera to the server during the image rectification operation being executed on the first image capture unit and the second image capture unit, and the group of default system parameters is not changed with a first image captured by the first capture unit and a second image captured by the second capture unit.

2. The calibration method of claim 1 , wherein a processor of the stereo camera transmits the group of default system parameters to the server through a calibration program, and the calibration program is built in the stereo camera, or the processor of the stereo camera downloads the calibration program from the server.

3. The calibration method of claim 1 , wherein calculating the plurality of camera calibration parameters corresponding to the stereo camera according to the calibration pattern comprises:

the first image capture unit and the second image capture unit executing an image capture operation on the calibration pattern respectively to generate a first image and a second image corresponding to the calibration pattern when the calibration pattern displayed by a display is located within an image calibration range of the stereo camera;

generating projection parameters corresponding to the calibration pattern according to a first image and a second image corresponding to the calibration pattern, respectively; and

calculating the plurality of camera calibration parameters according to the projection parameters corresponding to the calibration pattern.

4. The calibration method of claim 3 , wherein the display has at least one position marker, and the processor of the stereo camera utilizes at least one alignment marker of another display and the at least one position marker to make the calibration pattern be located within the image calibration range of the stereo camera.

5. The calibration method of claim 3 , wherein the processor of the stereo camera calculates the plurality of camera calibration parameters corresponding to the stereo camera according to the projection parameters corresponding to the calibration pattern.

6. The calibration method of claim 3 , wherein the server calculates the plurality of camera calibration parameters corresponding to the stereo camera according to the projection parameters corresponding to the calibration pattern.

7. The calibration method of claim 3 , wherein the stereo camera is connected to the server through a host and an Internet, and the display is coupled to the host.

8. The calibration method of claim 3 , wherein the stereo camera is connected to the server through an Internet, and the display is coupled to the stereo camera.

9. The calibration method of claim 1 , further comprising:

transmitting an identification parameter corresponding to the stereo camera to the server.

10. The calibration method of claim 1 , wherein the group of default system parameters comprises at least one of a lens focal length, an optical axis, and a lens deformation corresponding to the first image capture unit, a lens focal length, an optical axis, and a lens deformation corresponding to the second image capture unit, a distance between the first image capture unit and the second image capture unit, a number of a plurality of sensing rows of the first image capture unit and a number of a plurality of sensing rows of the second image capture unit, a number of sensing pixels comprised in each of the plurality of sensing rows of the first image capture unit and the plurality of sensing rows of the second image capture unit, and a size of each of the sensing pixels.

11. The calibration method of claim 1 , further comprising:

transmitting default characteristic parameters of a display to the server;

downloading another calibration pattern corresponding to the group of default system parameters and the default characteristic parameters of the display from the server, wherein the display displays the another calibration pattern;

calculating a plurality of camera calibration parameters corresponding to the stereo camera according to the another calibration pattern; and

executing an image rectification operation on the first image capture unit and the second image capture unit according to the plurality of camera calibration parameters, respectively.

12. The calibration method of claim 11 , wherein the default characteristic parameters of the display comprise at least one of a horizontal resolution of the display, a vertical resolution of the display, and a profile and a size of the display.

13. An image calibration system, comprising:

a stereo camera having a first image capture unit, a second image capture unit, and a processor, wherein the processor transmits a group of default system parameters of the stereo camera from the stereo camera to a server, and downloads a calibration pattern corresponding to the group of default system parameters to a display from the server after the server receives the group of default system parameters, wherein the group of default system parameters is not changed with a first image captured by the first capture unit and a second image captured by the second capture unit;

wherein the processor or the server calculates a plurality of camera calibration parameters corresponding to the stereo camera according to the calibration pattern, and the processor executes an image rectification operation on the first image capture unit and the second image capture unit according to the plurality of camera calibration parameters, respectively, wherein the server does not change the group of default system parameters transmitted from the stereo camera to the server during the image rectification operation being executed on the first image capture unit and the second image capture unit.

14. The image calibration system of claim 13 , wherein the processor transmits the group of default system parameters to the server through a calibration program, and the calibration program is built in the stereo camera, or the processor downloads the calibration program from the server.

15. The image calibration system of claim 13 , wherein when the calibration pattern of the calibration pattern displayed by the display is located within an image calibration range of the stereo camera, the first image capture unit and the second image capture unit executes an image capture operation on the calibration pattern respectively to generate a first image and a second image corresponding to the calibration pattern, the processor further generates projection parameters corresponding to the calibration pattern according to a first image and a second image corresponding to the calibration pattern respectively, and the processor or the server calculates the plurality of camera calibration parameters according to the projection parameters corresponding to the calibration pattern.

16. The image calibration system of claim 15 , wherein the display has at least one position marker, and the processor of the stereo camera utilizes at least one alignment marker of another display and the at least one position marker to make the calibration pattern be located within the image calibration range of the stereo camera.

17. The image calibration system of claim 13 , wherein the stereo camera is connected to the server through a host and an Internet, and the display is coupled to the host.

18. The image calibration system of claim 13 , wherein the processor further transmits an identification parameter corresponding to the stereo camera to the server.

19. The image calibration system of claim 13 , wherein the stereo camera is connected to the server through an Internet, and the display is coupled to the stereo camera.

20. An image calibration system, comprising:

a stereo camera having a first image capture unit, a second image capture unit, and a processor, wherein the processor transmits a group of default system parameters of the stereo camera and default characteristic parameters of a display from the stereo camera to a server, and downloads a calibration pattern corresponding to the group of default system parameters and the default characteristic parameters of the display from the server to the display after the server receives the group of default system parameters and the default characteristic parameters of the display, wherein the group of default system parameters is not changed with a first image captured by the first capture unit and a second image captured by the second capture unit;

wherein when the calibration pattern displayed by the display is located within an image calibration range of the stereo camera, the processor or the server calculates a plurality of camera calibration parameters corresponding to the stereo camera according to the calibration pattern, and the processor executes an image rectification operation on the first image capture unit and the second image capture unit according to the plurality of camera calibration parameters, respectively, wherein the server does not change the group of default system parameters of the stereo camera and the default characteristic parameters of the display transmitted from the stereo camera to the server during the image rectification operation being executed on the first image capture unit and the second image capture unit.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2016
From: ETRON TECHNOLOGY, INC.
To: EYS3D MICROELECTRONICS, CO.
Reel/Frame 038324/0429 →
EMPLOYMENT CONTRACT OF MING-CHE HO WITH ETRON TECHNOLOGY, INC. Recorded Mar 17, 2016
From: HO, MING-CHE
To: ETRON TECHNOLOGY, INC.
Reel/Frame 038129/0456 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2016
From: LIN, WEN-KUO
To: ETRON TECHNOLOGY, INC.
Reel/Frame 038005/0848 →
Continuity (2)
Provisional Application 62048272 · Sep 10, 2014
Related Publication 20160073092A1 · Mar 10, 2016