IP Library › Granted Patent US 11,688,102
Granted Patent B2
US 11,688,102 · App. 16/551,736 · Granted Jun 27, 2023

Image capture system with calibration function

Inventors: Ming-Hua Lin (Taipei, TW); Chi-Feng Lee (Hsinchu County, TW)
Assignee: eYs3D Microelectronics, Co.
G06T7/85G06T7/521H04N13/204G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,688,102
App. No.
16/551,736
Granted
Jun 27, 2023
Kind
B2
Abstract

An image capture system with calibration function includes an image capture device, a laser rangefinder, and a processer. The image capture device captures two images. The processer determines at least one feature point according to the two images, and generates depth information corresponding to each feature point of the at least one feature point according to the two images, wherein the laser rangefinder measures a reference distance corresponding to the each feature point, and the processer optionally calibrates the depth information or the two images according to the reference distance.

Claims (22)

1. An image capture system with calibration function, comprising:

an image capture device;

a laser rangefinder emitting laser beam, wherein the image capture device is used for capturing two images corresponding to the laser beam; and

a processor coupled to the image capture device and the laser rangefinder for determining at least one feature point according to positions of the laser beam in the two images, and generating depth information corresponding to each feature point of the at least one feature point according to the two images;

wherein the laser rangefinder measures a reference distance corresponding to the each feature point, and when the processor determines to calibrate the depth information or the two images, the processor executes scan line calibration according to the at least one feature point to generate two aligned images, generates aligned depth information corresponding to the each feature point according to the two aligned images, and calibrates the aligned depth information or the two aligned images according to the reference distance when a resolution of a depth map or a number of valid pixels of the depth map is less than a predetermined value, wherein the two images are used for generating the depth map.

2. The image capture system of claim 1 , wherein when the processor determines that the depth information or the two images need to be calibrated according to the reference distance, the processor calibrates the aligned depth information or the two aligned images according to the reference distance.

3. The image capture system of claim 2 , wherein when the two images need to be calibrated, the processor generates a reference coordinate corresponding to the each feature point according to the reference distance, calibrates the two aligned images according to at least one reference coordinate of the at least one feature point.

4. The image capture system of claim 2 , wherein when the depth information needs to be calibrated, the processor generates the aligned depth information corresponding to the reference distance according to the two aligned images, generates a relation according to the aligned depth information and the reference distance, and calibrates the aligned depth information according to the relation, wherein the scan line calibration is used for aligning scan lines of the two images.

5. The image capture system of claim 1 , wherein the processor adjusts a direction or an angle of the laser rangefinder to make the laser rangefinder emit at least one laser beam to the at least one feature point and measure the reference distance.

6. The image capture system of claim 1 , wherein the processor executes the scan line calibration on the two images according to the at least one feature point to generate the two aligned images.

7. The image capture system of claim 1 , wherein when an image misalignment exists between the two images, the processor calibrates the aligned depth information or the two aligned images according to the reference distance.

8. The image capture system of claim 1 , wherein when a difference between the depth information and the reference distance is greater than a predetermined value, the processor calibrates the aligned depth information or the two aligned images according to the reference distance.

9. An image capture system with calibration function, comprising:

an image capture device;

a laser rangefinder emitting laser beam; and

a processor generating a plurality of depth information according to at least one image captured by the image capture device, wherein the at least one image corresponds to the laser beam, and each depth information of the plurality of depth information correspond to a corresponding position of positions of the laser beam in the at least one image;

wherein the laser rangefinder measures a plurality of reference distances corresponding to the plurality of depth information, and the processor calibrates the plurality of depth information according to the plurality of reference distances when a resolution of a depth map or a number of valid pixels of the depth map is less than a predetermined value, wherein the depth map corresponds to the at least one image.

10. An image capture system with calibration function, comprising:

an image capture device;

a laser light source emitting laser beam; and

a processor determining feature points according to positions of the laser beam in one image captured by the image capture device, and generating a plurality of depth information corresponding to the feature points;

wherein the laser light source measures a plurality of reference distances corresponding to the plurality of depth information, and the processor calibrates the plurality of depth information according to the plurality of reference distances when a resolution of a depth map or a number of valid pixels of the depth map is less than a predetermined value, wherein the depth map corresponds to the one image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2019
From: LIN, MING-HUA; LEE, CHI-FENG
To: EYS3D MICROELECTRONICS, CO.
Reel/Frame 050173/0944 →
Continuity (2)
Provisional Application 62723493 · Aug 28, 2018
Related Publication 20200074684A1 · Mar 5, 2020
Cited By (1)
US 12,205,356