IP Library › Granted Patent US 10,192,287
Granted Patent B2
US 10,192,287 · App. 15/388,124 · Granted Jan 29, 2019

Image processing method and image system for transportation

Inventors: Sheng-Wei Chan (Taipei, TW); Che-Tsung Lin (Hsinchu, TW)
Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
G06T3/4038G06K9/00523G06K9/00791G06K9/00798G06K9/224G06K9/4671G06K9/6211G06K9/6228G06K2009/2045G06K2009/363
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,192,287
App. No.
15/388,124
Granted
Jan 29, 2019
Kind
B2
Abstract

An image processing method is adapted to process images captured by at least two cameras in an image system. In an embodiment, the image processing method comprises: matching two corresponding feature points for two images, respectively, to become a feature point set; selecting at least five most suitable feature point sets, by using an iterative algorithm; calculating a most suitable radial distortion homography between the two images, according to the at least five most suitable feature point sets; and fusing the images captured by the at least two cameras at each of timing sequences, by using the most suitable radial distortion homography.

Claims (31)

1. An image processing method for transportation adapted to process images captured by at least two cameras disposed on one vehicle in an image system, comprising:

matching two corresponding feature points for two images, respectively, to become a feature point set;

selecting at least five most suitable feature point sets, by using an iterative algorithm;

calculating a most suitable radial distortion homography between the two images, according to the at least five most suitable feature point sets; and

fusing the images captured by the at least two cameras at each of timing sequences, by using the most suitable radial distortion homography;

wherein before selecting the at least five most suitable feature point sets, randomly selecting at least five feature point sets;

iteratively calculating a plurality of radial distortion homographies before calculating the most suitable radial distortion homography between the two images; and

quantitatively assessing the plurality of radial distortion homographies;

wherein after iteratively calculating each of the plurality of radial distortion homographies for every iteration, the image processing method further comprises:

marking a ground truth point set between the two images;

transforming the ground truth point set into a transfer point set, respectively, according to each of the plurality of radial distortion homographies; and

calculating a distance difference value between the transfer point set and the ground truth point set.

2. The image processing method according to claim 1 , wherein before matching the two corresponding feature points for the two images, respectively, to become the feature point set, the image processing method further comprises:

detecting a plurality of feature points of the two images.

3. The image processing method according to claim 1 , wherein after fusing the images captured by the at least two cameras at each of the timing sequences, by using the most suitable radial distortion homography, the image processing method further comprises:

storing the most suitable radial distortion homography.

4. The image processing method according to claim 1 , further comprising:

performing a transparency step on images of one of the at least two cameras; and

fusing the images performed by the transparency step at each of the timing sequences.

5. The image system according to claim 1 , wherein the processor is configured to fuse the images of the at least two cameras, by using the most suitable radial distortion homography.

6. The image system according to claim 5 , wherein the processor is configured to eliminate sight obstructions between the images captured by the at least two cameras.

7. An image system for transportation, the image system comprising:

at least two cameras disposed on one vehicle and configured to capture images;

a processor coupled to the at least two cameras, wherein the processor is configured to eliminate distortions of the at least two cameras so as to obtain fused images without distortions; and

a monitor coupled to the processor, wherein the monitor is configured to display the fused images without distortions;

wherein the processor is further configured to calculate a most suitable radial distortion homography, by using an iterative algorithm;

wherein the processor is further configured to iteratively calculate a plurality of radial distortion homographies before calculating the most suitable radial distortion homography between the two images and to quantitatively assess the plurality of radial distortion homographies;

wherein after iteratively calculating each of the plurality of radial distortion homographies for every iteration, the processor is further configured to:

mark a ground truth point set between the two images;

transform the ground truth point set into a transfer point set, respectively, according to each of the plurality of radial distortion homographies; and

calculate a distance difference value between the transfer point set and the ground truth point set.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE FIRST INVENTOR FROM "SHENG-WI CHAN" TO --SHENG-WEI CHAN-- PREVIOUSLY RECORDED ON REEL 042325 FRAME 0844. ASSIGNOR(S) HEREBY CONFIRMS THE NAME OF THE FIRST INVENTOR TO BE --SHENG-WEI CHAN--.. Recorded May 25, 2017
From: CHAN, SHENG-WEI; LIN, CHE-TSUNG
To: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
Reel/Frame 042583/0815 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2017
From: CHAN, SHENG-WI; LIN, CHE-TSUNG
To: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
Reel/Frame 042325/0844 →
Priority Claims (1)
TW 105139290 A · Nov 29, 2016 · national
Continuity (1)
Related Publication 20180150939A1 · May 31, 2018