IP Library Granted Patent US 9,619,895
Granted Patent B2
US 9,619,895 · App. 14/465,814 · Granted Apr 11, 2017

Image processing method of vehicle camera and image processing apparatus using the same

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,619,895
App. No.
14/465,814
Granted
Apr 11, 2017
Kind
B2
Abstract

Disclosed herein is an image processing apparatus of a vehicle camera, including a light source extraction unit configured to extract light sources from a first frame exposed to light sources during a first time and to extract light sources including motion blurs from a second frame exposed to the light sources during a second time longer than the first time, a target light source classification unit configured to classify a first target light source that belongs to the light sources of the first frame and that does not move and a second target light source that belongs to the light sources of the second frame and that does not move, and a motion determination unit configured to estimate a first location that is the central point of the first target light source and a second location that is the central line including the central point of the second target light source, compare the first location with the second location, and determine whether or not a pitch motion of the vehicle has occurred.

Claims (30)

1. An image processing apparatus of a vehicle camera, comprising:

a light source extraction unit configured to extract light sources from a first frame exposed to light sources during a first time and to extract light sources generating motion blurs from a second frame exposed to the light sources during a second time longer than the first time;

a target light source classification unit configured to classify a first target light source that belongs to the light sources of the first frame and that does not move and a second target light source that belongs to the light sources of the second frame and that does not move;

a motion determination unit configured to estimate a first location that is a central point of the first target light source and a second location that is a central line comprising a central point of the second target light source, compare the first location with the second location, determine whether or not a pitch motion of the vehicle has occurred, perform binarization on an image of the first frame or the second frame, and extract coordinates of the center of gravity of pixels having a specific value as the first location or the second location; and

a correction unit configured to correct an image of the vehicle camera based on a result of the comparison between the first location and the second location.

2. The image processing apparatus according to claim 1 , wherein the light source that does not move comprises at least one of a streetlamp and a visual guidance reflector.

3. The image processing apparatus according to claim 1 , wherein the motion determination unit is further configured to overlap the first frame and the second frame and to determine a direction or degree of the pitch motion of the vehicle based on a location where the first location and the second location are overlapped.

4. The image processing apparatus according to claim 1 , wherein a digital sensor of the image processing apparatus is a rolling shutter type CMOS sensor.

5. An image processing method of a vehicle camera, comprising:

extracting light sources from a first frame that has been obtained by the vehicle camera and that has been exposed to light sources during a first time;

classifying a first target light source that belongs to the extracted light sources and that does not move;

computing a first location that is a central point of the first target light source;

extracting light sources generating motion blurs from a second frame that has been obtained by the vehicle camera and that has been exposed to light sources during a second time longer than the first time;

classifying a second target light source that belongs to the light sources extracted from the second frame and that does not move;

computing a second location that is a central line comprising a central point of the second target light source;

comparing the first location with the second location; and

determining whether or not a pitch motion of the vehicle has occurred based on a result of the comparison between the first location and the second location,

wherein the computing the first location or the computing the second location comprises:

performing binarization on an image of the first frame or the second frame, and

extracting coordinates of the center of gravity of pixels having a specific value as the first location or the second location.

6. The image processing method according to claim 5 , further comprising correcting an image of the vehicle camera based on the result of the comparison between the first location and the second location.

7. The image processing method according to claim 5 , wherein classifying the first target light source or classifying the second target light source comprises classifying a light source present in a predetermined region of the first frame or the second frame as a target light source.

8. The image processing method according to claim 5 , wherein classifying the first target light source or classifying the second target light source comprises classifying a plurality of streetlamps or visual guidance reflectors arranged along a road as target light sources in accordance with a training method using a support vector machine.

9. The image processing method according to claim 5 , wherein determining whether or not a pitch motion of the vehicle has occurred based on a result of the comparison between the first location and the second location comprises:

overlapping the first frame and the second frame, and

determining a direction or degree of the pitch motion of the vehicle based on a position where the first location and the second location are overlapped.

10. The image processing method according to claim 5 , wherein the second frame is a frame that belongs to a plurality of frames included in the image and that is placed right after the first frame.

11. The image processing method according to claim 6 , wherein correcting an image of the vehicle camera comprises:

extracting an optimized correction direction and distance using a RANdom SAmple Consensus (RANSAC) algorithm, and

correcting the image.

Assignments (4)
CHANGE OF NAME Recorded Dec 18, 2022
From: MANDO CORPORATION
To: HL MANDO CORPORATION
Reel/Frame 062152/0127 →
MERGER Recorded Sep 2, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 061375/0680 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2021
From: MANDO CORPORATION
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 058158/0300 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2014
From: LIM, JUN TAEK
To: MANDO CORPORATION
Reel/Frame 033593/0858 →