IP Library Granted Patent US 9,787,949
Granted Patent B2
US 9,787,949 · App. 14/177,448 · Granted Oct 10, 2017

Apparatus to recognize illumination environment of vehicle and control method thereof

Inventor: Myung-Woo Kim (Seongnam-si, KR)
Assignee: MANDO CORPORATION
H04N7/183G06K9/00791G06K9/4661G06K9/6223B60Q2300/314
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,787,949
App. No.
14/177,448
Granted
Oct 10, 2017
Kind
B2
Abstract

Disclosed herein are an apparatus to recognize an illumination environment of a vehicle and a control method thereof. The apparatus includes an infrared illumination sensor to detect an infrared illumination amount emitted from the sun, a camera, and an illumination environment recognition unit which detects the infrared illumination amount by the infrared illumination sensor, receives a camera exposure time from the camera, receives double exposure images captured to have different exposure values, calculates a general illumination value based on the detected infrared illumination amount, the received camera exposure time, and an illumination value obtained through an image clustering analysis of the double exposure images, calculates a rate of change in the calculated general illumination value, and recognizes a current illumination environment as an illumination environment for each time section based on the calculated general illumination value and the rate of change in the general illumination value.

Claims (29)

1. An apparatus to recognize an illumination environment of a vehicle, comprising:

an infrared illumination sensor to detect an infrared illumination amount emitted from the sun;

a camera to capture a road on which a vehicle drives; and

an illumination environment recognition unit which detects the infrared illumination amount by the infrared illumination sensor, receives a camera exposure time from the camera, receives double exposure images captured to have different exposure values by adjusting the exposure values of the camera, calculates a general illumination value based on the detected infrared illumination amount, the received camera exposure time, and an illumination value obtained through an image clustering analysis of the double exposure images, calculates a rate of change in the calculated general illumination value, and recognizes a current illumination environment as an illumination environment for each time section based on the calculated general illumination value and the rate of change in the general illumination value.

2. The apparatus according to claim 1 , wherein when, in the illumination environment recognition unit, “A” represents an infrared illumination value, “B” represents an illumination value corresponding to the camera exposure time, and “C” represents an illumination value corresponding to the result value obtained through the clustering analysis of the double exposure images, the general illumination value is obtained by the following equation:

general illumination value= W 1× A+W 2× B+W 3× C,

where W 1 , W 2 , and W 3 refer to weights, and the weights W 1 to W 3 have a relation of W 1 >W 2 >W 3 .

3. The apparatus according to claim 1 or 2 , wherein the illumination environment recognition unit determines the current illumination environment to be any one of daytime, nighttime, twilight, and dawn.

4. The apparatus according to claim 3 , wherein:

when the general illumination value is equal to or more than a preset illumination value and the rate of change in the general illumination value is less than a preset rate of change, the illumination environment recognition unit determines the current illumination environment to be daytime;

when the general illumination value is less than a preset illumination value and the rate of change in the general illumination value is less than a preset rate of change, the illumination environment recognition unit determines the current illumination environment to be nighttime;

when the general illumination value gradually decreases and the rate of change in the general illumination value is equal to or more than a preset rate of change, the illumination environment recognition unit determines the illumination environment to be twilight; and

when the general illumination value gradually increases and the rate of change in the general illumination value is equal to or more than a preset rate of change, the illumination environment recognition unit determines the illumination environment to be dawn.

5. The apparatus according to claim 1 , wherein when the general illumination value rapidly decreases for a short time period, the illumination environment recognition unit determines the current illumination environment as entry into a tunnel.

6. A method of recognizing an illumination environment of a vehicle, comprising:

detecting an infrared illumination amount by an infrared illumination sensor to detect an infrared illumination amount emitted from the sun;

receiving a camera exposure time from a camera to capture a road on which a vehicle drives;

receiving double exposure images captured to have different exposure values by adjusting the exposure values of the camera;

calculating a general illumination value based on the detected infrared illumination amount, the received camera exposure time, and an illumination value obtained through an image clustering analysis of the double exposure images;

calculating a rate of change in the calculated general illumination value; and recognizing a current illumination environment as an illumination environment for each time section based on the calculated general illumination value and the rate of change in the general illumination value.

7. The method according to claim 6 , wherein when, in the calculating a general illumination value, “A” represents an infrared illumination value, “B” represents an illumination value corresponding to the camera exposure time, and “C” represents an illumination value corresponding to the result value obtained through the clustering analysis of the double exposure images, the general illumination value is obtained by the following equation:

general illumination value= W 1× A+W 2× B+W 3× C,

where W 1 , W 2 , and W 3 refer to weights, and the weights W 1 to W 3 have a relation of W 1 >W 2 >W 3 .

8. The method according to claim 7 , wherein:

when the general illumination value is equal to or more than a preset illumination value and the rate of change in the general illumination value is less than a preset rate of change, the current illumination environment is determined to be daytime;

when the general illumination value is less than a preset illumination value and the rate of change in the general illumination value is less than a preset rate of change, the current illumination environment is determined to be nighttime;

when the general illumination value gradually decreases and the rate of change in the general illumination value is equal to or more than a preset rate of change, the illumination environment is determined to be twilight; and

when the general illumination value gradually increases and the rate of change in the general illumination value is equal to or more than a preset rate of change, the illumination environment is determined to be dawn.

9. The method according to claim 6 , wherein the recognizing an illumination environment determines the current illumination environment to be any one of daytime, nighttime, twilight, and dawn.

Assignments (3)
MERGER Recorded Aug 23, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 060874/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2021
From: MANDO CORPORATION
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 058042/0328 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2014
From: KIM, MYUNG-WOO
To: MANDO CORPORATION
Reel/Frame 032193/0032 →
Priority Claims (1)
KR 10-2013-0016746 · Feb 18, 2013 · national
Continuity (1)
Related Publication 20140232854A1 · Aug 21, 2014