IP Library Granted Patent US 10,498,988
Granted Patent B2
US 10,498,988 · App. 15/860,587 · Granted Dec 3, 2019

Image processing device and method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,498,988
App. No.
15/860,587
Granted
Dec 3, 2019
Kind
B2
Abstract

Image processing devices and methods thereof use different color conversion data of an image obtained in a black-and-white mode under a low illuminance condition than that of an image obtained in a color mode.

Claims (33)

1. An image processing device comprising:

an image obtaining unit configured to obtain a first image under a condition where an illuminance is substantially equal to or greater than a critical value, and to obtain a second image under a condition where the illuminance is less than the critical value;

a mode converter configured to convert an image processing mode into a first mode, in which color signal processing is performed on the first image, and a second mode, in which black-and-white signal processing is performed on the second image;

a color converter configured to convert a color of the first image by applying first color conversion data, including first conversion data and second conversion data, to the first image, and to convert a color of the second image by applying second color conversion data, including first conversion data and second conversion data, that is different from the first color conversion data to the second image; and

an image converter configured to convert the color converted second image into a third image, in which color information of the second image is converted into brightness information,

wherein the first conversion data is gain and the second conversion data is a color conversion matrix, and the gain of the second color conversion data is substantially equal to the gain of the first color conversion data.

2. The image processing device of claim 1 , wherein at least one of the first conversion data and the second conversion data of the second color conversion data is different from the other of the first conversion data and the second conversion data of the first color conversion data.

3. The image processing device of claim 1 , wherein the color conversion matrix of the second color conversion data is an identity matrix.

4. The image processing device of claim 1 , wherein the color conversion matrix of the second color conversion data is a combination of a color conversion matrix of the first color conversion data and an identity matrix.

5. The image processing device of claim 4 , wherein, in the color conversion matrix of the second color conversion data, a ratio of the identity matrix increases as the illuminance becomes lower than a critical value.

6. The image processing device of claim 1 , wherein the first image comprises visible ray band information, and the second image comprises the visible ray band and infrared ray (IR) band information.

7. A method of processing images comprising the steps of:

selecting an image processing mode from a first mode, in which color signal processing is performed on a first image obtained under a condition where illuminance is substantially equal to or greater than a critical value, and a second mode, in which black-and-white signal processing is performed on a second image obtained under a condition where the illuminance is less than the critical value;

if the first mode is selected, converting a color of the first image by applying first color conversion data including first conversion data and second conversion data to the first image;

if the second mode is selected, converting a color of the second image by applying second color conversion data, including first conversion data and second conversion data, that is different from the first color conversion data to the second image, the first conversion data comprising a gain and the second conversion data comprising a color conversion matrix, and the gain of the second color conversion data being substantially equal to the gain of the first color conversion data; and

converting the color converted second image into a third image, including converting the color information of the second image into brightness information.

8. The method of claim 7 , wherein at least one of the first conversion data and the second conversion data of the second color conversion data is different from the other of the first conversion data and the second conversion data of the first color conversion data.

9. The method of claim 7 , wherein the color conversion matrix of the second color conversion data is an identity matrix.

10. The method of claim 7 , wherein the color conversion matrix of the second color conversion data is a combination of a color conversion matrix of the first color conversion data and an identity matrix.

11. The method of claim 10 , wherein in the color conversion matrix of the second color conversion data, a ratio of the identity matrix increases as the illuminance becomes lower than the critical value.

12. The method of claim 7 , wherein the first image comprises visible ray band information, and the second image comprises the visible ray band information and infrared ray (IR) band information.

13. An image processing device comprising:

an image obtaining unit configured to obtain a first image under a condition where an illuminance is substantially equal to or greater than a critical value, and to obtain a second image under a condition where the illuminance is less than the critical value;

a mode converter configured to convert an image processing mode into a first mode, in which color signal processing is performed on the first image, and a second mode, in which black-and-white signal processing is performed on the second image;

a color converter configured to convert a color of the first image by applying first color conversion data including first conversion data and second conversion data to the first image, and to convert a color of the second image by applying second color conversion data, including first conversion data and second conversion data, that is different from the first color conversion data to the second image; and

an image converter configured to convert the color converted second image into a third image, in which color information of the second image is converted into brightness information,

wherein the first conversion data is a gain and the second conversion data is a color conversion matrix, and

wherein the gain of the second color conversion data is adjusted based on a light source information and the adjusted gain is a combination of the gain of the first color conversion data and the gain of the second color conversion data, and the color conversion matrix of the second color conversion data is an identity matrix or a combination of the color conversion matrix of the first color conversion data and an identity matrix.

14. A method of processing images comprising the steps of:

selecting an image processing mode from a first mode, in which color signal processing is performed on a first image obtained under a condition where illuminance is substantially equal to or greater than a critical value, and a second mode, in which black-and-white signal processing is performed on a second image obtained under a condition where the illuminance is less than the critical value;

if the first mode is selected, converting a color of the first image by applying first color conversion data including first conversion data and second conversion data to the first image;

if the second mode is selected, converting a color of the second image by applying second color conversion data, including first conversion data and second conversion data, that is different from the first color conversion data to the second image, the first conversion data comprising a gain and the second conversion data comprising a color conversion matrix, the gain of the second color conversion data being adjusted based on a light source information and the adjusted gain being a combination of the gain of the first color conversion data and the gain of the second color conversion data, and the color conversion matrix of the second color conversion data being an identity matrix or a combination of the color conversion matrix of the first color conversion data and an identity matrix; and

converting the color converted second image into a third image, including converting the color information of the second image into brightness information.

Assignments (5)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 2, 2018
From: PARK, JONG SEON; PAC, JUNG WON; YOON, JOO HYUN; NAM, SEUNG WOOK
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 044519/0527 →