IP Library Granted Patent US 10,432,859
Granted Patent B2
US 10,432,859 · App. 15/393,456 · Granted Oct 1, 2019

Image processing apparatus and method for setting wide dynamic range mode based on luminance of image

Inventor: Chang Min Lee (Changwon-si, KR)
Assignee: HANWHA TECHWIN CO., LTD.
H04N5/23245H04N5/2351H04N5/2353H04N5/2355H04N5/35581
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,432,859
App. No.
15/393,456
Granted
Oct 1, 2019
Kind
B2
Abstract

Provided is an image processing apparatus which generates a wide dynamic range (WDR) image using an image sensor. The image processing apparatus includes: an image sensor which outputs image data having a plurality of image channels; a mode setting unit which changes a photographing mode from a first mode in which a first number of sub-images are synthesized to a second mode in which a second number of sub-images are synthesized, based on luminance of the output image data; a register setting unit which changes a register value of the image sensor according to the second mode; and an image signal processor (ISP) which generates a result image by synthesizing the second number of sub-images from the image data according to the changed register value, wherein the second number of sub-images have different exposure times.

Claims (43)

1. An image processing apparatus comprising:

an image sensor configured to output image data having a plurality of image channels;

at least one processor configured to implement:

a mode setting unit which changes a photographing mode from a first mode in which a first number of sub-images are synthesized to a second mode in which a second number of sub-images are synthesized, based on luminance of the output image data: and

a register setting unit which changes a register value of the image sensor according to the second mode; and

an image signal processor (ISP) configured to generate a result image by synthesizing the second number of sub-images from the image data according to the changed register value,

wherein the second number of sub-images have different exposure times,

wherein the register value comprises a maximum shutter speed for each photographing mode and a shutter speed for each image channel, and

wherein the maximum shutter speed is set in inverse proportion to a number of sub-images to be synthesized for generating the result image.

2. The apparatus of claim 1 , wherein the number of image channels output from the image sensor is constant regardless of the photographing mode.

3. The apparatus of claim 1 , wherein the ISP is configured to read the second number of image channels according to the second mode among the image channels included in the image data output from the image sensor and generate the result image by synthesizing the second number of sub-images.

4. The apparatus of claim 3 , wherein the ISP is configured to implement:

a channel writer which sequentially records in an input channel buffer the image channels included in the image data output from the image sensor according to the second mode;

a channel reader which reads the second number of image channels among the image channels recorded in the input channel buffer and records the second number of image channels in an output channel buffer; and

a wide dynamic range (WDR) image generator which synthesizes sub-images corresponding to the second number of image channels recorded in the output channel buffer.

5. The apparatus of claim 4 , wherein the WDR image generator comprises:

a sub-image generation unit configured to generate the second number of sub-images respectively from the second number of image channels recorded in the output channel buffer; and

an image synthesis unit configured to generate the result image by synthesizing the second number of sub-images.

6. The apparatus of claim 5 , wherein the image synthesis unit is configured to generate the result image by assigning a different weight to each of the second number of sub-images or to each area of each of the second number of sub-images.

7. The apparatus of claim 1 , wherein each of the first number of sub-images and the second number of sub-images is an integer equal to or greater than 1.

8. The apparatus of claim 7 , wherein each of the first number of sub-images and the second number of sub-images is a power of 2.

9. The apparatus of claim 7 , wherein the first number of sub-images is 4, and the second number of sub-images is 2 or 1.

10. The apparatus of claim 1 , wherein the mode setting unit determines the luminance of the output image data based on a mean of luminance of pixels included in the output image data.

11. The apparatus of claim 1 , wherein the mode setting unit determines the luminance of the output image data based on a proportion of dark pixels whose luminance is equal to or lower than a first predetermined level in the output image data or the proportion of bright pixels whose luminance is equal to or higher than a second predetermined level in the output image data.

12. A image processing method comprising:

outputting image data having a plurality of image channels using an image sensor;

changing a photographing mode from a first mode in which a first number of sub-images are synthesized to a second mode in which a second number of sub-images are synthesized, based on luminance of the output image data;

changing a register value of the image sensor according to the second mode;

outputting modified image data corresponding to the changed register value; and

generating a result image by synthesizing the second number of sub-images from the modified image data,

wherein the second number of sub-images have different exposure times,

wherein the register value comprises a maximum shutter speed for each photographing mode and a shutter speed for each image channel, and

wherein the maximum shutter speed is set in inverse proportion to a number of sub-images to be synthesized for generating the result image.

13. The method of claim 12 , wherein the number of image channels output from the image sensor is constant regardless of the photographing mode.

14. The method of claim 12 , wherein the generating of the result image comprises reading the second number of image channels according to the second mode among the image channels included in the modified image data and generating the result image by synthesizing the second number of sub-images.

15. The method of claim 12 , wherein the generating of the image comprises:

sequentially recording the image channels included in the modified image data in an input channel buffer;

reading the second number of image channels among the image channels recorded in the input channel buffer;

recording the second number of image channels in an output channel buffer; and

synthesizing sub-images corresponding to the second number of image channels recorded in the output channel buffer.

16. The method of claim 15 , wherein the synthesizing of the second number of sub-images comprises:

generating the second number of sub-images respectively from the second number of image channels recorded in the output channel buffer; and

generating the result image by synthesizing the second number of sub-images.

Assignments (7)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 5, 2026
From: VISIONEXT CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 073358/0086 →
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2022
From: HANWHA TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.; VISIONEXT CO., LTD.,
Reel/Frame 058927/0216 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2016
From: LEE, CHANG MIN
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 040800/0197 →
Priority Claims (1)
KR 10-2016-0128866 · Oct 6, 2016 · national
Continuity (1)
Related Publication 20180103203A1 · Apr 12, 2018
Cited By (1)
US 12,457,411