IP Library Granted Patent US 9,509,918
Granted Patent B2
US 9,509,918 · App. 14/783,474 · Granted Nov 29, 2016

Method and device for obtaining high dynamic range image

Inventors: Huaren Liu (Shenzhen, CN); Shuijiang Mao (Shenzhen, CN); Jingjun Fu (Shenzhen, CN); Wei Feng (Shenzhen, CN)
Assignee: BYD Company Limited
H04N5/2355H04N1/3871H04N5/35581H04N9/045H04N2201/0084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,509,918
App. No.
14/783,474
Granted
Nov 29, 2016
Kind
B2
Abstract

A method and a device for obtaining a high dynamic range image are provided. The method includes: obtaining a pixel value of each pixel in two images of a same scene; determining a brightness value of each pixel in the two images; determining an objective brightness value of each pixel in a combined image combining the two images; determining a color value of each pixel in the two images; determining a color value of each pixel in the combined image; correcting the color value of each pixel in the combined image so as to obtain a corrected color value of each pixel in the combined image; determining a pixel value of each pixel in the combined image; and obtaining a high dynamic range image.

Claims (95)

1. A method for obtaining a high dynamic range image, comprising:

obtaining a pixel value of each pixel in a long exposure image and a short exposure image of a same scene;

determining a brightness value of each pixel in the long exposure image and the short exposure image according to the pixel value of each pixel in the long exposure image and the short exposure image;

determining an objective brightness value of each pixel in a combined image combining the long exposure image with the short exposure image according to the brightness value of each pixel in the long exposure image and the short exposure image;

determining a color value of each pixel in the long exposure image and the short exposure image according to the pixel value and the brightness value of each pixel in the long exposure image and the short exposure image;

determining a color value of each pixel in the combined image according to the color value of each pixel in the long exposure image and the short exposure image;

correcting the color value of each pixel in the combined image according to the brightness value of each pixel in the long exposure image and the short exposure image and the objective brightness value of each pixel in the combined image so as to obtain a corrected color value of each pixel in the combined image;

determining a pixel value of each pixel in the combined image according to the objective brightness value and the corrected color value of each pixel in the combined image; and

obtaining a high dynamic range image according to the pixel value of each pixel in the combined image.

2. The method of claim 1 , wherein determining an objective brightness value of each pixel in a combined image according to the brightness value of each pixel in the long exposure image and the short exposure image comprises:

obtaining an average brightness value of the short exposure image according to the brightness value of each pixel in the short exposure image;

determining a proportion of the short exposure image according to the average brightness value of the short exposure image; and

determining the objective brightness value of each pixel in the combined image according to the brightness value of each pixel in the long exposure image and the short exposure image and the proportion of the short exposure image.

3. The method of claim 2 , wherein obtaining an average brightness value of the short exposure image comprises:

obtaining a sum of the brightness value of each pixel in the short exposure image; and

dividing the sum by a number of pixels in the short exposure image.

4. The method of claim 2 , wherein the proportion of the short exposure image is determined according to:

A=K*Y _ S _ AVE/ 256;

wherein A is the proportion of the short exposure image, K is a predetermined value, and Y_S_AVE is the average brightness value of the short exposure image.

5. The method of claim 2 , wherein the objective brightness value of each pixel in the combined image is determined according to:

Y _ T=Y _ L *(1− A )+ Y _ S*A;

wherein Y_T is the objective brightness value of a pixel in the combined image, Y_L is the brightness value of a pixel in the long exposure image, A is the proportion of the short exposure image, and Y_S is the brightness value of a pixel in the short exposure image and at a same location with the pixel in the long exposure image.

6. The method of claim 1 , wherein the color value of each pixel in the combined image is determined according to:

COLOR=COLOR_ L +COLOR_ S;

wherein COLOR is the color value of a pixel in the combined image, COLOR_L is the color value of a pixel in the long exposure image, and COLOR_S is the color value of a pixel in the short exposure image and at a same location with the pixel in the long exposure image.

7. The method of claim 1 , wherein correcting the color value of each pixel in the combined image according to the brightness value of each pixel in the long exposure image and the short exposure image and the objective brightness value of each pixel in the combined image comprises:

generating a feature weight value of each pixel in the long exposure image and the short exposure image according to the brightness value of each pixel in the long exposure image and the short exposure image;

generating a feature brightness value of each pixel in the combined image according to the feature weight value and the brightness value of each pixel in the long exposure image and the short exposure image; and

correcting the color value of each pixel in the combined image according to the feature brightness value and the objective brightness value of each pixel in the combined image, so as to obtain the corrected color value of each pixel in the combined image.

8. The method of claim 7 , wherein the feature weight value of each pixel in the long exposure image and the short exposure image is determined according to:

Weight_ L=M −abs( M−Y _ L ),

Weight_ S=M −abs( M−Y _ S ),

wherein Weight_L is the feature weight value of a pixel in the long exposure image,

Weight_S is the feature weight value of a pixel in the short exposure image,

Y_L is the brightness value of the pixel in the long exposure image,

Y_S is the brightness value of the pixel in the short exposure image and at a same location with the pixel in the long exposure image, and

M is a medium pixel value of the pixel values in the long exposure image or the short exposure image.

9. The method of claim 8 , wherein the feature brightness value Y_M of each pixel in the combined image is determined according to:

Y _ M =( Y _ L *Weight_ L+Y _ S *Weight_ S )/(Weight_ L +Weight_ S ).

10. The method of claim 9 , wherein the corrected color value of each pixel in the combined image is determined according to:

XCOLOR=( Y _ T/Y _ M )*COLOR;

wherein XCOLOR is the corrected color value, and Y_T is the objective brightness value of each pixel in the combined image.

11. The method of claim 10 , wherein a pixel value result of each pixel in the combined image is determined according to:

RESULT= Y _ T +XCOLOR;

wherein RESULT is the pixel value result.

12. A device for obtaining a high dynamic range image, comprising:

at least one processor; and

at least one memory including computer program code,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least:

obtain a pixel value of each pixel in a long exposure image and a short exposure image of a same scene;

determine a brightness value of each pixel in the long exposure image and the short exposure image according to the pixel value of each pixel in the long exposure image and the short exposure image;

determine an objective brightness value of each pixel in a combined image combining the long exposure image with the short exposure image according to the brightness value of each pixel in the long exposure image and the short exposure image;

determine a color value of each pixel in the long exposure image and the short exposure image according to the pixel value and the brightness value of each pixel in the long exposure image and the short exposure image, and to determine the color value of each pixel in the combined image according to the color value of each pixel in the long exposure image and the short exposure image;

correct the color value of each pixel in the combined image according to the brightness value of each pixel in the long exposure image and the short exposure image and the objective brightness value of each pixel in the combined image, so as to obtain a corrected color value of each pixel in the combined image;

determine the pixel value of each pixel in the combined image according to the objective brightness value and the corrected color value of each pixel in the combined image; and

obtain a high dynamic range image according to the pixel value of each pixel in the combined image.

13. The device of claim 12 , wherein, to determine an objective brightness value of each pixel, the device is further caused, at least in part to:

obtain an average brightness value of the short exposure image according to the brightness value of each pixel in the short exposure image;

determine a proportion of the short exposure image according to the average brightness value of each pixel in the short exposure image; and

determine the objective brightness value of each pixel in the combined image according to the brightness value of each pixel in the long exposure image and the short exposure image and the proportion of the short exposure image.

14. The device of claim 13 , wherein the average brightness value of the short exposure image is determined by:

obtaining a sum of the brightness value of each pixel in the short exposure image, and then dividing the sum by a number of pixels in the short exposure image.

15. The device of claim 13 , wherein the proportion A of the short exposure image is determined according to:

A=K*Y _ S _ AVE/ 256;

wherein K is a predetermined value, and

Y_S_AVE is the average brightness value of the short exposure image.

16. The device of claim 13 , wherein the objective brightness values Y_T of each pixel in the combined image is determined according to:

Y _ T=Y _ L *(1− A )+ Y _ S*A;

wherein Y_L is the brightness value of a pixel in the long exposure image, A is the proportion of the short exposure image, and

Y_S is the brightness value of a pixel in the short exposure image and at a same location with the pixel in the long exposure image.

17. The device of claim 12 , wherein the color value COLOR of each pixel in the combined image is determined according to:

COLOR=COLOR_ L +COLOR_ S;

wherein COLOR_L is the color value of a pixel in the long exposure image, and

COLOR_S is the color value of a pixel in the short exposure image and at a same location with the pixel in the long exposure image.

18. The device of claim 12 , wherein, to correct the color value of each pixel, the device is further caused, at least in part to:

generate a feature weight value of each pixel in the long exposure image and the short exposure image according to the brightness value of each pixel in the long exposure image and the short exposure image ;

generate a feature brightness value of each pixel in the combined image according to the feature weight value and the brightness value of each pixel in the long exposure image and the short exposure image; and

correct the color value of each pixel in the combined image according to the feature brightness value and the objective brightness value of each pixel in the combined image to obtain the corrected color value of each pixel in the combined image.

19. The device of claim 18 , wherein the feature weight value of each pixel in the long exposure image and the short exposure image is determined according to:

Weight_ L=M −abs( M−Y _ L ),

Weight_ S=M −abs( M−Y _ S );

wherein Weight_L is the feature weight value of a pixel in the long exposure image,

Weight_S is the feature value of a pixel in the short exposure image,

Y_L is the brightness value of the pixel in the long exposure image,

Y_S is the brightness value of the pixel in the short exposure image and at a same location with the pixel in the long exposure image, and

M is a medium pixel value of the pixel values in the long exposure image or the short exposure image.

20. The device of claim 19 , wherein the feature brightness value Y_M of each pixel in the combined image is determined according to:

Y _ M =( Y _ L *Weight_ L+Y _ S *Weight_ S )/(Weight_ L +Weight_ S ).

21. The device of claim 20 , wherein the corrected color value of each pixel in the combined image is determined according to:

XCOLOR=( Y _ T/Y _ M )*COLOR,

wherein XCOLOR is the corrected color value, and Y_T is the objective brightness value of each pixel in the combined image.

22. The device of claim 21 , wherein a pixel value result of the combined image is determined according to:

RESULT= Y _ T +XCOLOR;

wherein RESULT is the pixel value result.

23. A computer program product comprising at least one non-transitory computer-storage medium having computer-executable instructions for performing the method of claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2015
From: LIU, HUAREN; MAO, SHUIJIANG; FU, JINGJUN; FENG, WEI
To: BYD COMPANY LIMITED
Reel/Frame 036829/0911 →
Priority Claims (1)
CN 2013 1 0154552 · Apr 28, 2013 · national
Continuity (1)
Related Publication 20160057333A1 · Feb 25, 2016