IP Library Granted Patent US 9,934,562
Granted Patent B2
US 9,934,562 · App. 15/449,894 · Granted Apr 3, 2018

Method for dynamic range editing

Inventor: Nils Kokemohr (Hamburg, DE)
Assignee: Google LLC
G06T5/009G06K9/36G06K9/52G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,934,562
App. No.
15/449,894
Granted
Apr 3, 2018
Kind
B2
Abstract

A method of displaying a high dynamic range image, comprising receiving the high dynamic range image, calculating a first set of tone mapping parameters as a function of the high dynamic range image, sub-sampling the first set of tone mapping parameters at a first resolution to create a first sub-sampled parameter set, creating a first tone-mapped image by processing the high dynamic range image as a function of the first sub-sampled parameter set, and displaying the first tone-mapped image. A method of composting a plurality of versions of an image to create the high dynamic range image is also disclosed such that the compositing may be modified as a function of received user input.

Claims (35)

1. A computer-implemented method, comprising the steps of:

determining at least one first matrix from a plurality of matrix entries, wherein first matrix entries of the plurality of matrix entries are determined as a function of at least a tone mapping parameter of a respective corresponding area within a high dynamic range input image;

determining at least one second matrix from a plurality of second matrix entries, wherein each second matrix entry is determined as a function of the high dynamic range input image and of user input data;

determining a third matrix as a function of the first matrix and the second matrix; and

generating a tone-mapped image as a function of the high dynamic range input image and the third matrix.

2. The method of claim 1 , wherein tone mapping parameter comprises at least one of brightness, contrast, haloing strength, detail retention, color temperature, brilliance, and sharpness.

3. The computer-implemented method of claim 2 , wherein the plurality of matrix entries further include second matrix entries, wherein the second matrix entries are determined as a function of at least one other image parameter of a respective corresponding area with the high dynamic range input image.

4. The computer-implemented method of claim 3 , wherein the at least one other image parameter comprises at least one of noise reduction, color change, and unsharp mask sharpening.

5. The computer-implemented method of claim 2 , wherein the user input data includes user indication of a first area of the image for adjustment in generating the tone-mapped image.

6. The computer-implemented method of claim 5 , wherein the user input data includes coordinates for pixels of the first area of the image.

7. The computer-implemented method of claim 5 , wherein a second area outside of the first area of the image is unadjusted in generating the tone-mapped image.

8. A non-transitory computer-readable medium storing instructions, when executed by one or more processors of a capture device, cause the one or more processors to:

determine at least one first matrix from a plurality of matrix entries, wherein first matrix entries of the plurality of matrix entries is determined as a function of at least a tone mapping parameter of a respective corresponding area within a high dynamic range input image;

determine at least one second matrix from a plurality of second matrix entries, wherein each second matrix entry is determined as a function of the high dynamic range input image and of user input data;

determine a third matrix as a function of the first matrix and the second matrix;

generate a tone-mapped image as a function of the high dynamic range input image and the third matrix; and

display the tone-mapped image on a display screen.

9. The computer-readable medium of claim 8 , wherein tone mapping parameter comprises at least one of brightness, contrast, haloing strength, detail retention, color temperature, brilliance, and sharpness.

10. The computer-readable medium of claim 8 , wherein the plurality of matrix entries further include second matrix entries, wherein the second matrix entries are determined as a function of at least one other image parameter of a respective corresponding area with the high dynamic range input image.

11. The computer-readable medium of 10 , wherein the at least one other image parameter comprises at least one of noise reduction, color change, and unsharp mask sharpening.

12. The computer-readable medium of claim 8 , wherein the user input data includes user indication of a first area of the image for adjustment in generating the tone-mapped image.

13. The computer-readable medium of claim 12 , wherein the user input data includes coordinates for pixels of the first area of the image.

14. The computer-readable medium of claim 12 , wherein a second area outside of the first area of the image is unadjusted in generating the tone-mapped image.

15. A system to generate a high dynamic range image, the system comprising:

one or more processors; and

a memory coupled to the one or more processors, the memory configured to store instructions that upon execution by the one or more processors cause the one or more processors to:

determine at least one first matrix from a plurality of matrix entries, wherein first matrix entries of the plurality of matrix entries is determined as a function of at least a tone mapping parameter of a respective corresponding area within a high dynamic range input image;

determine at least one second matrix from a plurality of second matrix entries, wherein each second matrix entry is determined as a function of the high dynamic range input image and of user input data;

determine a third matrix as a function of the first matrix and the second matrix; and

generate a tone-mapped image as a function of the high dynamic range input image and the third matrix.

16. The system of claim 15 , wherein tone mapping parameter comprises at least one of brightness, contrast, haloing strength, detail retention, color temperature, brilliance, and sharpness.

17. The system of claim 15 , wherein the plurality of matrix entries further include second matrix entries, wherein the second matrix entries are determined as a function of at least one other image parameter of a respective corresponding area with the high dynamic range input image.

18. The system of claim 17 , wherein the at least one other image parameter comprises at least one of noise reduction, color change, and unsharp mask sharpening.

19. The system of claim 15 , wherein the user input data includes user indication of a first area of the image for adjustment in generating the tone-mapped image.

20. The system of claim 19 , wherein the user input data includes coordinates for pixels of the first area of the image.

Assignments (3)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2017
From: KOKEMOHR, NILS
To: NIK SOFTWARE, INC.
Reel/Frame 042670/0702 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2017
From: NIK SOFTWARE, INC.
To: GOOGLE INC.
Reel/Frame 042670/0705 →
Continuity (7)
Continuation 15051731 · Feb 24, 2016
Continuation 14270313 · May 5, 2014
Continuation 13739754 · Jan 11, 2013
Continuation 13340314 · Dec 29, 2011
Continuation 11944380 · Nov 21, 2007
Provisional Application 60867080 · Nov 22, 2006
Related Publication 20170270648A1 · Sep 21, 2017