IP Library Granted Patent US 9,530,194
Granted Patent B2
US 9,530,194 · App. 14/168,155 · Granted Dec 27, 2016

Method for processing highlights and saturated regions in a digital image

Inventors: Rastislav Lukac (Santa Clara, CA); Ken Doyle (Santa Clara, CA)
Assignee: Foveon, Inc.
G06T5/008G06K9/40G06T5/001H04N9/646H04N9/68G06T2207/10024G06T2207/20172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,530,194
App. No.
14/168,155
Granted
Dec 27, 2016
Kind
B2
Abstract

A method for performing highlight restoration on a digital image includes comparing the pixels in the image with a saturation level value to identify saturated pixels. A saturation map of saturated pixels is generated. Each selected saturated pixel is identified as a restorable pixel only if at least one color channel of the pixel is unsaturated. For each restorable pixel, a group of the closest unsaturated pixels above, below, to the left, and to the right of the select saturated pixel is identified. A replacement pixel value is generated for each saturated color channel of the restorable pixel, using a combination of the pixel values of the unsaturated color channels of the restorable pixel and the pixel values of the corresponding color channels of the nearby unsaturated pixels.

Claims (17)

1. A method for restoring pixels in a digital image having saturated values in a color channel, comprising:

creating a saturation map of the image by comparing the pixel values with a predetermined threshold;

analyzing the image to select pixels having unsaturated values in the color channel;

creating only a single table of correction factors for the entire image by selecting pixels from the entire image having an unsaturated value in a selected color channel and for each selected pixel, calculating at least two values as a function of at least one color channel, a first value being an index into the single table of correction factors, and a second value being a correction factor stored in the single table of correction factors at a location pointed to by the index, the number of entries in the single table of correction factors being set as smaller than or equal to the number of bits used to represent each color channel;

for each pixel in the image having unsaturated values in the color channel, calculating an index pointer to the single table of correction factors, and applying a correction factor stored in the single table of correction factors at a location pointed to by the index pointer to the saturated value of the color channel to obtain a corrected value; and

replacing the saturated value in the color channel with the corrected value.

2. The method of claim 1 wherein creating the single table of correction factors comprises creating more than one table of correction factors.

3. The method of claim 1 further comprising selecting only pixels having a preselected characteristic for inclusion in the single table of correction factors.

4. The method of claim 3 wherein the preselected characteristic is pixels that have a luminance value larger than a predetermined threshold and do not have any of their color channels saturated.

5. The method of claim 1 wherein the number of entries in the single table of correction factors is smaller than or equal to the number of bits used to represent each color channel.

6. The method of claim 1 wherein the index into the single table of correction factors is a function of at least one of the color channels not being restored.

7. The method of claim 1 wherein the index into the single table of correction factors is a function of the color channel being restored.

8. The method of claim 1 wherein the index into the single table of correction factors is a function of the color channel being restored and at least one other color channel.

9. The method of claim 1 wherein correction factors to be stored in the single table of correction factors are calculated as a scaled value of the color channel being corrected.

10. The method of claim 1 wherein correction factors to be stored in the single table of correction factors are calculated as a ratio of the color channel to be corrected to one of the other color channels in the pixel.

11. The method of claim 1 wherein correction factors to be stored in the single table of correction factors are calculated as a difference between the color channel to be corrected and one of the other color channels in the pixel.

12. The method of claim 1 wherein correction factors to be stored in the single table of correction factors are calculated as a function of the color channel to be corrected and all other color channels in the pixel.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2024
From: FOVEON, INC.
To: SIGMA CORPORATION
Reel/Frame 069483/0391 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2014
From: LUKAC, RASTISLAV; DOYLE, KEN
To: FOVEON, INC.
Reel/Frame 033630/0245 →
Continuity (4)
Division 13473313 · May 16, 2012
Provisional Application 61487887 · May 19, 2011
Provisional Application 61534556 · Sep 14, 2011
Related Publication 20140321742A1 · Oct 30, 2014