IP Library Granted Patent US 11,330,153
Granted Patent B2
US 11,330,153 · App. 16/442,137 · Granted May 10, 2022

Noise estimation using user-configurable information

Inventors: Gang Hua (Katy, TX); Mihir Narendra Mody (Bangalore, IN); Rajasekhar Reddy Allu (Plano, TX); Niraj Nandan (Plano, TX); Shashank Dabral (Allen, TX)
Assignee: Texas Instmments Incorporated
H04N5/2173H04N5/357H04N5/3572H04N9/0451G06T2207/20064
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,330,153
App. No.
16/442,137
Granted
May 10, 2022
Kind
B2
Abstract

In some examples, a method comprises receiving pixel data from an image capture device having a color filter, wherein the pixel data represents a portion of an image. The method further includes performing wavelet decomposition on the pixel data to produce decomposed pixel data and determining a local intensity of the pixel data. The method also includes determining a noise threshold value based on the local intensity and a noise intensity function that is based on the color filter; determining a noise value for the pixel data based on the decomposed pixel data and the noise threshold value; and correcting the pixel data based on the noise value to produce an output image.

Claims (57)

1. A method comprising:

receiving pixel data from an image capture device having a color filter, wherein the pixel data represents a portion of an image;

performing wavelet decomposition on the pixel data to produce decomposed pixel data;

receiving correlation information for the color filter that includes a set of averaging weights,

determining a local intensity of the pixel data, wherein the determining of the local intensity applies the set of averaging weights of the correlation information to the pixel data to determine the local intensity;

determining a noise threshold value based on the local intensity and a noise intensity function that is based on the color filter;

determining a noise value for the pixel data based on the decomposed pixel data and the noise threshold value, wherein the determining of the noise value includes:

averaging the decomposed pixel data using the set of averaging weights to determine an average of the decomposed pixel data; and

dividing the average of the decomposed pixel data by the noise threshold value; and

correcting the pixel data based on the noise value to produce an output image.

2. The method of claim 1 , wherein the noise intensity function is a piecewise linear function.

3. The method of claim 1 , wherein the noise intensity function is user-defined and is based on a 2×2 pattern of the color filter.

4. The method of claim 1 , wherein:

the pixel data is merged pixel data; and

the method further comprises:

receiving sets of pixel data associated with a plurality of frames; and

merging the sets of pixel data to produce the merged pixel data.

5. The method of claim 4 , wherein the output image is a high dynamic range image.

6. A method comprising:

receiving pixel data from an image capture device having a color filter, wherein the pixel data represents a portion of an image;

performing wavelet decomposition on the pixel data to produce decomposed pixel data;

determining a local intensity of the pixel data;

determining a gain value based on a location, within the image, of the portion of the image associated with the pixel data;

determining a noise threshold value based on the local intensity and a noise intensity function that is based on the color filter, wherein the determining of the noise threshold value includes applying an inverse of the gain value to the local intensity and applying the gain value to the noise threshold value;

thereafter, determining a noise value for the pixel data based on the decomposed pixel data and the noise threshold value; and

correcting the pixel data based on the noise value to produce an output image.

7. The method of claim 6 further comprising determining the gain value and the inverse of the gain value by a lens shading correction compensation logic present in a noise filter.

8. The method of claim 6 , wherein the determining of the noise threshold value further includes multiplying the noise threshold value by a user-programmable scaling factor after the applying of the gain value.

9. The method of claim 6 , wherein:

the pixel data is merged pixel data;

the method further comprises:

receiving sets of pixel data associated with a plurality of frames; and

merging the sets of pixel data to produce the merged pixel data; and

the output image is a high dynamic range image.

10. A method comprising:

receiving sets of pixel data from a plurality of images, wherein the plurality of images is associated with a color filter;

merging the sets of pixel data to provide merged pixel data;

performing decomposition on the merged pixel data to produce decomposed pixel data;

determining a threshold based on cross-color correlation information associated with the color filter;

applying the threshold to the decomposed pixel data to produce thresholded pixel data by:

performing a weighted average of the decomposed pixel data based on the cross-color correlation information to determine an average of the decomposed pixel data; and

dividing the average of the decomposed pixel data by the threshold to determine the thresholded pixel data; and

performing reconstruction on the thresholded pixel data.

11. The method of claim 10 , wherein the cross-color correlation information includes a respective weight for each color of the color filter.

12. The method of claim 10 further comprising determining a set of local pixel intensities for the merged pixel data for colors of the color filter, wherein the determining of the threshold includes summing and averaging the set of local pixel intensities based on the cross-color correlation information to determine an average pixel intensity.

13. The method of claim 12 , wherein:

the determining of the threshold includes applying a lens shading correction compensation gain to the average pixel intensity to produce a gain-corrected pixel intensity; and

the threshold is based on the gain-corrected pixel intensity.

14. The method of claim 13 , wherein the lens shading correction compensation gain is based on a distance from an optical center of an image capture device.

15. The method of claim 13 , wherein the applying of the lens shading correction compensation gain to the average pixel intensity includes multiplying the average pixel intensity by an inverse of the lens shading correction compensation gain to produce the gain-corrected pixel intensity.

16. The method of claim 13 , wherein:

the determining of the threshold includes applying a noise intensity function to the gain-corrected pixel intensity to produce an intermediate noise threshold; and

the noise intensity function is a piecewise linear function.

17. The method of claim 16 , wherein the determining of the threshold includes applying the lens shading correction compensation gain to the intermediate noise threshold.

18. The method of claim 10 further comprising generating a high dynamic range image based on the reconstructed thresholded pixel data.

19. The method of claim 10 wherein the cross-color correlation information is associated with a 2×2 pattern of the color filter.

20. The method of claim 10 wherein the color filter includes a plurality of filter colors from a group consisting of: red, green, blue, clear, and infrared.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2019
From: HUA, GANG; MODY, MIHIR NARENDRA; ALLU, RAJASEKHAR REDDY; NANDAN, NIRAJ; DABRAL, SHASHANK
To: TEXAS INSTRUMENTS INCORPORATED
Reel/Frame 049484/0992 →
Continuity (1)
Related Publication 20200396356A1 · Dec 17, 2020
Cited By (1)
US 12,536,615