IP Library Granted Patent US 12,530,746
Granted Patent B2
US 12,530,746 · App. 17/841,859 · Granted Jan 20, 2026

Image processing noise reduction

Inventors: Willie C. Kiser (Albuquerque, NM); Michael D. Tocci (Albuquerque, NM); Nora Tocci (Albuquerque, NM)
Assignee: CONTRAST, INC.
G06T5/70G06T5/10G06T5/20G06T5/90H04N25/683G06T2207/20052G06T2207/20182
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,530,746
App. No.
17/841,859
Granted
Jan 20, 2026
Kind
B2
Abstract

Noise reduction in images is provided by performing a noise reduction step on blocks of pixels within a video-processing pipeline. The noise reduction step consists of applying a discrete cosine transform (DCT) to the block of pixels, quantizing the resulting DCT coefficients, and performing an inverse of the DCT to the quantized coefficients. The output of that noise reduction step is a block of image pixels similar to the input pixels, but with significantly less image noise. Because the noise reduction step can be performed quickly on small blocks of pixels, the noise reduction can be performed in real-time in a video processing pipeline.

Claims (20)

1 . A method for removing noise from a real-time stream of digital image data, the method comprising:

receiving data from at least one image sensor of a plurality of image sensors;

converting the data into a YCbCr color space;

applying a noise reduction pipeline to remove noise from the data, wherein the pipeline includes:

downsampling at least a portion of a Chroma component of the data in order to remove a first portion of the noise,

frequency domain processing the data to remove a second portion of the noise, wherein the processing includes implementing a noise reduction step that consists of:

performing discrete cosine transform (DCT) on the data to obtain DCT values,

quantizing the DCT values, and

conducting an inverse DCT to yield noise-reduced image data; and

providing the data for displaying, broadcasting, or storing as a digital image.

2 . The method of claim 1 , further comprising exposing at least a portion of said data to a low pass filter.

3 . The method of claim 2 , wherein the low-pass filter is inserted into the noise reduction pipeline at any point to filter image data represented in the frequency domain, the low-pass filter configured to remove a third portion of the noise.

4 . The method of claim 3 , wherein the low-pass filter is selected from a plurality of low-pass filters and the selected low-pass filter includes filtering parameters configured to filter noise that is specific to a particular digital image acquisition device and environmental conditions at the time of image acquisition.

5 . The method of claim 1 , wherein a luminance component is also downsampled.

6 . The method of claim 1 , further comprising processing said noise-reduced image data through a video processing pipeline.

7 . The method of claim 6 , wherein the video processing pipeline is a high dynamic range pipeline.

8 . The method of claim 6 , wherein the video processing pipeline comprises streaming pixel values from each of the plurality of image sensors in a frame independent manner through a kernel operation that identifies saturated pixel values and a merge module to merge the pixel values to produce a high-dynamic range (HDR) image.

9 . The method of claim 8 , wherein each sensor of the plurality of image sensors includes a Bayer filter.

10 . The method of claim 8 , wherein the plurality of image sensors are each positioned with respect to at least one beamsplitter and a lens of a video camera such that incoming light is split onto the plurality of image sensors so that each image sensor senses an image that is identical but for light level.

11 . The method of claim 1 , further comprising exposing said noise-reduced image data to a low-pass filter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2022
From: KISER, WILLIE C.; TOCCI, MICHAEL D.; TOCCI, NORA
To: CONTRAST, INC.
Reel/Frame 061088/0272 →
Continuity (3)
Continuation 16539595 · Aug 13, 2019
Provisional Application 62718595 · Aug 14, 2018
Related Publication 20220309622A1 · Sep 29, 2022
References Cited (45)
US 5881180A · Chang et al. · 1999 [cited by applicant]
US 9800856B2 · Venkataraman et al. · 2017 [cited by applicant]
US 10038855B2 · Cote et al. · 2018 [cited by applicant]
US 20030138154A1 · Suino · 2003 [cited by applicant]
US 20040202376A1 · Schwartz et al. · 2004 [cited by applicant]
US 20040228406A1 · Song · 2004 [cited by examiner]
US 20070133889A1 · Horie et al. · 2007 [cited by applicant]
US 20080037883A1 · Tsutsumi et al. · 2008 [cited by applicant]
US 20080239155A1 · Wong et al. · 2008 [cited by applicant]
US 20080304562A1 · Chang et al. · 2008 [cited by applicant]
US 20100013963A1 · Jannard · 2010 [cited by examiner]
US 20100098333A1 · Aoyagi · 2010 [cited by applicant]
US 20100149546A1 · Kobayashi et al. · 2010 [cited by applicant]
US 20100266008A1 · Reznik · 2010 [cited by applicant]
US 20130064448A1 · Tomaselli et al. · 2013 [cited by applicant]
US 20130083855A1 · Kottke · 2013 [cited by examiner]
US 20130128957A1 · Bankoski et al. · 2013 [cited by applicant]
US 20150215595A1 · Yoshida · 2015 [cited by applicant]
US 20150237375A1 · Okamoto · 2015 [cited by examiner]
US 20160205341A1 · Hollander et al. · 2016 [cited by applicant]
US 20160269733A1 · Tourapis · 2016 [cited by examiner]
US 20160360213A1 · Lee et al. · 2016 [cited by applicant]
US 20170084006A1 · Stewart · 2017 [cited by applicant]
US 20170134731A1 · Tourapis · 2017 [cited by examiner]
US 20170238029A1 · Kiser et al. · 2017 [cited by applicant]
US 20180054566A1 · Yaguchi · 2018 [cited by applicant]
US 20180063537A1 · Sasai et al. · 2018 [cited by applicant]
KR 100695003B1 · 2007 [cited by applicant]
KR 20130085264A · 2013 [cited by applicant]
Okuda et al, Effective color space representation for wavelet based compression of HDR images, 2007, International Conference on Image Analysis and Processing, pp. 1-6. (Year: 2007). [cited by examiner]
Kronander et al, Unified HDR reconstruction from raw CFA data, 2013, IEEE International Conference on Computational Photography, pp. 1-10. (Year: 2013). [cited by examiner]
Boncelet, Chapter 7—Image Noise Models, 2009, Essential Guide to Image Processing, Second Edition, pp. 143-167. (Year: 2009). [cited by examiner]
Jain et al, Survey of edge-preserving image denoising methods, 2016, Inf Syst Front, 18: 159-170. (Year: 2016). [cited by examiner]
Dugad et al, Fast scheme for Downsampling and Upsampling in the DCT Domain, 1999, International Conference on Image Processing, pp. 1-6. (Year: 1999). [cited by examiner]
Abd-Elhafiez et al, Color Image Compression Algorithm Based on the DCT Blocks, 2012, International J. of Comp. Sci. Issues (9) 4: 3. pp 1-6. (Year: 2012). [cited by examiner]
Gofaizen et al, Adaptive Decomposition of TV Images, 2017, International Conference on Information and Telecommunication Technologies and Radio Electronics, pp. 1-4. (Year: 2017). [cited by examiner]
Jack, 2005, Color spaces, Chapter 3 in Video Demystified: a Handbook for the Digital Engineer, 4Ed, Newnes (20 pages). [cited by applicant]
Kresch, 1999, Fast DCT domain filtering using the DCT and the DST, IEEE Trans Imag Proc (29 pages). [cited by applicant]
Nosratinia, 2002, Enhancement of JPEG-compressed images by re-application of JPEG, Journal of VLSI Signal Processing, (20 pages). [cited by applicant]
Roberts, 2017, Lossy Data Compression: JPEG, Stanford faculty page (5 pages) Retrieved from the Internet on Feb. 3, 2017, from <https://cs.stanford.edu/people/eroberts/courses/soco/projects/data-compression/lossy/jpeg/d… [cited by applicant]
Sedigh, 1998, Evaluation of filtering mechanisms for MPEG video communications, IEES Symp Rel Dist Sys (6 pages). [cited by applicant]
Tourapis, 2015, Deblocking in HVEC: some observations from the HDR/WCG CfE, JCT Vid Cod, 21st Meeting: Warsaw, PL, (6 pages). [cited by applicant]
Wei, 2011, Analysis of JPEG encoder for image compression, 2011 Int Conf Mult Tech 205-208. [cited by applicant]
Wige, 2010, Analysis of in-loop denoising in lossy transform coding, PCS2010 82-85. [cited by applicant]
Yeadon, 1996, QoS filteres: Addressing the heterogeneity gap, Int Dist Mult Sys Serv 227-243. [cited by applicant]