IP Library › Granted Patent US 12,387,298
Granted Patent B2
US 12,387,298 · App. 18/337,240 · Granted Aug 12, 2025

Noise reduction and feature enhancement for a thermal imaging camera

Inventors: Daniel Bode (Santa Barbara, CA); Brian Nehring (Santa Barbara, CA); Sofia Hamrin (Santa Barbara, CA); William J. Parrish (Santa Barbara, CA)
Assignee: Seek Thermal, Inc.
G06T5/70G01J5/48G06T5/20G06T5/40G06T7/11G06T7/13G06V10/56G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,387,298
App. No.
18/337,240
Granted
Aug 12, 2025
Kind
B2
Abstract

Thermal cameras, particularly less elaborate inexpensive designs, may deliver high temperature resolution at the expense of less clear displayed images. For many low visibility uses, such as firefighting, it may be advantageous to sacrifice some temperature detail for clarity and object recognition. Without sacrificing the actual detailed temperature information available in a captured scene, it may be beneficial to apply filters in series to raw image data that reduce visible noise and build back in feature contrast for the purposes of providing a user a displayed image that permits ease of object recognition, while still providing the raw data to a thermography module to maintain high resolution of temperature information if desired. In addition, more efficient and useful edge highlighting techniques are disclosed. For very low contrast scenes, such as smoky rooms and the like, other specific filters and equalization methods may be applied.

Claims (29)

1. A column noise correction filter method for a digital image frame of input pixel values arranged in a series of rows and columns, the method comprising, for each column of the image frame:

dividing pixels of the column into blocks of n pixels;

creating a first measure of central tendency for each block;

grouping each block with m adjacent blocks from adjacent columns;

creating a second measure of central tendency of the first central tendency values for each m block grouping; and

subtracting the second measure of central tendency from the first measure of central tendency to create a column noise correction value which is subtracted from each corresponding input pixel to create a column noise filtered image frame.

2. The column noise correction filter method of claim 1 wherein the row noise correction values is further interpolated between adjacent rows before being applied.

3. The column noise correction filter method of claim 1 wherein the first measure is an average, and the second measure is a median.

4. The column noise correction filter method of claim 1 wherein the blocks are chosen to overlap.

5. The column noise correction filter method of claim 1 wherein n=one of 8 or 16, and m=5.

6. The column noise correction filter method of claim 1 , further comprising determining a contrast of the scene based on a width of a histogram of the image intensity values of at least one of all or a subset of pixels in an image frame of the scene and applying column filter steps to columns if the contrast is below a predetermined value.

7. A row noise correction filter method for a digital image frame of input pixel values, the method comprising, for each row of the image frame:

creating a first measure of central tendency to the row of all the pixels in the row;

dividing the row into blocks of k pixels;

creating a second measure of central tendency of the pixels in each block;

subtracting, for each block, the second measure of central tendency from the first measure of central tendency to create an intermediate correction factor;

creating a third measure based on the intermediate correction factors;

creating a row noise correction factor comprising a difference between the intermediate product and the third measure; and

subtracting the row noise correction value from each corresponding input pixels to create a row noise filtered image.

8. The row noise correction filter method of claim 7 wherein the first measure is mean, the second measure is median, and the third measure is mean.

9. The row noise correction filter method of claim 7 wherein k=7.

10. The row noise correction filter method of claim 7 , further comprising determining a contrast of the scene based on a width of a histogram of the image intensity values of at least one of all or a subset of pixels in an image frame of the scene and applying row filter steps to columns if the contrast is below a predetermined value.

11. A method for highlighting edge features in a thermal image in a thermal camera including a thermal imaging sensor, and image processing capability for implementing a signal processing chain of processor executed functions, the method comprising;

receiving image frame data at a colorization element and an edge highlighting filter element in the signal processing chain, the image data comprising frames of pixel values;

assigning colors to each pixel corresponding to a predetermined relationship between color and at least one of pixel intensity or scene temperature of the region of the imaged scene corresponding to a given pixel, wherein the colors are assigned from a primary color look up table (LUT);

applying an edge filter to the frame pixels to generate a map of edge strength values of each pixel;

converting the edge strength values to a histogram of discrete edge strength bins comprising a number of edge strength bins corresponding to pixel edge strength above a predetermined value divided into a predetermined number of bins;

creating a series of color LUTs each color LUT in the series comprising a shift in brightness from the primary color LUT, wherein the number of color LUTs corresponds to the predetermined number of bins, and the shift in brightness between each color LUT corresponds to a total desired shift for maximum edge strength divided by the predetermined number of bins; and

replacing the colors assigned to individual pixels from the primary color LUT that have a pixel edge strength above the predetermined value, with colors from the shifted LUT corresponding to the individual pixel's edge strength bin.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2025
From: BODE, DANIEL
To: SEEK THERMAL, INC.
Reel/Frame 071594/0351 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2025
From: NEHRING, BRIAN
To: SEEK THERMAL, INC.
Reel/Frame 071594/0404 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2025
From: HAMRIN, SOFIA
To: SEEK THERMAL, INC.
Reel/Frame 071594/0444 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2025
From: PARRISH, WILLIAM J.
To: SEEK THERMAL, INC.
Reel/Frame 071594/0497 →
Continuity (4)
Provisional Application 63373984 · Aug 30, 2022
Provisional Application 63369747 · Jul 28, 2022
Provisional Application 63366687 · Jun 20, 2022
Related Publication 20230410263A1 · Dec 21, 2023
References Cited (41)
US 6055340A · Nagao · 2000 [cited by applicant]
US 6628842B1 · Nagao · 2003 [cited by applicant]
US 6849849B1 · Warner et al. · 2005 [cited by applicant]
US 8340414B2 · Hogasten et al. · 2012 [cited by applicant]
US 8428385B2 · Whiteside et al. · 2013 [cited by applicant]
US 8515196B1 · Högasten · 2013 [cited by applicant]
US 8836793B1 · Kriesel et al. · 2014 [cited by applicant]
US 9215384B2 · Högasten et al. · 2015 [cited by applicant]
US 9471970B2 · Strandmar · 2016 [cited by applicant]
US 9549130B2 · Lee · 2017 [cited by examiner]
US 9595087B2 · Olsson · 2017 [cited by applicant]
US 9875556B2 · McNally · 2018 [cited by applicant]
US 9924116B2 · Chahine · 2018 [cited by examiner]
US 9947086B2 · Lee · 2018 [cited by examiner]
US 10249032B2 · Strandemar · 2019 [cited by applicant]
US 10255662B2 · Olsson · 2019 [cited by applicant]
US 10298859B2 · Frost et al. · 2019 [cited by applicant]
US 10542193B1 · Marteney · 2020 [cited by examiner]
US 11276152B2 · Wolfe · 2022 [cited by examiner]
US 11375166B2 · Paul · 2022 [cited by examiner]
US 20100111412A1 · Hogasten · 2010 [cited by examiner]
US 20140355904A1 · Olsson · 2014 [cited by examiner]
US 20150124102A1 · Frost · 2015 [cited by examiner]
US 20160070125A1 · Reich · 2016 [cited by examiner]
US 20160156858A1 · Lee · 2016 [cited by examiner]
US 20160198102A1 · Chahine · 2016 [cited by examiner]
US 20160323525A1 · Lee · 2016 [cited by examiner]
US 20170004609A1 · Strandemar · 2017 [cited by examiner]
US 20170053380A1 · McNally · 2017 [cited by examiner]
US 20170186139A1 · Olsson · 2017 [cited by examiner]
US 20180348143A1 · Ahlstrom · 2018 [cited by examiner]
US 20200099825A1 · Marteney · 2020 [cited by examiner]
US 20200380651A1 · Wolfe · 2020 [cited by examiner]
US 20220094896A1 · Paul et al. · 2022 [cited by applicant]
CN 110570374A · 2019 [cited by applicant]
WO WO2014107120A1 · 2014 [cited by applicant]
WO WO2016022374A1 · 2016 [cited by applicant]
WO WO2019028067A1 · 2019 [cited by applicant]
International Search Report and Written Opinion issued in PCT Application No. PCT/US2023/068673, dated Nov. 28, 2023, in 33 pages. [cited by applicant]
Guillon S. et al.: “Adaptive nonlinear filters for 2D and 3D image enhancement”, Signal Processing, Elsevier, Amsterdam, NL, vol. 67, No. 3, Jun. 30, 1998 (Jun. 30, 1998), pp. 237-254, XP004129654, ISSN: 0165-1684, DOI:… [cited by applicant]
Paris Sylvain et al.: “Bilateral Filtering: Theory and Applications”, Foundations and Trends in Computer Graphics and Vision, vol. 4, No. 1, Jan. 1, 2008 (Jan. 1, 2008), pp. 1-75, XP055822578, US ISSN: 1572-2740, DOI: 1… [cited by applicant]