Granted Patent B2

US 12,518,348 · App. 18/070,337 · Granted Jan 6, 2026

Inventor: Katrin Strandemar (Rimbo, SE)

Assignee: FLIR Systems AB

G06T5/50G06T5/73H04N23/20G06T2207/10024G06T2207/10048G06T2207/20221

Abstract

Claims (46)

1 . A system comprising:

a first imaging device configured to capture an infrared (IR) image of a scene;

a second imaging device configured to capture a first visual image of at least a portion of the scene, wherein the first visual image comprises a luminance component and color components; and

a logic device configured to:

low-pass filter the IR image to obtain a low-pass filtered IR image;

determine high spatial frequency content associated with the first visual image; and

generate a combined image based on a luminance component of the low-pass filtered IR image, color components of the low-pass filtered IR image, and a luminance component of only the high spatial frequency content associated with the first visual image, wherein color components of the combined image are based only on the color components of the IR image, wherein each color component of the combined image is based only on a corresponding color component of the low-pass filtered IR image.

2 . The system of claim 1 , wherein the logic device is configured to generate a luminance component of the combined image based only on the luminance component of the low-pass filtered IR image, the luminance component of the high spatial frequency content, and a factor.

3 . The system of claim 2 , wherein the logic device is configured to generate the luminance component of the combined image by:

generating a scaled version of the luminance component of the high spatial frequency content based on the factor and the luminance component of the high spatial frequency content; and

adding the luminance component of the low-pass filtered IR image and the scaled version of the luminance component of the high spatial frequency content to obtain the luminance component of the combined image.

4 . The system of claim 1 , wherein differences in temperature associated with different colors are preserved between the low-pass filtered IR image and the combined image.

5 . The system of claim 1 , wherein the logic device is configured to add the high spatial frequency content only to a subset of pixels of the low-pass filtered IR image to generate the combined image such that the combined image comprises the low-pass filtered IR image with the subset of pixels altered to include the high spatial frequency content but remaining pixels of the low-pass filtered IR image are preserved.

6 . The system of claim 1 , wherein the logic device is configured to determine the high spatial frequency content associated with the first visual image at least by high pass filtering the first visual image, wherein the color components of the low-pass filtered IR image are associated with a YCbCr color space.

7 . The system of claim 1 , wherein the second imaging device is further configured to capture a second visual image of at least the portion of the scene, and wherein the logic device is configured to determine the high spatial frequency content associated with the first visual image based on a difference image generated from the first visual image and the second visual image.

8 . The system of claim 1 , wherein:

the logic device is further configured to:

up-sample the IR image to obtain an up-sampled IR image; and

low pass filter the up-sampled IR image to obtain the low-pass filtered IR image.

9 . The system of claim 1 , wherein the logic device is further configured to:

align the IR image with the first visual image at least by compensating for a parallax and/or pointing errors due to a difference between a respective optical axis of the first imaging device and the second imaging device; and

provide the combined image for display by a display unit.

10 . The system of claim 1 , wherein the color components of the IR image are associated with a color space, and wherein the color space is one of a YCbCr color space, an RGB color space, an HSV color space, a CIE 1931 color space, a CIE 1931 XYZ color space, or a CIELab color space, wherein the first imaging device is further configured to detect electromagnetic radiation associated with a wavelength between approximately 0.7 μm and 20 μm, and wherein the first imaging device is configured to capture the IR image based on the detected electromagnetic radiation.

11 . A system comprising:

a first imaging device configured to capture an infrared (IR) image of a scene;

a second imaging device configured to capture a first visual image of at least a portion of the scene, wherein the first visual image comprises a luminance component and color components; and

a logic device configured to:

determine high spatial frequency content associated with the first visual image;

generate a combined image based on the IR image and a luminance component of the high spatial frequency content, wherein color components of the combined image are based only on color components of the IR image; and

add high frequency noise to the combined image.

12 . A method comprising:

receiving an infrared (IR) image of a scene captured using a first imaging device;

up-sampling the IR image to obtain an up-sampled IR image;

low-pass filtering the up-sampled IR image to obtain a low-pass filtered IR image;

receiving a first visual image of at least a portion of the scene captured using a second imaging device;

determining high spatial frequency content associated with the first visual image; and

generating a combined image based on a luminance component of the low-pass filtered IR image, color components of the low-pass filtered IR image, and a luminance component of only the high spatial frequency content associated with the first visual image, wherein color components of the combined image are based only on the color components of the low-pass filtered IR image.

13 . The method of claim 12 , wherein the generating comprises generating a luminance component of the combined image based only on the luminance component of the low-pass filtered IR image, the luminance component of the high spatial frequency content, and a factor.

14 . The method of claim 12 , wherein differences in temperature associated with different colors are preserved between the low-pass filtered IR image and the combined image.

15 . The method of claim 12 , further comprising adding the high spatial frequency content only to a subset of pixels of the low-pass filtered IR image to generate the combined image such that the combined image comprises the low-pass filtered IR image with the subset of pixels altered to include the high spatial frequency content but remaining pixels of the low-pass filtered IR image are preserved.

16 . The method of claim 12 , wherein each color component of the combined image is based only on a corresponding color component of the low-pass filtered IR image.

17 . The method of claim 12 , further comprising:

aligning the IR image with the first visual image at least by compensating for a parallax and/or pointing errors due to a difference between a respective optical axis of the first imaging device and the second imaging device.

18 . The method of claim 12 , further comprising:

adding high frequency noise to the combined image to obtain a processed combined image; and

providing the processed combined image for display by a display unit.

Assignments (1)

Continuity (10)

References Cited (75)