IP Library › Granted Patent US 11,549,849
Granted Patent B2
US 11,549,849 · App. 16/948,358 · Granted Jan 10, 2023

Image processing arrangement providing a composite image with emphasized spatial portions

Inventors: Joel R. Johnson (Lincoln, NE); Jaakko Havola (Espoo, FI)
Assignee: SAVOX COMMUNICATIONS OY AB (LTD)
G01J5/0265G01J5/04H04N5/33G01J5/485G01J2005/0077
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,549,849
App. No.
16/948,358
Granted
Jan 10, 2023
Kind
B2
Abstract

According to an example, a technique for image processing is provided, the technique comprising: obtaining a first image and a second image that at least partially illustrate the same real-world scene, wherein the first image comprises a visible light image and the second image comprises a thermal image; identifying one or more spatial portions of the second image that represent a predefined temperature range; identifying one or more spatial portions of the first image that illustrate the same portions of the real-world scene as illustrated in the identified one or more spatial portions of the second image; and deriving, based on the first image, a composite image wherein the identified one or more spatial portions of the first image are emphasized.

Claims (58)

1. An image processing apparatus comprising at least one processor and at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

obtain a first image and a second image that at least partially illustrate the same real-world scene, wherein the first image comprises a visible light image and the second image comprises a thermal image;

identify a respective set of one or more spatial portions of the second image that represent a respective one of a plurality of different predefined temperature ranges;

identify, for each set of one or more spatial portions of the second image, a respective set of one or more spatial portions of the first image that illustrate the same portions of the real-world scene as illustrated in the respective set of one or more spatial portions of the second image; and

derive, based on the first image, a composite image, wherein the sets of one or more spatial portions of the first image are emphasized such that a different emphasis is applied for each set of one or more spatial portions of the first image.

2. The image processing apparatus according to claim 1 , wherein

said predefined temperature range is defined as a predefined range of pixel values, and

identifying the one or more spatial portions of the second image comprises identifying pixel positions of the second image having pixel values that fall within said predefined range of pixel values.

3. The image processing apparatus according to claim 1 , wherein said predefined temperature range represents one of the following:

temperatures between 30 to 50 degrees Celsius,

temperatures between 15 to 44 degrees Celsius.

4. The image processing apparatus according to claim 1 , wherein identifying the one or more spatial portions of the first image comprises using a predefined spatial mapping function to convert pixel positions within said identified one or more spatial portions of the second image into corresponding pixel positions of the first image.

5. The image processing apparatus according to claim 4 , wherein said predefined spatial mapping function comprises mapping a pixel position of the second image into a corresponding pixel position of the first image by translating the pixel position by a predefined amount in a predefined direction.

6. The image processing apparatus according to claim 1 , wherein deriving the composite image comprises:

generating an emphasis image comprising respective visual indications in spatial positions that spatially correspond to said identified one or more spatial portions of the first image, whereas other parts of the emphasis image are transparent; and

overlaying the emphasis image on the first image.

7. The image processing apparatus according to claim 1 , wherein deriving the composite image comprises modifying at least part of the image content of the first image in said one or more identified spatial portions of the first image in a predefined manner.

8. The image processing apparatus according to claim 7 , wherein said modifying comprises one of the following:

replacing the image content in said one or more identified spatial portions of the first images with respective one or more visual indications,

modifying the image content in said one or more identified spatial portions of the first images in a predefined manner,

modifying the image content around said one or more identified spatial portions of the first images in a predefined manner.

9. An image capturing apparatus comprising:

a camera assembly comprising a first imaging device for capturing visible light images and a second imaging device for capturing thermal images, the first and second cameras positioned with respect to each other such that they have at least partially overlapping respective fields of view; and

an image processing apparatus according to claim 1 , arranged to receive the first image and the second image from the first camera and the second camera, respectively.

10. The image capturing apparatus according to claim 9 , wherein the first camera and the second camera are arranged to have their respective optical axes in parallel at a predefined distance from each other.

11. A search camera apparatus comprising an elongated shaft, a display and an image capturing apparatus according to claim 9 , wherein

the camera assembly is arranged at one end of the elongated shaft,

the display is arranged in or close to the other end of the elongated shaft, and

the image processing apparatus is further caused to provide the composite image for rendering on the display.

12. A method for image processing, the method comprising:

obtaining a first image and a second image that at least partially illustrate the same real-world scene, wherein the first image comprises a visible light image and the second image comprises a thermal image;

identifying a respective set of one or more spatial portions of the second image that represent a respective one of a plurality of different predefined temperature ranges;

identifying, for each set of one or more spatial portions of the second image, a respective set of one or more spatial portions of the first image that illustrate the same portions of the real-world scene as illustrated in the respective set of one or more spatial portions of the second image; and

deriving, based on the first image, a composite image wherein, the sets of one or more spatial portions of the first image are emphasized such that a different emphasis is applied for each set of one or more spatial portions of the first image.

13. The method according to claim 12 , comprising

using a camera assembly comprising a first camera for capturing visible light images and a second camera for capturing thermal images to capture, respectively, the first image and the second image,

wherein the first and second cameras are positioned with respect to each other such that they have at least partially overlapping respective fields of view.

14. A computer program product comprising computer readable program code tangibly embodied on a non-transitory computer readable medium, the program code configured to cause performing the method according to claim 12 when run a computing apparatus.

15. The image processing apparatus according to claim 2 , wherein said predefined temperature range represents one of the following:

temperatures between 30 to 50 degrees Celsius,

temperatures between 15 to 44 degrees Celsius.

16. The image processing apparatus according to claim 2 , wherein identifying the one or more spatial portions of the first image comprises using a predefined spatial mapping function to convert pixel positions within said identified one or more spatial portions of the second image into corresponding pixel positions of the first image.

17. The image processing apparatus according to claim 3 , wherein identifying the one or more spatial portions of the first image comprises using a predefined spatial mapping function to convert pixel positions within said identified one or more spatial portions of the second image into corresponding pixel positions of the first image.

18. The image processing apparatus according to claim 2 , wherein deriving the composite image comprises:

generating an emphasis image comprising respective visual indications in spatial positions that spatially correspond to said identified one or more spatial portions of the first image, whereas other parts of the emphasis image are transparent; and

overlaying the emphasis image on the first image.

19. The image processing apparatus according to claim 3 , wherein deriving the composite image comprises:

generating an emphasis image comprising respective visual indications in spatial positions that spatially correspond to said identified one or more spatial portions of the first image, whereas other parts of the emphasis image are transparent; and

overlaying the emphasis image on the first image.

20. An image processing apparatus comprising at least one processor and at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

obtain a first image and a second image that at least partially illustrate the same real-world scene, wherein the first image comprises a visible light image and the second image comprises a thermal image;

identify one or more spatial portions of the second image that represent a predefined temperature range;

identify one or more spatial portions of the first image that illustrate the same portions of the real-world scene as illustrated in the identified one or more spatial portions of the second image; and

derive, based on the first image, a composite image,

wherein the identified one or more spatial portions of the first image are emphasized, and

wherein deriving the composite image comprises:

generating an emphasis image comprising respective visual indications in spatial positions that spatially correspond to said identified one or more spatial portions of the first image, whereas other parts of the emphasis image are transparent; and

overlaying the emphasis image on the first image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: JOHNSON, JOEL R.; HAVOLA, JAAKKO
To: SAVOX COMMUNICATIONS OY AB (LTD)
Reel/Frame 055898/0892 →
Continuity (2)
Continuation In Part 16355480 · Mar 15, 2019
Related Publication 20200408603A1 · Dec 31, 2020
Cited By (1)
US 12,477,074