IP Library Granted Patent US 8,853,631
Granted Patent B2
US 8,853,631 · App. 13/442,241 · Granted Oct 7, 2014

Camera with two visual imaging subsystems for determining parallax and for focusing an infrared imaging subsystem

Inventor: Katrin Strandemar (Rimbo, SE)
Assignee: FLIR Systems AB
G01J5/02G01J2005/0077G01J5/0275G01J5/08G01J5/0859G01J5/10G01J5/0846
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,853,631
App. No.
13/442,241
Granted
Oct 7, 2014
Kind
B2
Abstract

A camera has an infrared (IR) imaging subsystem that includes an IR detector. The camera also has a visual imaging subsystem for generating a visual image of an observed scene. The camera also has one or more distance measuring devices for obtaining distance related information regarding a distance from the camera to the scene and a processor arranged to receive distance related information from one or more distance measuring devices and process the received distance related information, wherein said processing comprises determining a distance to the scene based on the received distance related information. The IR imaging subsystem may also include an IR optical element for focusing IR radiation on the IR detector. The IR optical element may be operable to focus the IR radiation on the IR detector based on the determined distance.

Claims (61)

1. A camera comprising:

an infrared (IR) imaging subsystem configured to obtain IR images of an observed scene, the IR imaging subsystem having an IR detector;

a visual imaging subsystem configured to obtain a visual image of the observed scene;

one or more distance measuring devices configured to obtain distance related information regarding a distance from the camera to the scene; and

a processor configured to receive distance related information from one or more distance measuring devices, the processor further being configured to:

process the received distance related information, wherein the processing comprises determining a distance to the scene based on the received distance related information,

determine the distance to one or more parts of the observed scene or to objects comprised therein,

present the distance information in a distance map, and

combine several images focused at different distances into one image, based on distance map information.

2. The camera of claim 1 , wherein the IR imaging subsystem further includes an IR optical element configured to focus IR radiation on the IR detector based on determined distance.

3. The camera of claim 2 , wherein the processor is further configured to calculate a focus distance based on the determined distance and the IR optical element is operable to focus IR radiation on the IR detector based on the focus distance.

4. The camera of claim 3 , wherein the processor is further configured to:

determine a displacement between an IR image taken by the IR imaging subsystem and the first visual image taken by the first visual imaging subsystem;

align the IR image and the first visual image based on the displacement; and

present at least one of a fused image or a blended image based on the IR image and the visual image.

5. The camera of claim 2 , wherein the processor is further configured to:

determine a displacement between an IR image taken by the IR imaging subsystem and the visual image taken by the visual imaging subsystem;

align the IR image and the visual image based on the displacement; and

present at least one of a fused image or a blended image based on the IR image and the visual image.

6. The camera of claim 1 , wherein the processor is further configured to:

determine a displacement between an IR image taken by the IR imaging subsystem and the visual image taken by the visual imaging subsystem;

align the IR image and the visual image based on the displacement; and

present at least one of a fused image or a blended image based on the IR image and the visual image.

7. The camera of claim 6 , wherein the processor is further configured to:

determine a first and a second displacement for at least a first and a second part of the IR image, respectively; and

align the first and second part of the image based on the first and second displacement, respectively.

8. The camera of claim 1 , wherein the processor is further configured to control the IR optical element to focus on each object in the image separately, based on the distance map.

9. The camera of claim 1 , wherein the processor is further configured to correct for perspective effects, based on the distance map.

10. The camera of claim 1 , wherein the processor is further configured to correct for perspective effects by:

obtaining a distance map for an imaged scene;

calculating a scaling map based on the distance map; and

apply the values of the scaling map to the corresponding parts of an image of the imaged scene to correct the image for the effects of perspective.

11. The camera of claim 1 , wherein the processor is further configured to determine the actual size or area of an object present in the imaged scene, based on the number of pixels covering the object and the determined distance to the object.

12. A method of focusing a camera having an infrared (IR) imaging subsystem, a visual imaging subsystem, and one or more distance measuring devices, the method comprising:

receiving distance related information from one or more distance measuring devices;

determining a distance to the scene based on the received distance related information;

focusing an IR imaging subsystem based on the determined distance; and

determining at least a first distance and a second distance to at least a first part and a second part of the scene.

13. The method of claim 12 , wherein the first and second part of the scene correspond to a first and a second object present in the scene, respectively.

14. The method of claim 12 , further comprising:

calculating a focus distance based on the determined distance to the scene; and

focusing the IR imaging subsystem based on the focus distance.

15. The method of claim 12 , further comprising:

determining a displacement between an IR image and a visual image;

aligning the IR image and the visual image based on the displacement; and

presenting at least one of a fused image or a blended image based on the IR image and the visual image.

16. The method of claim 12 , further comprising:

determining a first and a second displacement for at least a first and a second part of the IR image, respectively; and

aligning the first and second part of the image based on the first and second displacement, respectively.

17. The method of claim 12 , further comprising:

determining a distance to one or more parts of the observed scene or to objects comprised therein to provide distance information; and

presenting the distance information in a distance map.

18. The method of claim 17 , further comprising controlling an IR optical element of the IR imaging subsystem to focus on each object in the image separately, based on the distance map.

19. The method of claim 17 , further comprising combining several images focused at different distances into one image, based on distance map information.

20. The method of claim 17 , further comprising correcting for perspective effects, based on the distance map.

21. The method of claim 12 , further comprising:

obtaining a distance map for an imaged scene;

calculating a scaling map based on the distance map; and

apply the values of the scaling map to the corresponding parts of an image of the imaged scene to correct the image for the effects of perspective.

22. The method of claim 12 , further comprising determining an actual size or area of an object present in the imaged scene, based on the number of pixels covering the object and the determined distance to the object.

23. A non-transitory computer-readable storage medium comprising computer executable instructions for execution by a processor to perform the method according to claim 12 .

Assignments (2)
ADDRESS CHANGE Recorded Jan 16, 2013
From: FLIR SYSTEMS AB
To: FLIR SYSTEMS AB
Reel/Frame 029645/0168 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2012
From: STRANDEMAR, KATRIN
To: FLIR SYSTEMS AB
Reel/Frame 028074/0806 →
Continuity (2)
Continuation In Part 12624333 · Nov 23, 2009
Related Publication 20120218418A1 · Aug 30, 2012