IP Library Granted Patent US 11,070,718
Granted Patent B2
US 11,070,718 · App. 16/441,697 · Granted Jul 20, 2021

Image stabilization systems and methods

Inventors: Mitch G. Barton (Tigard, OR); Charles Rush (Wilsonville, OR); Sheldon Johnson (Wilsonville, OR)
Assignee: FLIR SURVEILLANCE, INC.
H04N5/23222H04N5/2328H04N5/23258
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,070,718
App. No.
16/441,697
Granted
Jul 20, 2021
Kind
B2
Abstract

Open-loop or feed-forward image stabilization systems and related techniques are provided to improve the accuracy and reliability of imaging systems. An open-loop or feed-forward image stabilization system includes a fast steering mirror assembly, an angular motion sensor, and a logic device. The fast steering mirror assembly adjusts a propagation direction of an optical path for an imaging system. The angular motion sensor is configured to measure and provide an angular motion of the imaging system. The logic device is configured to provide open-loop or feed-forward control for the fast steering mirror assembly by determining a compensating angular offset for the fast steering mirror assembly based, at least in part, on the received angular motion of the imaging system, and by controlling the fast steering mirror assembly to adjust the propagation direction of the optical path for the imaging system according to the determined compensating angular offset.

Claims (100)

1. A system comprising:

a fast steering mirror assembly coupled within an imaging system and configured to adjust a propagation direction of an optical path for the imaging system; and

a logic device configured to control the fast steering mirror assembly based on angular motion of the imaging system, wherein the logic device is configured to:

receive the angular motion of the imaging system from an angular motion sensor coupled to the imaging system, wherein the received angular motion of the imaging system produces an angular offset in the propagation direction of the optical path;

determine a compensating angular offset for the fast steering mirror assembly based, at least in part, on the received angular motion of the imaging system, wherein the compensating angular offset is configured to stabilize imagery projected along the optical path to an imaging module of the imaging system, by at least partially counteracting the angular offset produced by the angular motion of the imaging system; and

control the fast steering mirror assembly to adjust the propagation direction of the optical path for the imaging system according to the determined compensating angular offset;

wherein the fast steering mirror assembly comprises:

a mirror configured to reflect a beam of electromagnetic radiation projected along the optical path; and

an actuator assembly comprising one or more actuators coupled to the mirror and configured to adjust a position of the mirror;

wherein the controlling the fast steering mirror assembly to adjust the propagation direction of the optical path comprises controlling the one or more actuators to adjust the position of the mirror based, at least in part, on the determined compensating angular offset, without positional feedback from the actuator assembly.

2. The system of claim 1 , further comprising:

the angular motion sensor coupled to the imaging system, wherein the angular motion sensor is configured to provide the angular motion of the imaging system; and

the imaging module of the imaging system, wherein the imaging module comprises a visible spectrum imaging module or an infrared imaging module, and wherein the fast steering mirror assembly is disposed between the imaging module and an aperture of the imaging system.

3. The system of claim 1 , wherein the imaging module comprises an infrared imaging module sensitive to a first electromagnetic spectrum, the system further comprising:

a second imaging module sensitive to a second electromagnetic spectrum different from the first electromagnetic spectrum; and

a beam splitter configured to split the beam of electromagnetic radiation projected along the optical path into a first beam for the infrared imaging module and a second beam for the second imaging module.

4. The system of claim 1 , wherein the determining the compensating angular offset for the fast steering mirror assembly comprises:

determining an image stabilization component of the received angular motion of the imaging system; and

determining the compensating angular offset for the fast steering mirror assembly based, at least in part, on the image stabilization component of the received angular motion of the imaging system and one or more angular gains corresponding to a position of the fast steering mirror assembly within the imaging system relative to at least one rotational axis of the imaging system.

5. The system of claim 1 , wherein the logic device is configured to:

control the fast steering mirror assembly to drive an actuator of the fast steering mirror assembly according to a fault probe actuator power signal;

receive a fault detection signal from an actuator fault detector electrically coupled to the actuator, wherein the actuator fault detector is configured to generate the fault detection signal based, at least in part, on an electrical response of the actuator to the fault probe actuator power signal; and

generate a fast steering mirror assembly fault response.

6. The system of claim 5 , wherein:

the fault probe actuator power signal comprises a full range step input actuator power signal; and

the actuator fault detector is configured to generate the fault detection signal when a rise time of the electrical response of the actuator is less than a predetermined threshold rise time.

7. The system of claim 5 , wherein the fast steering mirror assembly fault response comprises:

a fault indicator comprising an alarm or notification that is provided to a user interface for display to a user; and/or

a control signal to disable operation of the fast steering mirror assembly.

8. A system comprising:

a fast steering mirror assembly coupled within an imaging system and configured to adjust a propagation direction of an optical path for the imaging system; and

a logic device configured to control the fast steering mirror assembly based on angular motion of the imaging system, wherein the logic device is configured to:

receive the angular motion of the imaging system from an angular motion sensor coupled to the imaging system;

determine a compensating angular offset for the fast steering mirror assembly based, at least in part, on the received angular motion of the imaging system, wherein the compensating angular offset is configured to stabilize imagery projected along the optical path to an imaging module of the imaging system, relative to the angular motion of the imaging system; and

control the fast steering mirror assembly to adjust the propagation direction of the optical path for the imaging system according to the determined compensating angular offset;

wherein the controlling the fast steering mirror assembly comprises:

receiving a temperature of the fast steering mirror assembly from a temperature sensor coupled within the fast steering mirror assembly;

determining a temperature compensated digital actuator control signal corresponding to the compensating angular offset and the received temperature and based on a calibration curve for the fast steering mirror assembly; and

providing the temperature compensated digital actuator control signal to the fast steering mirror assembly.

9. The system of claim 1 , wherein:

the one or more actuators are coupled to the mirror and configured to adjust a tip and/or tilt of the mirror relative to the beam of electromagnetic radiation; and

the fast steering mirror assembly comprises:

an actuator power signal generator configured to generate and provide actuator power signals to the one or more actuators to drive the one or more actuators to adjust the tip and/or tilt of the mirror;

a temperature sensor coupled within the fast steering mirror assembly and configured to provide a temperature associated with the one or more actuators; and

an actuator fault detector electrically coupled to at least one of the one or more actuators and configured to generate a fault detection signal based, at least in part, on electrical responses of the at least one actuator to the actuator power signals.

10. A system comprising:

a fast steering mirror assembly coupled within an imaging system and configured to adjust a propagation direction of an optical path for the imaging system; and

a logic device configured to control the fast steering mirror assembly based on angular motion of the imaging system, wherein the logic device is configured to:

receive the angular motion of the imaging system from an angular motion sensor coupled to the imaging system;

determine a compensating angular offset for the fast steering mirror assembly based, at least in part, on the received angular motion of the imaging system, wherein the compensating angular offset is configured to stabilize imagery projected along the optical path to an imaging module of the imaging system, relative to the angular motion of the imaging system; and

control the fast steering mirror assembly to adjust the propagation direction of the optical path for the imaging system according to the determined compensating angular offset;

wherein the logic device is configured to:

control the imaging module of the imaging system to image a calibration target;

determine a set of angular offsets associated with the imaged calibration target and provided by the fast steering mirror assembly, according to a predetermined set of temperatures of the imaging system; and

generate a calibration curve based, at least in part, on the set of angular offsets and the predetermined set of temperatures.

11. The system of claim 10 , wherein the determining the set of angular offsets comprises:

determining that a current temperature of the imaging system approximates one of the predetermined set of temperatures;

determining a first pixel position associated with the calibration target on the imaging module of the imaging system;

controlling the fast steering mirror assembly to adjust the propagation direction of the optical path for the imaging system according to one or more calibration actuator control signals; and

determining the set of angular offsets based on a difference between the first pixel position and one or more additional pixel positions corresponding to the one or more calibration actuator control signals.

12. The system of claim 10 , wherein:

the calibration target comprises a pinhole target and the first and additional pixel positions of the pinhole target correspond to a center or edge of the imaged pinhole target; and

the first and additional pixel positions of the pinhole target comprise sub-pixel positions based, at least in part, on a shape of the pinhole target and/or a focal plane array arrangement of the imager of the imaging system.

13. A method comprising:

receiving an angular motion of an imaging system from an angular motion sensor coupled to the imaging system, wherein the received angular motion of the imaging system produces an angular offset in a propagation direction of an optical path of the imaging system;

determining an angular offset for a fast steering mirror assembly coupled within the imaging system based, at least in part, on the received angular motion of the imaging system, wherein the fast steering mirror assembly is configured to adjust the propagation direction of the optical path for the imaging system, and wherein the compensating angular offset is configured to stabilize imagery projected along the optical path to an imaging module of the imaging system, by at least partially counteracting the angular offset produced by the angular motion of the imaging system; and

controlling the fast steering mirror assembly, based on the angular motion of the imaging system, to adjust the propagation direction of the optical path for the imaging system according to the determined compensating angular offset;

wherein the fast steering mirror assembly comprises:

a mirror configured to reflect a beam of electromagnetic radiation projected along the optical path; and

an actuator assembly comprising one or more actuators coupled to the mirror and configured to adjust a position of the mirror;

wherein the controlling the fast steering mirror assembly to adjust the propagation direction of the optical path comprises controlling the one or more actuators to adjust the position of the mirror based, at least in part, on the determined compensating angular offset, without positional feedback from the actuator assembly.

14. The method of claim 13 , wherein:

the angular motion sensor is configured to provide the angular motion of the imaging system;

the imaging module comprises a visible spectrum imaging module or an infrared imaging module; and

the fast steering mirror assembly is disposed between the imaging module and an aperture of the imaging system.

15. The method of claim 13 , wherein:

the imaging module comprises an infrared imaging module sensitive to a first electromagnetic spectrum;

the imaging system comprises a second imaging module sensitive to a second electromagnetic spectrum different from the first electromagnetic spectrum; and

the imaging system comprises a beam splitter configured to split the beam of electromagnetic radiation projected along the optical path into a first beam for the infrared imaging module and a second beam for the second imaging module.

16. The method of claim 13 , wherein the determining the compensating angular offset for the fast steering mirror assembly comprises:

determining an image stabilization component of the received angular motion of the imaging system; and

determining the compensating angular offset for the fast steering mirror assembly based, at least in part, on the image stabilization component of the received angular motion of the imaging system and one or more angular gains corresponding to a position of the fast steering mirror assembly within the imaging system relative to at least one rotational axis of the imaging system.

17. The method of claim 13 , wherein the controlling the fast steering mirror assembly comprises:

receiving a temperature of the fast steering mirror assembly from a temperature sensor coupled within the fast steering mirror assembly;

determining a temperature compensated digital actuator control signal corresponding to the compensating angular offset and the received temperature and based on a calibration curve for the fast steering mirror assembly; and

providing the temperature compensated digital actuator control signal to the fast steering mirror assembly.

18. The method of claim 13 , wherein:

the one or more actuators coupled to the mirror are configured to adjust a tip and/or tilt of the mirror relative to the beam of electromagnetic radiation; and

the fast steering mirror assembly comprises:

an actuator power signal generator configured to generate and provide actuator power signals to the one or more actuators to drive the one or more actuators to adjust the tip and/or tilt of the mirror;

a temperature sensor coupled within the fast steering mirror assembly and configured to provide a temperature associated with the one or more actuators; and

an actuator fault detector electrically coupled to at least one of the one or more actuators and configured to generate a fault detection signal based, at least in part, on electrical responses of the at least one actuator to the actuator power signals.

19. The method of claim 13 , further comprising:

controlling the fast steering mirror assembly to drive an actuator of the fast steering mirror assembly according to a fault probe actuator power signal;

receiving a fault detection signal from an actuator fault detector electrically coupled to the actuator, wherein the actuator fault detector is configured to generate the fault detection signal based, at least in part, on an electrical response of the actuator to the fault probe actuator power signal; and

generating a fast steering mirror assembly fault response.

20. The method of claim 13 , further comprising:

controlling the imaging module of the imaging system to image a calibration target;

determining a set of angular offsets associated with the imaged calibration target and provided by the fast steering mirror assembly, according to a predetermined set of temperatures of the imaging system; and

generating a calibration curve based, at least in part, on the set of angular offsets and the predetermined set of temperatures.

Assignments (2)
CHANGE OF NAME Recorded Dec 29, 2021
From: FLIR SURVEILLANCE, INC.
To: TELEDYNE FLIR SURVEILLANCE, INC.
Reel/Frame 058598/0879 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2019
From: BARTON, MITCH G.; RUSH, CHARLES; JOHNSON, SHELDON
To: FLIR SURVEILLANCE, INC.
Reel/Frame 049504/0184 →
Continuity (2)
Provisional Application 62686584 · Jun 18, 2018
Related Publication 20190387161A1 · Dec 19, 2019
Cited By (1)
US 12,631,843