Combined mechanical and electronic image stabilization
A device includes a mechanical stabilization system is used in image signal processing. The mechanical image stabilization system has an operating bandwidth and includes a motor to control an orientation of an image sensor. A processing apparatus of the device determines a temperature of the motor and adjusts a cutoff frequency of the operating bandwidth based on the temperature of the motor.
1. A device comprising:
a mechanical stabilization system that has a first operating bandwidth, the mechanical stabilization system comprising a motor configured to control an orientation of an image sensor; and
a processing apparatus configured to:
determine a temperature of the motor; and
adjust a cutoff frequency of the first operating bandwidth based on the temperature of the motor.
2. The device of claim 1 , wherein the mechanical stabilization system is configured to reject motions of the image sensor that occur within the first operating bandwidth.
3. The device of claim 2 , wherein the first operating bandwidth has an upper cutoff frequency.
4. The device of claim 1 , further comprising:
an electronic stabilization system that has a second operating bandwidth.
5. The device of claim 4 , wherein the electronic stabilization system is configured to correct images for rotations of the image sensor.
6. The device of claim 5 , wherein the processing apparatus is further configured to:
adjust a cutoff frequency of the second operating bandwidth based on the temperature of the motor.
7. The device of claim 1 , wherein the mechanical stabilization system includes a proportional integral derivative controller.
8. The device of claim 7 , wherein the proportional integral derivative controller is tuned to enforce the first operating bandwidth.
9. A method comprising:
receiving an image from an image sensor;
filtering sensor data from one or more motion sensors with a pass band matching an operation bandwidth to the sequence of orientation estimates to obtain filtered data;
invoking an electronic image stabilization system to correct the image based on the filtered data to obtain a stabilized image; and
storing an output image based on the stabilized image.
10. The method of claim 9 , further comprising:
invoking a mechanical image stabilization system to reject motions of the image sensor that occur within a first operating bandwidth.
11. The method of claim 10 , wherein the first operating bandwidth has an upper cutoff frequency.
12. The method of claim 11 , wherein the electronic image stabilization system has a second operating bandwidth.
13. The method of claim 12 , wherein the electronic image stabilization system is configured to correct images for rotations of the image sensor.
14. The method of claim 13 , further comprising:
adjusting a cutoff frequency of the first operating bandwidth.
15. The method of claim 14 , further comprising:
adjusting a cutoff frequency of the second operating bandwidth.
16. A device comprising:
a mechanical stabilization system that has a first operating bandwidth, the mechanical stabilization system comprising a motor configured to control an orientation of an image sensor;
a battery configured to supply power to the motor; and
a processing apparatus configured to:
determine a state of charge of the battery; and
adjust a cutoff frequency of the first operating bandwidth based on the state of charge of the battery.
17. The device of claim 16 , further comprising:
an electronic stabilization system that has a second operating bandwidth.
18. The device of claim 17 , wherein the electronic stabilization system is configured to correct images for rotations of the image sensor.
19. The device of claim 18 , wherein the first operating bandwidth has an upper cutoff frequency.
20. The device of claim 19 , wherein the second operating bandwidth has a cutoff frequency that is greater than the upper cutoff frequency.