Systems and methods for image stabilization
View Patent ↗An image capture device includes a frame buffer, a processor, a shutter, an actuator, a three-axis optical motion sensor and an image sensor. The image sensor defines an optical axis. The three-axis optical motion sensor provides information concerning rotational movement of the camera about each of a roll axis, a yaw axis and a pitch axis. The roll axis is parallel to the optical axis. The yaw axis and the pitch axis are orthogonal to one another and orthogonal to the roll axis. The actuator rotates the image sensor in response to the rotational movement of the device about the optical axis. The processor generates first and second offsets responsive to the rotational motion about the yaw axis and the pitch axis. The processor shifts each line of image information in a frame in accordance with the first and second offsets.
1. A method for stabilizing an image by counteracting motion of the body of an image capture device, the method comprising:
using an optical sensor to provide information concerning rotational movement about an optical axis, movement about a yaw axis, and movement about a pitch axis, including generating multiple first offsets responsive to both movement in yaw and movement in pitch and generating multiple second offset responsive to both movement in yaw and movement in pitch;
using the information concerning rotational movement about the optical axis to rotate an image sensor about the optical axis, the image sensor being different than the optical sensor; and
applying information concerning movement about the yaw axis and movement about the pitch axis to a post acquisition processor configured to reduce the effects of movement about both the yaw axis and the pitch axis in an output image generated by the image capture device,
wherein applying information concerning movement about the yaw axis and movement about the pitch axis to a post acquisition processor comprises applying a non-mechanical solution that comprises acquiring image data from multiple image segment exposure intervals of a frame exposure period at the image sensor, reading each line of the image data for each image segment exposure interval from the image sensor, shifting relative location of each line of the image data for each image segment exposure interval in accordance with the respective first and second offsets for that image segment exposure interval to produce shifted image data, and writing the shifted image data for each image segment exposure interval in a frame buffer to accumulate an output image in the frame buffer.
2. The method of claim 1 , wherein applying information concerning movement about the yaw axis and movement about the pitch axis to a post acquisition processor comprises applying an algorithm over a single-frame of image information.
3. The method of claim 2 , wherein applying an algorithm over a single-frame of image information comprises applying a deconvolution algorithm.
4. The method of claim 1 , wherein using an optical sensor comprises using a three-axis optical sensor that comprises multiple optical arrays to provide the information concerning the rotational movement about the optical axis, the movement about the yaw axis, and the movement about a pitch axis.
5. A camera, comprising:
a body housing a frame buffer coupled to a processor, a shutter, an actuator, and a three-axis optical sensor, the processor further coupled to the shutter, the actuator and the three-axis optical sensor; and
an image sensor, the image sensor defining an optical axis, the image sensor being different than the three-axis optical sensor, the three-axis optical sensor having a roll axis that is parallel with the optical axis, a yaw axis that is orthogonal to the optical axis and a pitch axis that is orthogonal to both the optical axis and the yaw axis, the actuator configured to rotate the image sensor in accordance with information from the three-axis optical sensor responsive to rotation of the body about the optical axis, wherein the processor applies an image processing algorithm responsive to information from the three-axis optical sensor responsive to rotation of the body about the yaw axis and rotation of the body about the pitch axis,
wherein the processor is configured to generate multiple first offsets responsive to both movement in yaw and movement in pitch and to generate multiple second offset responsive to both movement in yaw and movement in pitch, and
wherein the processor is further configured to direct the image sensor to acquire image data from multiple image segment exposure intervals of a frame exposure period, to read each line of the image data for each image segment exposure interval from the image sensor, to shift relative location of each line of the image data for each image segment exposure interval in accordance with the respective first and second offsets for that image segment exposure interval to produce shifted image data, and writing the shifted image data for each image segment exposure interval in the frame buffer to accumulate an output image in the frame buffer.
6. The camera of claim 5 , wherein the body further comprises one of a mobile phone, a portable computer, and a personal digital assistant.
7. The camera of claim 5 , wherein the processor is configured to apply a deconvolution algorithm over a single-frame of image information.
8. The camera of claim 5 , wherein the processor is configured to direct the frame buffer to transfer an output image to a memory store upon completion of a frame of image information.
9. The camera of claim 5 , wherein the three-axis optical sensor comprises multiple optical arrays to provide the information responsive to the rotation of the body about the optical axis, the rotation of the body about the yaw axis and the rotation of the body about the pitch axis.