IP Library Granted Patent US 7,734,161
Granted Patent B2
US 7,734,161 · App. 11/737,625 · Granted Jun 8, 2010

Image stabilization with adaptive shutter control

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,734,161
App. No.
11/737,625
Granted
Jun 8, 2010
Kind
B2
Abstract

An apparatus to facilitate image stabilization with adaptive shutter control is described. An embodiment of the apparatus includes an image sensor, a movement detector, and a shutter controller. The movement detector is coupled to the image sensor. The shutter controller is coupled to the movement detector. The image sensor is configured to obtain image data. The movement detector is configured to obtain movement measurement information during a shutter period having a predetermined duration. The shutter controller is configured to adjust the shutter period of a shutter based on the movement measurement information. The shutter controls the time the image sensor is responsive to light incident on the image sensor. Embodiments of the apparatus provide a smaller and less costly implementation for image stabilization.

Claims (41)

1. An apparatus to facilitate image stabilization with adaptive shutter control, the apparatus comprising:

an image sensor to obtain image data;

a movement detector coupled to the image sensor, the movement detector configured to obtain movement measurement information during a shutter period having a predetermined duration; and

a shutter controller coupled to the movement detector, the shutter controller configured to adjust the shutter period of a shutter based on the movement measurement information, wherein the shutter controls a time the image sensor is responsive to light incident on the image sensor by deactivating the shutter in response to a determination that the image sensor moves beyond a movement threshold and reactivating the shutter in response to a determination that the image sensor returns within the movement threshold.

2. The apparatus of claim 1 wherein the shutter controller is further configured to deactivate the shutter prior to expiration of the predetermined duration of the shutter period.

3. The apparatus of claim 1 wherein the movement detector is further configured to determine if the image sensor moves beyond a movement threshold.

4. The apparatus of claim 3 wherein the movement detector is further configured to determine if the image sensor moves beyond a maximum heading excursion, wherein the maximum heading excursion is larger than the movement threshold and represents a maximum movement of the image sensor that will be tolerated for a single image.

5. The apparatus of claim 3 wherein the movement detector is further configured to determine if the image sensor returns within the movement threshold prior to moving beyond a maximum heading excursion.

6. The apparatus of claim 1 wherein the movement detector is further configured to generate the movement measurement information based on the image data from the image sensor.

7. The apparatus of claim 1 wherein the image sensor is further configured to store an original image from at least a portion of the predetermined duration of the shutter period, and to store a replacement image from a subsequent reduced shutter period having a shorter duration than an original duration corresponding to the original image.

8. The apparatus of claim 1 wherein the movement detector is further configured to identify a plurality of separate exposure times for a single image based on the movement measurement information, and the image sensor is further configured to accumulate an image signal for the single image over the plurality of separate exposure times.

9. The apparatus of claim 1 further comprising a brightness controller coupled to the image sensor, the brightness controller configured to generate brightness information, wherein the shutter controller is further configured to deactivate the shutter in response to a determination that the brightness information exceeds a brightness threshold.

10. The apparatus of claim 9 wherein the brightness controller is further configured to perform contrast equalization on an image in response to a determination that the brightness information is below a brightness threshold.

11. A method for image stabilization, the method comprising:

activating a shutter of an image sensor at a commencement of a shutter period, the shutter period having a predetermined duration;

obtaining movement measurement information during the shutter period, the movement measurement information indicative of a movement of the image sensor; and

adjusting the shutter period based on the movement measurement information, wherein adjusting the shutter period comprises:

deactivating the shutter of the image sensor in response to a determination that the movement measurement information exceeds a movement threshold; and

reactivating the shutter of the image sensor in response to a determination that the movement measurement information returns within the movement threshold.

12. The method of claim 11 wherein adjusting the shutter period comprises deactivating the shutter of the image sensor prior to expiration of the predetermined duration of the shutter period.

13. The method of claim 11 further comprising deactivating the shutter of the image sensor in response to a determination that the movement measurement information exceeds a maximum heading excursion, wherein the maximum heading excursion is larger than the movement threshold and represents a maximum movement of the image sensor that will be tolerated for a single image.

14. The method of claim 11 further comprising:

generating an original image during at least a portion of the predetermined duration of the shutter period after activating and before deactivating the shutter of the image sensor, wherein at least some of the movement measurement information is based on image data obtained during the predetermined duration;

generating a replacement image after reactivating the shutter of the image sensor, wherein the replacement image is generated during a reduced shutter period; and

replacing the original image with the replacement image.

15. The method of claim 14 further comprising performing contrast equalization on the replacement image.

16. The method of claim 11 further comprising:

generating an original image during at least a portion of the predetermined duration of the shutter period after activating and before deactivating the shutter of the image sensor; and

modifying an exposure time of the original image after reactivating the shutter of the image sensor.

17. The method of claim 16 further comprising deactivating the shutter in response to expiration of a monitoring period after at least one modification of the exposure time of the original image.

18. A camera system with adaptive shutter control, the camera system comprising:

means for obtaining movement measurement information during a shutter period, the movement measurement information indicative of a movement of an image sensor;

means for adjusting the shutter period based on the movement measurement information;

means for deactivating the shutter of the image sensor in response to a determination that the movement measurement information exceeds a movement threshold; and

means for reactivating the shutter of the image sensor in response to a determination that the movement measurement information returns within the movement threshold.

19. The camera system of claim 18 further comprising:

means for identifying a plurality of independent movement periods within a single monitoring period, wherein the plurality of independent movement periods are identified by the movement measurement information of the image sensor within a movement threshold; and

means for accumulating an image signal for a single image over the plurality of independent movement periods.

20. The camera system of claim 18 further comprising:

means for storing an original image from a first portion of the shutter period; and

means for storing a replacement image from a second portion of the shutter period having a shorter duration than the first portion corresponding to the original image.

Assignments (7)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041710/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037808/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (RELEASES RF 032851-0001) Recorded Feb 2, 2016
From: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 037689/0001 →
PATENT SECURITY AGREEMENT Recorded May 8, 2014
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Reel/Frame 032851/0001 →
MERGER Recorded May 7, 2013
From: AVAGO TECHNOLOGIES ECBU IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 030369/0528 →
MERGER Recorded Apr 19, 2013
From: AVAGO TECHNOLOGIES ECBU IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 030251/0018 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2007
From: BROSNAN, MICHAEL JOHN; SCHNEIDER, ALEXANDER; WILSON, ROBERT
To: AVAGO TECHNOLOGIES ECBU IP (SINGAPORE) PTE. LTD.
Reel/Frame 019313/0296 →