IP Library Granted Patent US 8,253,810
Granted Patent B2
US 8,253,810 · App. 11/987,869 · Granted Aug 28, 2012

Method, apparatus and system for image stabilization using a single pixel array

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,253,810
App. No.
11/987,869
Granted
Aug 28, 2012
Kind
B2
Abstract

An imaging pixel array and associated method and system are disclosed in which the array contains first pixels each having a first photo-conversion device, and second pixels each having a first photo-conversion device and a second photo-conversion device. The first photo-conversion devices are configured to acquire an image during a first integration period. The second photo-conversion devices are configured to acquire a plurality of images during the first integration period. A circuit uses the plurality of image signals and determines from them relative motion between the array and an image during a portion of the first integration period and provides a signal representing the motion which is used for image stabilization.

Claims (44)

1. An imaging device comprising:

a pixel array configured to receive an image, said array comprising a plurality of first pixels each having first and second photo-conversion devices, said first photo-conversion devices configured to acquire an image signal during a first integration period, said second photo-conversion devices configured to acquire a plurality of image signals during said first integration period;

a circuit for using said plurality of image signals generated by said second photo-conversion devices and detecting therefrom relative motion of the imaging device and an image during a portion of said first integration period and providing a signal representing said motion, wherein the first and second photo-conversion devices of each of the first pixels are coupled to a common storage node in that first pixel.

2. The imaging device of claim 1 , further comprising a plurality of second pixels, each having a first photo conversion device.

3. The imaging device of claim 2 , wherein said plurality of first pixels are separated from one another by said second pixels.

4. The imaging device of claim 2 , wherein said plurality of first pixels are located to form a plurality of vertical lines or a plurality of horizontal lines throughout said pixel array.

5. The imaging device of claim 2 , wherein said plurality of first pixels are located to form a plurality of intersecting vertical and horizontal lines throughout said pixel array.

6. The imaging device of claim 1 , further including a lens configured to provide said image to said pixel array.

7. The imaging device of claim 1 , wherein said first and said second photo-conversion devices are readout using the same readout circuitry.

8. The imaging device of claim 1 , further including a compensator configured to maintain a substantially fixed relationship between the image and the imaging device based on the signal representing said motion.

9. The imaging device of claim 8 , wherein said compensator opto-mechanically maintains the substantially fixed relationship.

10. The imaging device of claim 9 , wherein said pixel array is located on a movable platform and wherein said compensator provides signals to displace said platform to maintain the substantially fixed relationship.

11. The imaging device of claim 10 , wherein said pixel array is located on a fixed platform and is associated with a moveable lens element and wherein said compensator provides signals to displace the lens element to maintain the substantially fixed relationship.

12. The imaging device of claim 1 wherein vectors are used to determine the relative motion during a portion of said first integration period.

13. The imaging device of claim 1 wherein edge analysis is used to determine said relative motion during a portion of said first integration period.

14. A digital camera comprising:

a pixel array including a plurality of dual-mode image pixels, each dual-mode image pixel containing first and second photo-conversion devices, wherein—the first and second photo-conversion devices of each of the dual-mode image pixels are coupled to a common storage node in that dual-mode image pixel and wherein each of the first photo-conversion devices is coupled to its respective common storage node through a respective transfer transistor;

a control circuit for operating said pixel array such that the first photo-conversion devices acquire an image during a first integration period and the second photo-conversion devices acquire a plurality of successive image signals during the first integration period;

a circuit for acquiring said plurality of successive image signals and configured to:

determine a location difference of at least one common feature between first and second image signals of said plurality of image signals, and

provide a displacement signal indicative of relative motion between an image and said pixel array during a portion of said first integration period.

15. The digital camera of claim 14 , further comprising a plurality of single-mode image pixels, each single-mode image pixel contains a first photo-conversion device, and wherein the dual-mode pixels are interspersed with the single-mode pixels in said array.

16. The digital camera of claim 14 , wherein the plurality of images captured by the second photo-conversion devices during the first integration period is greater than three.

17. The digital camera of claim 14 , further comprising a readout circuit for reading out signals from the first photo conversion devices and the second photo-conversion devices.

18. The digital camera of claim 14 , further including a compensator configured to maintain a substantially fixed relationship between the image and the pixel array based on the displacement signal.

19. The digital camera of claim 14 , wherein vectors are used to determine relative motion of the digital camera and an image during a portion of said first integration period.

20. The digital camera claim 14 , wherein edge analysis is used to determine relative motion of the digital camera and an image during a portion of said first integration period.

21. A method of operating an imaging device comprising:

inputting light from a desired image to a pixel array, the pixel array including a plurality of dual-mode pixels, each having first and second photo-conversion devices, wherein the first and second photo-conversion devices of each of the dual-mode pixels are coupled to a common storage node in that dual-mode pixel,

receiving light on said first photo-conversion devices during a first integration period,

receiving light on said second photo-conversion devices during the first integration period,

reading a first charge from said second photo-conversion devices at a first time during said first integration period,

reading a second charge from said second photo-conversion devices at a second time during said first integration period,

using the first and second read charges to determine relative movement of the imaging device and an image during a portion of the first integration period, and

compensating for the determined movement.

22. The method of claim 21 , wherein the pixel array further includes a plurality of single-mode pixels, each having a first photo-conversion device.

23. The method of claim 21 , further comprising:

reading a third charge from said second photo-conversion devices at a third time during said first integration period,

using the second charge and third read charges to determine relative movement of the imaging device and an image during a portion of said first integration period, and

compensating for the determined movement.

24. The method of claim 21 , further comprising opto-mechanically performing said compensation, wherein said pixel array is located on a movable platform, and said act of compensating comprises:

maintaining a fixed relationship between said pixel array and said image by moving said movable platform to compensate for said determined movement.

25. The method of claim 21 , further comprising opto-mechanically performing said compensation wherein said pixel array is located on a fixed platform, and said act of compensating comprises:

maintaining the fixed relationship between said pixel array and said image by moving and element of a lens which focuses an image on the pixel array.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2009
From: MICRON TECHNOLOGY, INC.
To: APTINA IMAGING CORPORATION
Reel/Frame 023245/0186 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2007
From: MYERS, CHARLES; BROSNAN, MICHAEL J.; MOORE, CHARLES; BAUMGARTNER, RICHARD A.; SILSBY, CHRISTOPHER; MISEK, BRIAN J.; ANG, JIN K.
To: MICRON TECHNOLOGY, INC.
Reel/Frame 020260/0899 →