IP Library Granted Patent US 10,659,715
Granted Patent B2
US 10,659,715 · App. 16/503,391 · Granted May 19, 2020

Fractional-readout oversampled image sensor

Inventors: Jay Endsley (Santa Clara, CA); Thomas Vogelsang (Mountain View, CA); Craig M. Smith (Spencerport, NY); Michael Guidash (Rochester, NY); Alexander C. Schneider (Redmond, WA)
Assignee: Rambus Inc.
H04N5/378H04N5/2355H04N5/3532H04N5/35536H04N5/35554
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,659,715
App. No.
16/503,391
Granted
May 19, 2020
Kind
B2
Abstract

Signals representative of total photocharge integrated within respective image-sensor pixels are read out of the pixels after a first exposure interval that constitutes a first fraction of a frame interval. Signals in excess of a threshold level are read out of the pixels after an ensuing second exposure interval that constitutes a second fraction of the frame interval, leaving residual photocharge within the pixels. After a third exposure interval that constitutes a third fraction of the frame interval, signals representative of a combination of at least the residual photocharge and photocharge integrated within the pixels during the third exposure interval are read out of the pixels.

Claims (34)

1. A method of operation within an integrated-circuit image sensor having a pixel array, the method comprising:

reading the pixel array after each of a plurality of sub-frame intervals to generate a corresponding plurality of sub-frame readouts, the sub-frame intervals transpiring sequentially within a frame interval;

selectively combining the sub-frame readouts to generate a digital image corresponding to the frame interval, including excluding from the digital image (i) over-threshold pixel values within a first one of the sub-frame readouts and (ii) under-threshold pixel values within a second one of the sub-frame readouts.

2. The method of claim 1 wherein excluding over-threshold pixel values within the first one of the sub-frame readouts from the digital image comprises excluding, from the digital image, pixel values from saturated pixels within the pixel array.

3. The method of claim 2 wherein reading the pixel array after each of the sub-frame intervals to generate the corresponding sub-frame readouts comprises generating analog readout signals for respective pixels of the pixel array, and wherein excluding, from the digital image, pixel values from saturated pixels within the array comprises identifying the saturated pixels by comparing the analog readout signals with a saturation threshold.

4. The method of claim 1 wherein excluding under-threshold pixel values from the digital image comprises excluding, from the digital image, pixel values from pixels in which accumulated photocharge is less than a predetermined threshold.

5. The method of claim 4 wherein reading the pixel array after each of the sub-frame intervals to generate the corresponding sub-frame readouts comprises generating analog readout signals for respective pixels of the pixel array, and wherein excluding, from the digital image, pixel values from pixels in which accumulated photocharge is less than a predetermined threshold comprises identifying the pixels in which accumulated photocharge is less than the predetermined threshold by comparing the analog readout signals with a noise threshold.

6. The method of claim 4 wherein reading the pixel array after each of the sub-frame intervals to generate the corresponding sub-frame readouts comprises generating digital values for respective pixels of the pixel array, and wherein excluding, from the digital image, pixel values from pixels in which accumulated photocharge is less than a predetermined threshold comprises identifying the pixels in which accumulated photocharge is less than the predetermined threshold by comparing the digital values against a digital noise threshold.

7. The method of claim 1 wherein reading the pixel array after each of the sub-frame intervals to generate the corresponding sub-frame readouts comprises generating digital pixels values for respective pixels of the pixel array, and wherein excluding under-threshold pixel values within the second one of the sub-frame readouts from the digital image comprises zeroing each of the digital pixel values for the second one of the sub-frame readouts that does not exceed a noise threshold.

8. The method of claim 1 wherein reading the pixel array after each of the plurality of sub-frame intervals to generate the corresponding plurality of sub-frame readouts comprises reading the pixel array after a long sub-frame interval having a duration greater than half the frame interval and reading the pixel array after each of a plurality of short sub-frame intervals having a collective duration less than half the frame interval.

9. The method of claim 8 wherein selectively combining the sub-frame readouts to generate the digital image comprises scaling the sub-frame readouts according to the durations of their corresponding sub-frame intervals.

10. The method of claim 1 wherein reading the pixel array after each of the plurality of sub-frame intervals to generate the corresponding plurality of sub-frame readouts comprises:

generating, for an initial one of the sub-frame readouts and a final one of the sub-frame readouts, pixel values corresponding to a totality of photocharge accumulated within the pixel array during the corresponding sub-frame interval; and

generating, for a non-final one of the sub-frame readouts that follows the initial one of the sub-frame readouts, pixel values corresponding to a fraction of photocharge accumulated within the pixel array during the corresponding sub-frame interval.

11. An integrated-circuit image sensor comprising:

a pixel array; and

image generation circuitry to:

read the pixel array after each of a plurality of sub-frame intervals to generate a corresponding plurality of sub-frame readouts, the sub-frame intervals transpiring sequentially within a frame interval;

selectively combine the sub-frame readouts to generate a digital image corresponding to the frame interval, including circuitry to exclude from the digital image (i) over-threshold pixel values within a first one of the sub-frame readouts, and (ii) under-threshold pixel values within a second one of the sub-frame readouts.

12. The integrated-circuit image sensor of claim 11 wherein the circuitry to exclude over-threshold pixel values within the first one of the sub-frame readouts from the digital image comprises circuitry to exclude, from the digital image, pixel values from saturated pixels within the pixel array.

13. The integrated-circuit image sensor of claim 12 wherein the image generation circuitry to read the pixel array after each of the sub-frame intervals to generate the corresponding sub-frame readouts comprises readout circuitry to generate analog readout signals for respective pixels of the pixel array, and wherein the circuitry to exclude, from the digital image, pixel values from saturated pixels within the array comprises comparator circuitry to compare the analog readout signals with a saturation threshold.

14. The integrated-circuit image sensor of claim 11 wherein the circuitry to exclude under-threshold pixel values from the digital image comprises circuitry to exclude, from the digital image, pixel values from pixels in which accumulated photocharge is less than a predetermined threshold.

15. The integrated-circuit image sensor of claim 14 wherein the image generation circuitry to read the pixel array after each of the sub-frame intervals to generate the corresponding sub-frame readouts comprises readout circuitry to generate analog readout signals for respective pixels of the pixel array, and wherein the circuitry to exclude, from the digital image, pixel values from pixels in which accumulated photocharge is less than a predetermined threshold comprises comparator circuitry to compare the analog readout signals with a noise threshold.

16. The integrated-circuit image sensor of claim 14 wherein the image generation circuitry to read the pixel array after each of the sub-frame intervals to generate the corresponding sub-frame readouts comprises readout circuitry to generate digital values for respective pixels of the pixel array, and wherein the circuitry to exclude, from the digital image, pixel values from pixels in which accumulated photocharge is less than a predetermined threshold comprises digital logic to compare the digital values against a digital noise threshold.

17. The integrated-circuit image sensor of claim 11 wherein the image generation circuitry to read the pixel array after each of the sub-frame intervals to generate the corresponding sub-frame readouts comprises readout circuitry to generate digital pixels values for respective pixels of the pixel array, and wherein the circuitry to exclude under-threshold pixel values within the second one of the sub-frame readouts from the digital image comprises circuitry to zero each of the digital pixel values for the second one of the sub-frame readouts that does not exceed a noise threshold.

18. The integrated-circuit image sensor of claim 11 wherein the image generation circuitry to read the pixel array after each of the plurality of sub-frame intervals to generate the corresponding plurality of sub-frame readouts comprises readout circuitry to read the pixel array after a long sub-frame interval having a duration greater than half the frame interval and to read the pixel array after each of a plurality of short sub-frame intervals having a collective duration less than half the frame interval.

19. The integrated-circuit image sensor of claim 11 wherein the image generation circuitry to read the pixel array after each of the plurality of sub-frame intervals to generate the corresponding plurality of sub-frame readouts comprises readout circuitry to:

generate, for an initial one of the sub-frame readouts and a final one of the sub-frame readouts, pixel values corresponding to a totality of photocharge accumulated within the pixel array during the corresponding sub-frame interval; and

generate, for a non-final one of the sub-frame readouts that follows the initial one of the sub-frame readouts, pixel values corresponding to a fraction of photocharge accumulated within the pixel array during the corresponding sub-frame interval;

accumulated within the pixel array during the corresponding sub-frame interval.

20. An integrated-circuit image sensor comprising:

a pixel array;

means for reading the pixel array after each of a plurality of sub-frame intervals to generate a corresponding plurality of sub-frame readouts, the sub-frame intervals transpiring sequentially within a frame interval; and

means for selectively combining the sub-frame readouts to generate a digital image corresponding to the frame interval, including circuitry to exclude from the digital image (i) over-threshold pixel values within a first one of the sub-frame readouts, and (ii) under-threshold pixel values within a second one of the sub-frame readouts.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2019
From: ENDSLEY, JAY; VOGELSANG, THOMAS; SMITH, CRAIG M.; SCHNEIDER, ALEXANDER C.; GUIDASH, MICHAEL
To: RAMBUS INC
Reel/Frame 051068/0583 →
Continuity (5)
Continuation 15759963
Continuation 14995138 · Jan 13, 2016
Provisional Application 62268438 · Dec 16, 2015
Provisional Application 62221421 · Sep 21, 2015
Related Publication 20200036926A1 · Jan 30, 2020