IP Library Granted Patent US 10,798,322
Granted Patent B2
US 10,798,322 · App. 16/140,862 · Granted Oct 6, 2020

High dynamic-range image sensor

Inventors: Craig M. Smith (Spencerport, NY); Frank Armstrong (Rochester, NY); Jay Endsley (Santa Clara, CA); Thomas Vogelsang (Mountain View, CA); James E. Harris (Tyler, TX); John Ladd (Santa Clara, CA); Michael Guidash (Rochester, NY)
Assignee: Rambus Inc.
H04N5/35536H04N5/2355H04N5/23245H04N5/347H04N5/355H04N5/35554H04N5/361H04N5/37457H04N9/045
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,798,322
App. No.
16/140,862
Granted
Oct 6, 2020
Kind
B2
Abstract

A pixel array within an integrated-circuit image sensor is exposed to light representative of a scene during a first frame interval and then oversampled a first number of times within the first frame interval to generate a corresponding first number of frames of image data from which a first output image may be constructed. One or more of the first number of frames of image data are evaluated to determine whether a range of luminances in the scene warrants adjustment of an oversampling factor from the first number to a second number, if so, the oversampling factor is adjusted such that the pixel array is oversampled the second number of times within a second frame interval to generate a corresponding second number of frames of image data from which a second output image may be constructed.

Claims (37)

1. A method of operation within an integrated-circuit image sensor having a pixel array, the method comprising:

exposing the pixel array to light representative of a scene during first and second frame intervals of equal duration;

oversampling the pixel array a first number of times within the first frame interval to generate a corresponding first number of frames of image data from which a first output image may be constructed;

evaluating one or more of the first number of frames of image data to determine whether a range of luminances in the scene warrants adjustment of an oversampling factor from the first number to a different second number; and

oversampling the pixel array the second number of times within the second frame interval to generate a corresponding second number of frames of image data from which a second output image may be constructed if the range of luminances in the scene is determined to warrant adjustment of the oversampling factor.

2. The method of claim 1 wherein evaluating one or more of the first number of frames of image data comprises generating statistics regarding the range of luminances within the scene.

3. The method of claim 2 wherein generating statistics regarding the range of luminances within the scene comprises counting, within the one or more of the first number of frames of image data, occurrences of pixel values within pixel-value ranges that correspond to respective luminance ranges.

4. The method of claim 3 wherein counting occurrences of pixel values within pixel-value ranges that correspond to respective luminance ranges comprises generating respective counts of occurrences of the pixel values within the pixel value ranges for each of a plurality of colors of a color filter array.

5. The method of claim 1 further comprising evaluating the one or more of the first number of frames of image data to determine whether the range of luminances in the scene warrants adjustment of (i) the second frame interval such that the second frame interval is longer or shorter than the first frame interval, (ii) a lens aperture or (iii) a signal gain applied when sampling individual pixels of the pixel array.

6. The method of claim 1 wherein oversampling the pixel array the first number of times to generate the first number of frames of image data comprises generating each of the first number of frames of image data in accordance with a first scan sequence definition selected from a predetermined set of scan sequence definitions, and oversampling the pixel array the second number of times to generate the second number of frames of image data comprises generating each of the second number of frames of image data in accordance with a second scan sequence definition selected from the predetermined set of scan sequence definitions.

7. The method of claim 6 wherein each scan sequence definition within the predetermined set of scan sequence definitions, including the first and second scan sequence definitions, indicates, as an oversampling factor for the scan sequence, a number of frames of image data to be generated and respective subexposure durations corresponding to each of the frames of image data.

8. The method of claim 7 wherein the subexposure durations indicated by each scan sequence definition within the predetermined set of scan sequence definitions sum to a frame-interval duration that matches the duration of each of the first and second frame intervals.

9. The method of claim 8 wherein each of the scan sequence definitions which indicate that the pixel array is to be oversampled during the frame-interval duration constitute respective oversampling scan sequence definitions, each of the oversampling scan sequence definitions specifying at least one long subexposure and a nonzero number of short subexposures that is different from the number of short subexposures within at least one other of the oversampling scan sequence definitions.

10. The method of claim 9 wherein the at least one long subexposure duration is specified to be the same in each of the oversampling scan sequence definitions, and wherein the duration of each of the nonzero number of short subexposures for at least one of the oversampling scan sequence definitions is uniform and different from a uniform duration of each of the nonzero number of short subexposures for at least one other of the oversampling scan sequence definitions.

11. An integrated-circuit image sensor comprising:

a pixel array; and

read-out circuitry to:

expose the pixel array to light representative of a scene during first and second frame intervals of equal duration;

oversample the pixel array a first number of times within the first frame interval to generate a corresponding first number of frames of image data from which a first output image may be constructed;

evaluate one or more of the first number of frames of image data to determine whether a range of luminances in the scene warrants adjustment of an oversampling factor from the first number to a different second number; and

oversample the pixel array the second number of times within the second frame interval to generate a corresponding second number of frames of image data from which a second output image may be constructed if the range of luminances in the scene is determined to warrant adjustment of the oversampling factor.

12. The integrated-circuit image sensor of claim 11 wherein the read-out circuitry to evaluate one or more of the first number of frames of image data comprises histogram circuitry to generate statistics regarding the range of luminances within the scene.

13. The integrated-circuit image sensor of claim 12 wherein the histogram circuitry to generate statistics regarding the range of luminances within the scene comprises circuitry to count, within the one or more of the first number of frames of image data, occurrences of pixel values within pixel-value ranges that correspond to respective luminance ranges.

14. The integrated-circuit image sensor of claim 13 wherein the circuitry to count occurrences of pixel values within pixel-value ranges that correspond to respective luminance ranges comprises circuitry to generate respective counts of occurrences of the pixel values within the pixel value ranges for each of a plurality of colors of a color filter array.

15. The integrated-circuit image sensor of claim 11 wherein the read-out circuitry comprises auto-exposure control circuitry to evaluate the one or more of the first number of frames of image data to determine whether the range of luminances in the scene warrants adjustment of (i) the second frame interval such that the second frame interval is longer or shorter than the first frame interval, (ii) a lens aperture or (iii) a signal gain applied when sampling individual pixels of the pixel array.

16. The integrated-circuit image sensor of claim 11 wherein the read-out circuitry to oversample the pixel array the first number of times and the second number of times comprises scan sequence selection circuitry to generate each of the first number of frames of image data and second number of frames of image data in accordance with respective first and second scan sequence definitions selected from a predetermined set of scan sequence definitions.

17. The integrated-circuit image sensor of claim 16 wherein each scan sequence definition within the predetermined set of scan sequence definitions, including the first and second scan sequence definitions, indicates, as an oversampling factor for the scan sequence, a number of frames of image data to be generated and respective subexposure durations corresponding to each of the frames of image data.

18. The integrated-circuit image sensor of claim 17 wherein the subexposure durations indicated by each scan sequence definition within the predetermined set of scan sequence definitions sum to a frame-interval duration that matches the duration of each of the first and second frame intervals.

19. The integrated-circuit image sensor of claim 18 wherein each of the scan sequence definitions which indicate that the pixel array is to be oversampled during the frame-interval duration constitute respective oversampling scan sequence definitions, each of the oversampling scan sequence definitions specifying at least one long subexposure and a nonzero number of short subexposures that is different from the number of short subexposures within at least one other of the oversampling scan sequence definitions.

20. The integrated-circuit image sensor of claim 19 wherein the at least one long subexposure duration is specified to be the same in each of the oversampling scan sequence definitions, and wherein the duration of each of the nonzero number of short subexposures for at least one of the oversampling scan sequence definitions is uniform and different from a uniform duration of each of the nonzero number of short subexposures for at least one other of the oversampling scan sequence definitions.

21. An integrated-circuit image sensor comprising:

a pixel array; and

means for:

exposing the pixel array to light representative of a scene during first and second frame intervals of equal duration;

oversampling the pixel array a first number of times within the first frame interval to generate a corresponding first number of frames of image data from which a first output image may be constructed;

evaluating one or more of the first number of frames of image data to determine whether a range of luminances in the scene warrants adjustment of an oversampling factor from the first number to a different second number; and

oversampling the pixel array the second number of times within the second frame interval to generate a corresponding second number of frames of image data from which a second output image may be constructed if the range of luminances in the scene is determined to warrant adjustment of the oversampling factor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2019
From: SMITH, CRAIG M.; ARMSTRONG, FANK; ENDSLEY, JAY; VOGELSANG, THOMAS; LADD, JOHN; GUIDASH, MICHAEL; HARRIS, JAMES E.
To: RAMBUS INC
Reel/Frame 051026/0333 →
Continuity (6)
Continuation 15100976
Provisional Application 61911575 · Dec 4, 2013
Provisional Application 61911579 · Dec 4, 2013
Provisional Application 61914394 · Dec 11, 2013
Provisional Application 61918382 · Dec 19, 2013
Related Publication 20190082125A1 · Mar 14, 2019
Cited By (9)
US 12,279,055 US 12,328,519 US 12,335,641 US 12,342,091 US 12,395,752 US 12,495,227 US 12,593,125 US 12,598,402 US 12,610,163