Systems and methods for generating a high-dynamic range (HDR) pixel stream
A system, method, and computer program product are provided for high-dynamic range images. In use, a first pixel attribute of a first pixel is received and a second pixel attribute of a second pixel is received. Next, a scalar based on the first pixel attribute and the second pixel attribute is identified. Finally, the first pixel and the second pixel are blended, based on the scalar, wherein the first pixel is brighter than the second pixel. Additional systems, methods, and computer program products are also presented.
1 . An apparatus, comprising:
an image sensor including a plurality of cells including: a first cell having a first photodiode, and a second cell having a second photodiode, for being utilized to generate at least a portion of one or more line analog signals;
a line in communication with the plurality of cells, the line communicating the one or more line analog signals;
at least one analog-to-digital channel in communication with the line, the at least one analog-to-digital channel receiving at least one of the one or more line analog signals for conversion thereof, where the at least one analog-to-digital channel outputs a first line digital signal and a second line digital signal; and
circuitry in communication with the at least one analog-to-digital channel, the circuitry receiving at least one of the first line digital signal or the second line digital signal, for image generation;
wherein the apparatus is configured such that:
at least a portion of a first image is generated utilizing a first analog signal of at least three analog signals;
at least a portion of a second image is generated utilizing a second analog signal of the at least three analog signals;
at least a portion of a third image is generated utilizing a third analog signal of the at least three analog signals;
at least a portion of a fourth image is generated based on the at least portion of the second image and the at least portion of the third image; and
at least a portion of a fifth image is generated based on the at least portion of the first image and the at least portion of the fourth image.
2 . The apparatus of claim 1 , wherein the apparatus is configured such that:
the second image and the third image are generated utilizing different gains.
3 . The apparatus of claim 2 , wherein the apparatus is configured such that the different gains are applied before a read out of the second analog signal and the third analog signal.
4 . The apparatus of claim 1 , wherein the apparatus is configured such that:
the first image is generated utilizing an exposure duration that differs from that which is utilized for generating at least one of the second image or the third image.
5 . The apparatus of claim 1 , wherein the apparatus is configured such that:
the first image is generated utilizing an exposure duration that differs from that which is utilized for generating the second image and the third image.
6 . The apparatus of claim 1 , wherein the apparatus is configured such that:
a first gain is applied to the first analog signal;
a second gain, that is different than the first gain, is applied to the second analog signal; and
a third gain, that is different than the first gain and the second gain, is applied to the third analog signal.
7 . The apparatus of claim 6 , wherein the apparatus is configured such that the first gain is greater than the second gain and the third gain, and the second gain is greater than the third gain.
8 . The apparatus of claim 6 , wherein the apparatus is configured such that the first gain, the second gain, and the third gain are applied to different analog signals before a read out of the different analog signals.
9 . The apparatus of claim 6 , wherein the apparatus is configured such that the third gain is applied to the third analog signal after a read out of the third analog signal.
10 . The apparatus of claim 1 , wherein the apparatus is configured such that only the first image is generated in response to detection of user shutter control input.
11 . The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the first image is generated in response to detection of user shutter control input, and the at least portion of the second image and the at least portion of the third image, are not generated in response to the detection of user shutter control input.
12 . The apparatus of claim 1 , wherein the apparatus is configured such that different adjacent cells of the image sensor correspond with a same color of light, and are subject to, for the first image, the second image, and the third image: a corresponding sampling for which one or more analog signals generated by each of the different adjacent cells corresponding with the same color of light are sampled and combined before being utilized to generate at least a portion of at least one first line analog signal.
13 . The apparatus of claim 1 , wherein the apparatus is configured such that different adjacent cells of the image sensor correspond with a same color of light, and are subject to, for at least one of: the first image, the second image, or the third image: a corresponding sampling for which one or more analog signals generated by each of the different adjacent cells corresponding with the same color of light are sampled and combined before being utilized to generate at least a portion of at least one first line analog signal.
14 . The apparatus of claim 1 , wherein the apparatus is configured such that, for the first image, the second image, and the third image: corresponding analog signals generated by different cells of a first line corresponding with a same color of light are combined with corresponding analog signals generated by other different cells of a second line corresponding with the same color of light, before digital conversion thereof.
15 . The apparatus of claim 1 , wherein the apparatus is configured such that, for at least one of: the first image, the second image, or the third image: corresponding analog signals generated by different cells of a first line corresponding with a same color of light are combined with corresponding analog signals generated by other different cells of a second line corresponding with the same color of light, before digital conversion thereof.
16 . The apparatus of claim 1 , wherein the apparatus is configured such that:
the at least portion of the fourth image is generated by combining the at least portion of the second image and the at least portion of the third image; and
the at least portion of the fifth image is generated by combining the at least portion of the first image and the at least portion of the fourth image.
17 . The apparatus of claim 1 , wherein the apparatus is configured such that:
the at least portion of the fourth image is generated by combining the at least portion of the third image, and at least portions of a plurality of the second images generated utilizing a plurality of the second analog signals that are different and that are generated by sampling with the second exposure time; and
the at least portion of the fifth image is generated by combining the at least portion of the first image and the at least portion of the fourth image, where the first image is the only image for which portions thereof are combined with portions of the fourth image.
18 . The apparatus of claim 1 , wherein the apparatus is configured such that:
the first image is one of a plurality of the first images that are captured, where the first image is selected from the plurality of the first images based on an analysis thereof.
19 . The apparatus of claim 1 , wherein the apparatus is configured such that:
the first image is one of a plurality of the first images that are captured;
the at least portion of the fourth image is generated by combining the at least portion of the third image, and at least portions of a plurality of the second images generated utilizing a plurality of the second analog signals that are different and that are generated by sampling with the second exposure time; and
the plurality of the first images are captured and processed in an alternatively interleaved order with respect to the plurality of the second images.
20 . The apparatus of claim 1 , wherein the apparatus is configured such that:
a first weight is utilized for the at least portion of the first image and a second weight, that is different than the first weight, is utilized for the at least portion of the fourth image.
21 . The apparatus of claim 1 , wherein the apparatus is configured such that:
a first weight is utilized by being applied for a first pixel attribute for the at least portion of the first image that includes a single pixel of the first image; and
a second weight, that is different than the first weight, is utilized by being applied for a second pixel attribute for the at least portion of the fourth image that includes a single pixel of the fourth image.
22 . The apparatus of claim 21 , wherein the apparatus is configured such that:
at least one of the first pixel attribute or the second pixel attribute includes at least one of a tone attribute, a color attribute, or a luminance attribute; and
at least one other of the first pixel attribute or the second pixel attribute includes another attribute different than the tone attribute, the color attribute, and the luminance attribute.
23 . The apparatus of claim 21 , wherein the apparatus is configured such that:
at least one of the first pixel attribute or the second pixel attribute includes at least one of a color attribute, or a luminance attribute; and
at least one other of the first pixel attribute or the second pixel attribute includes another attribute.
24 . The apparatus of claim 21 , wherein the apparatus is configured such that:
at least one of the first pixel attribute or the second pixel attribute includes at least one of a color attribute, or a luminance attribute; and
at least one other of the first pixel attribute or the second pixel attribute includes a detail attribute.
25 . The apparatus of claim 1 , wherein the apparatus is configured such that:
first weights are utilized by being applied for first pixel attributes for the at least portion of the fourth image and second weights, that are different than the first weights, are utilized by being applied for second pixel attributes for the at least portion of the first image, to generate the at least portion of the fifth image.
26 . The apparatus of claim 1 , wherein the apparatus is configured such that:
a first one of the first weights is applied for a first one of the first pixel attributes that includes a color attribute, and a second one of the first weights is applied for a second one of the first pixel attributes that includes a luminance attribute.
27 . The apparatus of claim 1 , wherein the apparatus is configured such that:
different gains are applied to the second analog signal and the third analog signal.