Imaging systems with high dynamic range and phase detection pixels
View Patent ↗A pixel may include an inner sub-pixel group and an outer sub-pixel group. The inner sub-pixel group may have a smaller light collecting area than the outer sub-pixel group and therefore be less sensitive to light than the outer sub-pixel group. This may enable the pixel to be used to generate high dynamic range images, even with the sub-pixel groups using the same length integration time. The inner sub-pixel group may be nested within the outer sub-pixel group. Additionally, one or both of the inner sub-pixel group and the outer sub-pixel group can be split into at least two sub-pixels so that the sub-pixel group can be used to gather phase detection data. Adjacent pixels may have sub-pixel groups split in different directions to enable detection of vertical and horizontal edges in a scene.
1. A pixel array comprising a plurality of pixels, wherein each pixel of the plurality of pixels has a structure that follows a pattern, wherein the pattern comprises a repeating unit cell of two-by-two pixels that is repeated across the pixel array, and wherein the repeating unit cell of two-by-two pixels comprises:
first, second, third, and fourth pixels, wherein each pixel comprises an inner sub-pixel group that is nested within an outer sub-pixel group, wherein each outer sub-pixel group comprises first and second outer sub-pixels that are configured to generate phase detection data, wherein the first and second outer sub-pixels of the first pixel have a first orientation, and wherein the first and second outer sub-pixels of the second pixel have a second orientation that is different than the first orientation.
2. The pixel array defined in claim 1 , wherein the first pixel is an upper left pixel of the repeating unit cell of two-by-two pixels, wherein the second pixel is an upper right pixel of the repeating unit cell of two-by-two pixels, wherein the third pixel is a lower left pixel of the repeating unit cell of two-by-two pixels, wherein the fourth pixel is a lower right pixel of the repeating unit cell of two-by-two pixels, and wherein the first orientation is orthogonal to the second orientation.
3. The pixel array defined in claim 2 , wherein the first and second outer sub-pixels of the first pixel are horizontally adjacent and wherein the first and second outer sub-pixels of the second pixel are vertically adjacent.
4. The pixel array defined in claim 3 , wherein the first and second outer sub-pixels of the third pixel are vertically adjacent and wherein the first and second outer sub-pixels of the fourth pixel are horizontally adjacent.
5. The pixel array defined in claim 2 , wherein the first pixel is covered by a green color filter element, wherein the second pixel is covered by a red color filter element, wherein the third pixel is covered by a blue color filter element, and wherein the fourth pixel is covered by a green color filter element.
6. The pixel array defined in claim 1 , wherein the first pixel is an upper left pixel of the repeating unit cell of two-by-two pixels, wherein the second pixel is a lower left pixel of the repeating unit cell of two-by-two pixels, wherein the third pixel is an upper right pixel of the repeating unit cell of two-by-two pixels, wherein the fourth pixel is a lower right pixel of the repeating unit cell of two-by-two pixels, wherein the first and second outer sub-pixels of the first pixel are horizontally adjacent, wherein the first and second outer sub-pixels of the second pixel are vertically adjacent, wherein the first and second outer sub-pixels of the third pixel are horizontally adjacent, and wherein the first and second outer sub-pixels of the fourth pixel are vertically adjacent.
7. The pixel array defined in claim 6 , wherein the first pixel is covered by a green color filter element, wherein the second pixel is covered by a blue color filter element, wherein the third pixel is covered by a red color filter element, and wherein the fourth pixel is covered by a green color filter element.
8. The pixel array defined in claim 1 , wherein each inner sub-pixel group comprises first and second inner sub-pixels that are configured to generate phase detection data.
9. The pixel array defined in claim 8 , wherein the first and second inner sub-pixels of the first pixel have the first orientation and wherein the first and second inner sub-pixels of the second pixel have the second orientation.
10. The pixel array defined in claim 8 , wherein the first and second inner sub-pixels of the first pixel have the second orientation.
11. The pixel array defined in claim 1 , wherein the repeating unit cell of two-by-two pixels further comprises:
a first shielding layer that covers a first half of the inner sub-pixel group of the third pixel; and
a second shielding layer that covers a second half of the inner sub-pixel group of the fourth pixel.
12. A pixel array comprising a plurality of pixels, wherein each pixel of the plurality of pixels has a structure that follows a pattern, wherein the pattern comprises a repeating unit cell of two-by-four pixels that is repeated across the pixel array, and wherein the repeating unit cell of two-by-four pixels comprises:
a first two-by-two group of pixels, wherein the first two-by-two group of pixels includes an upper left pixel, an upper right pixel, a lower left pixel, and a lower right pixel that each have first and second outer sub-pixels and a inner sub-pixel group nested within the first and second outer sub-pixels and wherein the first and second outer sub-pixels in the first two-by-two group are arranged in a respective orientation and are configured to generate phase detection data; and
a second two-by-two group of pixels that is adjacent to the first two-by-two group of pixels, wherein the second two-by-two group of pixels includes an upper left pixel, an upper right pixel, a lower left pixel, and a lower right pixel that each have first and second outer sub-pixels and an inner sub-pixel group nested within the first and second outer sub-pixels, wherein the first and second outer sub-pixels in the second two-by-two group are arranged in a respective orientation and are configured to generate phase detection data, and wherein the orientations of the pixels in the second two-by-two group of pixels are different than the orientations of the pixels in the first two-by-two group of pixels.
13. The pixel array defined in claim 12 , wherein the upper left pixel in the first two-by-two group of pixels has first and second outer sub-pixels arranged in a first orientation, wherein the upper left pixel in the second two-by-two group of pixels has first and second outer sub-pixels arranged in a second orientation, wherein the upper right pixel in the first two-by-two group of pixels has first and second outer sub-pixels arranged in the first orientation, and wherein the upper right pixel in the second two-by-two group of pixels has first and second outer sub-pixels arranged in the second orientation.
14. The pixel array defined in claim 13 , wherein the lower left pixel in the first two-by-two group of pixels has first and second outer sub-pixels arranged in the second orientation, wherein the lower left pixel in the second two-by-two group of pixels has first and second outer sub-pixels arranged in the first orientation, wherein the lower right pixel in the first two-by-two group of pixels has first and second outer sub-pixels arranged in the second orientation, and wherein the lower right pixel in the second two-by-two group of pixels has first and second outer sub-pixels arranged in the first orientation.
15. The pixel array defined in claim 14 , wherein first and second outer sub-pixels arranged in the first orientation are horizontally adjacent and first and second sub-outer pixels arranged in the second orientation are vertically adjacent.
16. The pixel array defined in claim 14 , wherein the first orientation and the second orientation are orthogonal.
17. The pixel array defined in claim 12 , wherein the upper left pixel in the first two-by-two group of pixels has first and second outer sub-pixels arranged in a first orientation, wherein the upper left pixel in the second two-by-two group of pixels has first and second outer sub-pixels arranged in a second orientation, wherein the upper right pixel in the first two-by-two group of pixels has first and second outer sub-pixels arranged in the second orientation, wherein the upper right pixel in the second two-by-two group of pixels has first and second outer sub-pixels arranged in the first orientation, wherein the lower left pixel in the first two-by-two group of pixels has first and second outer sub-pixels arranged in the second orientation, wherein the lower left pixel in the second two-by-two group of pixels has first and second outer sub-pixels arranged in the first orientation, wherein the lower right pixel in the first two-by-two group of pixels has first and second outer sub-pixels arranged in the first orientation, and wherein the lower right pixel in the second two-by-two group of pixels has first and second outer sub-pixels arranged in the second orientation.
18. The pixel array defined in claim 12 , wherein the upper left pixel in the first two-by-two group of pixels and the upper left pixel in the second two-by-two group of pixels are both covered by respective color filter elements of a first color, wherein the upper right pixel in the first two-by-two group of pixels and the upper right pixel in the second two-by-two group of pixels are both covered by respective color filter elements of a second color, wherein the lower left pixel in the first two-by-two group of pixels and the lower left pixel in the second two-by-two group of pixels are both covered by respective color filter elements of a third color, and wherein the lower right pixel in the first two-by-two group of pixels and the lower right pixel in the second two-by-two group of pixels are both covered by respective color filter elements of a fourth color.
19. A pixel array comprising a plurality of pixels, wherein each pixel of the plurality of pixels has a structure that follows a pattern, wherein the pattern comprises a repeating unit cell of two-by-two pixels that is repeated across the pixel array, and wherein the repeating unit cell of two-by-two pixels comprises:
first, second, third, and fourth pixels, wherein each pixel comprises first and second sub-pixels that are configured to generate phase detection data, wherein the first and second sub-pixels are the only sub-pixels formed in each pixel, wherein the first and second sub-pixels of the first pixel have a first orientation, and wherein the first and second sub-pixels of the second pixel have a second orientation that is different than the first orientation.
20. The pixel array defined in claim 19 , wherein the second orientation is perpendicular to the first orientation.