Native three-color images and high dynamic range images
View Patent ↗Various implementations provide color images, including, for example, RGB images and/or HDR images. In one particular implementation, a color image is created using a first set of color values captured from multiple sensors. Multiple pixel locations of the color image have a color value for three colors that are captured from the multiple sensors. A lens assembly passes light to the multiple sensors. An HDR image is created using a second set of color values captured from the multiple sensors. Another implementation includes a lens assembly and multiple sensors arranged to receive light though the lens assembly. A first set of color values captured from the multiple sensors can be assembled to provide three color values for multiple pixel locations. A second set of color values captured from the multiple sensors can be interpolated to provide an HDR image.
1. A method comprising:
creating a color image using a first set of color values captured from three sensors that are configured to acquire multiple colors and that use filters having three different color patterns from each other, wherein each pixel location of the color image has a color value for three colors, the three color values being captured from the three sensors, wherein each sensor receives a same amount of luminance from a single lens assembly; and
creating a high dynamic range (“HDR”) image using a second set of color values captured from the three sensors of the single lens assembly wherein:
the three sensors include a first sensor, a second sensor, and a third sensor, and
the first sensor is configured to acquire three colors using a three-color pattern,
the second sensor uses a three-color pattern different from the pattern of the first sensor, and
the third sensor uses a three-color pattern different from the pattern of the first sensor and the pattern of the second sensor.
2. The method of claim 1 wherein the three different color patterns include (i) a first pattern that includes red (“R”), green (“G”), and blue (“B”), (ii) a second pattern that includes R, G, and B, and (iii) a third pattern that includes R, G, and B.
3. The method of claim 1 wherein creating the HDR image comprises interpolating the second set of color values to have red (“R”), green (“G”), and blue (“B”) for each pixel locations of the HDR image.
4. The method of claim 1 wherein creating the HDR image comprises interpolating the second set of color values to have red (“R”), green (“G”), and blue (“B”) for all non-edge pixel locations of the HDR image.
5. The method of claim 1 wherein the HDR image comprises:
a higher-luminance area component having pixel values derived from corresponding locations in a first image; and
a lower-luminance area component having pixel values derived from corresponding locations in a second image.
6. The method of claim 5 wherein:
the three sensors include a Bayer-pattern sensor,
the second set of color values includes color values captured from the Bayer-pattern sensor, and
creating the HDR image comprises creating the higher-luminance area component by interpolating the color values in the second set of color values captured from the Bayer-pattern sensor.
7. The method of claim 6 wherein creating the higher-luminance area component further comprises using a neutral density filter in front of at least one of the three sensors.
8. The method of claim 5 wherein:
the three sensors include a first sensor and a second sensor,
the first and second sensors are configured to acquire multiple colors,
creating the HDR image comprises creating the lower-luminance area component by assembling red (“R”), green (“G”), and blue (“B”) color values, from the second set, captured from the first sensor and the second sensor to form R, G, and B patterns that are interpolated using a quincunx algorithm.
9. The method of claim 5 wherein a first sensor pattern allows color values captured from the first sensor to be interpolated to provide red (“R”), green (“G”), and blue (“B”) color values for all interior pixels of the higher-luminance area component,
a second sensor pattern and a third sensor pattern allow color values captured from the second sensor and the third sensor to be assembled and interpolated using a quincunx algorithm to provide R, G, and B color values for all interior pixels of the lower-luminance area component, and
the second sensor pattern and the third sensor pattern allow color values captured from the first sensor, the second sensor, and the third sensor to be assembled to provide captured R, G, and B color values for all interior pixels of an RGB image.
10. The method of claim 1 wherein: the three colors are red (“R”), green (“G”), and blue (“B”), and the color values can be assembled to form an RGB image.
11. The method of claim 1 wherein the method is performed by a camera.
12. An apparatus comprising:
a single lens assembly;
three sensors that receive a same amount of luminance from the single lens assembly and are configured to acquire multiple colors using filters that have three different color patterns from each other, wherein the three sensors capture a first set of color values to create a color image, wherein each pixel location of the color image has a color value for three colors; and
a processor that creates an HDR image using a second set of color values captured from the three sensors wherein:
the three sensors include a first sensor, a second sensor, and a third sensor, and
the first sensor is configured to acquire three colors using a three-color pattern,
the second sensor uses a three-color pattern different from the pattern of the first sensor, and
the third sensor uses a three-color pattern different from the pattern of the first sensor and the pattern of the second sensor.
13. The apparatus of claim 12 wherein:
the HDR image comprises (i) a higher-luminance area component having pixel values derived from corresponding locations in a first image, and (ii) a lower-luminance area component having pixel values derived from corresponding locations in a second image.
14. The apparatus of claim 13 wherein:
the three sensors include a Bayer pattern sensor,
the second set of color values includes color values captured from the Bayer-pattern sensor, and
creating the HDR image comprises creating the higher-luminance area component by interpolating the color values in the second set of color values captured from the Bayer-pattern sensor.
15. The apparatus of claim 14 wherein creating the higher-luminance area component further comprises using a neutral density filter arranged between the lens assembly and one of the three sensors.
16. The apparatus of claim 13 wherein
the three sensors include a first sensor and a second sensor,
the first and second sensors are configured to acquire multiple colors, and
creating the HDR image comprises creating the lower-luminance area component by assembling red (“R”), green (“G”), and blue (“B”) color values, from the second set, captured from the first sensor and the second sensor to form R, G, and B patterns that are interpolated using a quincunx algorithm.
17. The apparatus of claim 13 wherein
a first sensor pattern allows color values captured from the first sensor to be interpolated to provide red (“R”), green (“G”), and blue (“B”) color values for all interior pixels of the higher-luminance area component,
a second sensor pattern and a third sensor pattern allow color values captured from the second sensor and the third sensor to be assembled and interpolated using a quincunx algorithm to provide R, G, and B color values for all interior pixels of the lower-luminance area component, and
the second sensor pattern and the third sensor pattern allow color values captured from the first sensor, the second sensor, and the third sensor to be assembled to provide captured R, G, and B color values for all interior pixels of an RGB image.
18. The apparatus of claim 12 wherein creating the HDR image comprises interpolating the second set of color values to have red (“R”), green (“G”), and blue (“B”) for each pixel locations of the HDR image.
19. The apparatus of claim 12 wherein wherein creating the HDR image comprises interpolating the second set of color values to have red (“R”), green (“G”), and blue (“B”) for all non-edge pixel locations of the HDR image.
20. The apparatus of claim 12 wherein:
the three colors are red (“R”), green (“G”), and blue (“B”), and the color values can be assembled to form an RGB image.
21. The apparatus of claims 12 wherein the apparatus is a camera.