Advanced raw conversion to produce high dynamic range, wide color gamut output
Described are examples for generating high dynamic range (HDR)/wide color gamut (WCG) output from an image sensor. A raw red, green, blue (RGB) image obtained by the image sensor can be received. A plurality of color transform operations can be applied to the raw RGB image to generate a HDR/WCG image. The HDR/WCG image can be stored in a memory, displayed on a display, transmitted to another device, etc.
1. A method for generating high dynamic range (HDR)/wide color gamut (WCG) output from an image sensor, comprising:
receiving a raw red, green, blue (RGB) image obtained by the image sensor;
applying, by a processor, a plurality of color transform operations to the raw RGB image to generate a HDR/WCG image, wherein applying the plurality of color transform operations comprises:
applying a wide-gamut RGB color space transform operation to the raw RGB image to produce a wide-gamut RGB image;
applying a BT.2020 transform operation to hop the wide-gamut RGB image to a second wide-gamut RGB image; and
converting the second wide-gamut RGB image to the HDR/WCG image in a YCbCr color space using a linear conversion matrix; and
storing, by the processor, the HDR/WCG image in a memory.
2. The method of claim 1 , further comprising at least one of scaling the wide-gamut RGB image before applying the second color space transform operation, or scaling the second wide-gamut RGB image before converting to the HDR/WCG image.
3. The method of claim 1 , wherein the wide-gamut RGB color space transform operation is a ProPhoto RGB transform operation.
4. The method of claim 1 , wherein the wide-gamut RGB color space transform operation outputs a 10-bit image, the second color space transform operation outputs a 10-bit image, and the HDR/WCG image is a 10-bit image.
5. The method of claim 1 , wherein the wide-gamut RGB color space transform operation outputs a 12-bit image, the second color space transform operation outputs a 12-bit image, and the HDR/WCG image is a 12-bit image.
6. The method of claim 1 , further comprising applying a gamma correction operation to the HDR/WCG image after applying one or more of a sharpening operation, a color noise (or other types of noise) reduction operation, or a scaling operation to the HDR/WCG image.
7. The method of claim 1 , wherein receiving the raw RGB image comprises receiving a digital negative (DNG) container including the raw RGB image.
8. The method of claim 1 , further comprising at least one of displaying, on a display, or transmitting, to another device, the HDR/WCG image from the memory.
9. A device for generating high dynamic range (HDR) and wide color gamut (WCG) output, comprising:
an image sensor configured to capture one or more raw red, green, blue (RGB) images;
a memory for storing one or more parameters or instructions for converting the one or more raw RGB images to HDR/WCG images; and
at least one processor coupled to the memory, wherein the at least one processor is configured to:
receive a raw RGB image obtained by the image sensor;
apply a plurality of color transform operations to the raw RGB image to generate a HDR/WCG image, wherein applying the plurality of color transform operations comprises:
applying a wide-gamut RGB color space transform operation to the raw RGB image to produce a wide-gamut RGB image;
applying a BT.2020 transform operation to hop the wide-gamut RGB image to a second wide-gamut RGB image; and
converting the second wide-gamut RGB image to the HDR/WCG image in a YCbCr color space using a linear conversion matrix; and
store the HDR/WCG image in the memory.
10. The device of claim 9 , wherein the at least one processor is further configured to at least one of scale the wide-gamut RGB image before applying the second color space transform operation, or scale the second wide-gamut RGB image before converting to the HDR/WCG image.
11. The device of claim 9 , wherein the wide-gamut RGB color space transform operation is a ProPhoto RGB transform operation.
12. The device of claim 9 , wherein the wide-gamut RGB color space transform operation outputs a 10-bit image, the second color space transform operation outputs a 10-bit image, and the HDR/WCG image is a 10-bit image.
13. The device of claim 9 , wherein the wide-gamut RGB color space transform operation outputs a 12-bit image, the second color space transform operation outputs a 12-bit image, and the HDR/WCG image is a 12-bit image.
14. The device of claim 9 , wherein the at least one processor is further configured to apply a gamma correction operation to the HDR/WCG image after applying one or more of a sharpening operation, a color noise (or other types of noise) reduction operation, or a scaling operation to the HDR/WCG image.
15. The device of claim 9 , wherein the at least one processor is configured to receive the raw RGB image as a digital negative (DNG) container including the raw RGB image.
16. The device of claim 9 , further comprising at least one of a display for displaying the HDR/WCG image from the memory, or a transceiver for transmitting, to another device, the HDR/WCG image from the memory.
17. A non-transitory computer-readable medium, comprising code executable by one or more processors for generating high dynamic range (HDR)/wide color gamut (WCG) output from an image sensor, the code comprising code for:
receiving a raw red, green, blue (RGB) image obtained by the image sensor;
applying a plurality of color transform operations to the raw RGB image to generate a HDR/WCG image, wherein applying the plurality of color transform operations comprises:
applying a wide-gamut RGB color space transform operation to the raw RGB image to produce a wide-gamut RGB image;
applying a BT.2020 transform operation to hop the wide-gamut RGB image to a second wide-gamut RGB image; and
converting the second wide-gamut RGB image to the HDR/WCG image in a YCbCr color space using a linear conversion matrix; and
storing the HDR/WCG image in a memory.
18. The non-transitory computer-readable medium of claim 17 , further comprising code for at least one of scaling the wide-gamut RGB image before applying the second color space transform operation, or scaling the second wide-gamut RGB image before converting to the HDR/WCG image.
19. The non-transitory computer-readable medium of claim 17 , wherein the wide-gamut RGB color space transform operation is a ProPhoto RGB transform operation.
20. The non-transitory computer-readable medium of claim 17 , wherein the wide-gamut RGB color space transform operation outputs a 10-bit image, the second color space transform operation outputs a 10-bit image, and the HDR/WCG image is a 10-bit image.