Compression and decoding of single sensor color image data
View Patent ↗A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.
1. A method for decoding an image comprising:
accessing a first encoded image plane comprising of a sum of image planes representative of a first color, a second encoded image plane comprising a difference between image planes representative of the first color, a third encoded image plane comprising a difference between an image plane of a second color and an image plane of the first color, and a fourth encoded image plane comprising a difference between an image plane of a third color and an image plane of the first color;
in a first operating mode:
decoding the first encoded image plane, the third encoded image plane, and the fourth encoded image plane to form a first set of decoded image planes; and
combining the first set of decoded image planes to form a first decoded image; and
in a second operating mode:
decoding the first encoded image plane, the second encoded image plane, the third encoded image plane, and the fourth encoded image plane to form a second set of decoded image planes; and
combining the second set of decoded image planes to form a second decoded image.
2. The method of claim 1 , wherein combining the first set of decoded image planes comprises bypassing de-Bayer filtering of the first set of decoded image planes.
3. The method of claim 1 , wherein combining the second set of decoded image planes comprises performing de-Bayer filtering on the second set of decoded image planes.
4. The method of claim 1 , wherein the first color comprises green, wherein the second color comprises red, and wherein the third color comprises blue.
5. The method of claim 1 , wherein the second decoded image comprises a higher resolution image than the first decoded image.
6. A system for decoding an image comprising:
an input configured to access a first encoded image plane comprising of a sum of image planes representative of a first color, a second encoded image plane comprising a difference between image planes representative of the first color, a third encoded image plane comprising a difference between an image plane of a second color and an image plane of the first color, and a fourth encoded image plane comprising a difference between an image plane of a third color and an image plane of the first color; and
a decoder configured to decode a set of encoded image planes to produce a set of decoded image planes and to combine the set of decoded image planes to produce a decoded image, wherein in a first decoder operating mode, the set of encoded image planes comprises the first encoded image plane, the third encoded image plane, and the fourth encoded image plane, and wherein in a second decoder operating mode, the set of encoded image planes comprises the first encoded image plane, the second encoded image plane, the third encoded image plane, and the fourth encoded image plane; and
an output configured to store the decoded image in a memory.
7. The system of claim 6 , wherein the decoder is configured to bypass de-Bayer filtering of the set of decoded image planes when combining the set of decoded image planes in the first decoder operating mode.
8. The system of claim 6 , wherein the decoder is configured to perform de-Bayer filtering on the set of decoded image planes when combining the set of decoded image planes in the second decoder operating mode.
9. The system of claim 6 , wherein the first color comprises green, wherein the second color comprises red, and wherein the third color comprises blue.
10. The system of claim 6 , wherein the second decoded image comprises a higher resolution image than the first decoded image.
11. A method for decoding an image comprising:
accessing an encoded image comprising:
a first encoded image plane comprising image information representative of a difference between a second color and a first color;
a second encoded image plane comprising image information representative of a difference between a third color and the first color; and
a third encoded image plane and a fourth encoded image plane each comprising image information representative of the first color;
decoding the first encoded image plane to form a first decoded image plane;
decoding the second encoded image plane to form a second decoded image plane;
decoding one of the third encoded image plane and the fourth encoded image plane to form a third decoded image plane; and
combining the first decoded image plane, the second decoded image plane, and the third decoded image plane to produce a decoded image.
12. The method of claim 11 , wherein combining the decoded image planes comprises bypassing de-Bayer filtering of the decoded image planes.
13. The method of claim 11 , wherein combining the decoded image planes comprises combining for each pixel in the image, corresponding pixel information in the first decoded image plane, the second decoded image plane, and the third decoded image plane.
14. The method of claim 13 , wherein combining pixel information comprises interleaving pixel information in the first decoded image plane, the second decoded image plane, and the third decoded image plane.
15. The method of claim 11 , wherein the first color comprises green, wherein the second color comprises red, and wherein the third color comprises blue.
16. A system for decoding an image comprising:
an input configured to access an encoded image comprising:
a first encoded image plane comprising image information representative of a difference between a second color and a first color;
a second encoded image plane comprising image information representative of a difference between a third color and the first color; and
a third encoded image plane and a fourth encoded image plane each comprising image information representative of the first color;
a decoder configured to:
decode the first encoded image plane to form a first decoded image plane;
decode the second encoded image plane to form a second decoded image plane;
decode one of the third encoded image plane and the fourth encoded image plane to form a third decoded image plane; and
combine the first decoded image plane, the second decoded image plane, and the third decoded image plane to produce a decoded image; and
an output configured to store the decoded image in a memory.
17. The system of claim 16 , wherein combining the decoded image planes comprises bypassing de-Bayer filtering of the decoded image planes.
18. The system of claim 16 , wherein combining the decoded image planes comprises combining for each pixel in the image, corresponding pixel information in the first decoded image plane, the second decoded image plane, and the third decoded image plane.
19. The system of claim 18 , wherein combining pixel information comprises interleaving pixel information in the first decoded image plane, the second decoded image plane, and the third decoded image plane.
20. The system of claim 16 , wherein the first color comprises green, wherein the second color comprises red, and wherein the third color comprises blue.