Compression and decoding of single sensor color image data
A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.
1. A method for compressing an image, comprising:
receiving raw sensor data that has been captured by an imaging sensor, the raw sensor data comprised of a plurality of arrays of imaging components, each of the plurality of arrays configured to generate a first imaging component, a second imaging component, a third imaging component and a fourth imaging component;
summing the second imaging component with the third imaging component in order to generate a first modified image plane;
subtracting the third imaging component from the second imaging component in order to generate a second modified image plane;
subtracting the first modified image plane from at least the first imaging component in order to generate a third modified image plane;
subtracting the first modified image plane from at least the fourth imaging component in order to generate a fourth modified image plane; and
outputting the first, second, third, and fourth modified image planes.
2. The method of claim 1 , further comprising encoding each of the output first, second, third, and fourth modified image planes independent of other ones of the modified image planes.
3. The method of claim 2 , wherein the encoding comprises using a wavelet compression technology.
4. The method of claim 2 , wherein the encoding comprises using a Discrete Cosine Transform (DCT) compression technology.
5. The method of claim 1 , further comprising separating the received raw sensor data into the first imaging component, the second imaging component, the third imaging component and the fourth imaging component.
6. The method of claim 5 , wherein the separating of the received raw sensor data comprises separating the received raw sensor data into three color primaries.
7. A non-transitory computer readable apparatus comprising a storage medium adapted to store a computer program, the computer program being configured to, when executed, cause an imaging apparatus to:
receive raw sensor data that has been captured by an imaging sensor, the raw sensor data comprised of a plurality of arrays of imaging components, each of the plurality of arrays configured to generate a first imaging component, a second imaging component, a third imaging component and a fourth imaging component;
sum the second imaging component with the third imaging component in order to generate a first modified image plane;
subtract the third imaging component from the second imaging component in order to generate a second modified image plane;
subtract the first modified image plane from at least the first imaging component in order to generate a third modified image plane;
subtract the first modified image plane from at least the fourth imaging component in order to generate a fourth modified image plane; and
output the first, second, third, and fourth modified image planes.
8. The non-transitory computer readable apparatus of claim 7 , wherein the computer program, which when executed is further configured to cause the imaging apparatus to encode each of the output first, second, third, and fourth modified image planes independent of other ones of the modified image planes.
9. The non-transitory computer readable apparatus of claim 8 , wherein the encode uses a wavelet compression technology.
10. The non-transitory computer readable apparatus of claim 8 , wherein the encode uses a Discrete Cosine Transform (DCT) compression technology.
11. The non-transitory computer readable apparatus of claim 7 , wherein the computer program, which when executed is further configured to cause the imaging apparatus to separate the received raw sensor data into the first imaging component, the second imaging component, the third imaging component and the fourth imaging component.
12. The non-transitory computer readable apparatus of claim 11 , wherein the separation of the received raw sensor data comprises separation of the received raw sensor data into three color primaries.
13. An imaging decoder system, comprising:
an input interface configured to receive four quarter-resolution planes, the four quarter-resolution planes comprising:
a first modified image plane, the first modified image plane comprising a sum of a second imaging component with a third imaging component;
a second modified image plane, the second modified image plane comprising a subtraction of the third imaging component and the second imaging component;
a third modified image plane, the third modified image plane comprising a subtraction of a first imaging component from the first modified image plane; and
a fourth modified image plane, the fourth modified image plane comprising a subtraction of a fourth imaging component from the first modified image plane; and
a decoder apparatus, the decoder apparatus configured to reconstruct the four quarter-resolution planes into: (i) a first image that is a quarter of its native resolution, and/or (ii) a second image that comprises the native resolution.
14. The imaging decoder system of claim 13 , wherein the reconstruction of the first image that is the quarter of the native resolution comprises:
division of the third modified image plane by a factor of two;
division of the first modified image plane by a factor of two; and
division of the fourth modified image plane by a factor of two.
15. The imaging decoder system of claim 13 , wherein the reconstruction of the second image that comprises the native resolution comprises:
a decode of the first modified image plane;
a decode of the second modified image plane;
a decode of the third modified image plane; and
a decode of the fourth modified image plane.
16. The imaging decoder system of claim 15 , wherein the decode of the first, second, third, and fourth modified image planes results in generation of the first imaging component, the second imaging component, the third imaging component, and the fourth imaging component.
17. The imaging decoder system of claim 16 , wherein the decoder apparatus is further configured to interleave the generated first imaging component, the generated second imaging component, the generated third imaging component, and the generated fourth imaging component.
18. The imaging decoder system of claim 17 , wherein the result of the interleave comprises an original Bayer layout of a captured image.
19. The imaging decoder system of claim 18 , wherein the decoder apparatus is further configured to perform a de-Bayer operation on the original Bayer layout in order to generate a full raster RGB frame.
20. The imaging decoder system of claim 19 , further comprising an output, the output configured to provide the full raster RGB frame.