Compression and decoding of single sensor color image data
View Patent ↗A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.
1. A method for editing captured image data, the method comprising:
receiving, by an image processing system, image data corresponding to a first resolution captured by an image sensor of a camera, the image data comprising a plurality of image planes;
encoding, by the image processing system, a subset of the image planes to produce a preview image at a second resolution that is lower than the first resolution, the subset of the image planes each corresponding to a different color component associated with the image data;
receiving, by the image processing system, an edit operation to the preview image; and
providing, by the image processing system, the image data and the received edit to an editing system, the editing system configured to decode the subset of the image planes to produce an image at the first resolution and to perform the received edit operation on the image at the first resolution.
2. The method of claim 1 , wherein the encoding of the subset of the plurality of image planes comprises encoding all of the plurality of image planes.
3. The method of claim 1 , wherein the encoding of the subset of the plurality of image planes comprises encoding fewer than all of the plurality of image planes.
4. The method of claim 1 , wherein the encoding of the subset of the image planes comprises combining the subset of the image planes to produce the preview image.
5. The method of claim 1 , wherein the received edit operation comprises identifying a subset of the image data.
6. The method of claim 5 , further comprising performing a de-Bayer operation only on the identified subset of the image data.
7. The method of claim 5 , further comprising providing only the identified subset of the image data to the editing system.
8. A system for editing image data, the system comprising:
an input configured to receive image data corresponding to a first resolution captured by an image sensor of a camera, the image data comprising a plurality of image planes;
a processor configured to:
encode a subset of the image planes to produce a preview image at a second resolution that is lower than the first resolution, each of the subset of the image planes corresponding to a different color component associated with the image data; and
receive an edit operation to the preview image; and
an output configured to provide the image data and the received edit to an editing system, the editing system configured to decode the subset of the image planes to produce an image at the first resolution and to perform the received edit operation on the image at the first resolution.
9. The system of claim 8 , wherein the subset of the plurality of image planes comprises all of the plurality of image planes.
10. The system of claim 8 , wherein the subset of the plurality of image planes comprises less than all of the plurality of image planes.
11. The system of claim 8 , wherein the encode of the subset of the image planes comprises combining the subset of image planes to produce the preview image.
12. The system of claim 8 , wherein the received edit operation identifies a subset of the image data.
13. The system of claim 12 , wherein the editing system performs a de-Bayer operation only on the identified subset of the image data.
14. The system of claim 12 , wherein the image processing system provides only the identified subset of the image data to the editing system.
15. A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by a hardware processor, cause an image processing system to:
receive, by the image processing system, image data corresponding to a first resolution captured by an image sensor of a camera, the image data comprising a plurality of image planes;
encode, by the image processing system, a subset of the image planes, each of the subset corresponding to a different color component associated with the image data, to produce a preview image at a second resolution that is lower than the first resolution;
receive, by the image processing system, an edit operation to the preview image; and
provide, by the image processing system, the image data and the received edit to an editing system, the editing system configured to decode the subset of the image planes to produce an image at the first resolution and to perform the received edit operation on the image at the first resolution.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the subset of the plurality of image planes comprises all of the plurality of image planes.
17. The non-transitory computer-readable storage medium of claim 15 , wherein the subset of the plurality of image planes comprises less than all of the plurality of image planes.
18. The non-transitory computer-readable storage medium of claim 15 , wherein the encode of the subset of image planes comprises combining the subset of image planes to produce the preview image.
19. The non-transitory computer-readable storage medium of claim 15 , wherein the received edit operation identifies a subset of the image data.
20. The non-transitory computer-readable storage medium of claim 19 , wherein the editing system performs a de-Bayer operation only on the identified subset of the image data.
21. The non-transitory computer-readable storage medium of claim 19 , wherein the image processing system provides only the identified subset of the image data to the editing system.