IP Library Granted Patent US 10,863,158
Granted Patent B2
US 10,863,158 · App. 15/593,107 · Granted Dec 8, 2020

Image processing apparatus, image processing method, and program

Inventor: Daisuke Sakamoto (Yokohama, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N9/735H04N1/6005H04N1/6027H04N5/77H04N9/045H04N9/8042H04N19/124H04N19/136H04N19/146H04N19/186H04N19/647H04N19/85H04N19/91H04N1/6077H04N1/648H04N2209/046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,863,158
App. No.
15/593,107
Granted
Dec 8, 2020
Kind
B2
Abstract

The image processing apparatus includes a white balance adjustment circuit configured to adjust a color temperature to RAW data of an image obtained by capturing, a generator circuit configured to generate data of planes for each component of the image from data of which color temperature was adjusted, and a RAW encoding circuit configured to conduct compression encoding of the data of the planes.

Claims (69)

1. An image processing apparatus comprising:

a demosaicing circuit configured to conduct a demosaicing process to generate data of an image in which each pixel contains each of components of a first color, a second color, and a third color from RAW data of a captured image including the components of the first color, the second color, and the third color arranged in a predetermined matrix;

an adjusting circuit configured to adjust a white balance to data subjected to the demosaicing process;

a mosaicing circuit configured to conduct a mosaicing process to regenerate data of the image of the predetermined matrix from the data of which the white balance was adjusted;

a generator circuit configured to generate data of planes for each component of the first color, the second color, and the third color from data subjected to the mosaicing process; and

an encoding circuit configured to conduct compression encoding, after the white balance was adjusted and the mosaicing process was conducted, of the data of the planes for each component of the first color, the second color, and the third color.

2. The image processing apparatus according to claim 1 , wherein

the first color is red, the second color is blue, and the third color is green.

3. The image processing apparatus according to claim 1 , wherein:

the generator circuit includes

a first generator circuit configured to generate data of planes for each component of the first color, the second color, and the third color of the image, and

a second generator circuit configured to generate data of a plane corresponding to a component of luminance of the image and data of a plane corresponding to a component of a color difference; and

the encoding circuit conducts the compression encoding of the data of the plane generated by either one of the first generator circuit or the second generator circuit.

4. The image processing apparatus according to claim 3 , further comprising

a generation control circuit configured to control which one of generation of data of the plane by the first generator circuit and generation of data of the plane by the second generator circuit is to be conducted by the generator circuit depending on a predetermined setting condition.

5. The image processing apparatus according to claim 4 , wherein

the generation control circuit controls the generator circuit to generate data of the plane by the first generator circuit when a compression ratio of compression encoding by the encoding circuit is set to be equal to or lower than a predetermined threshold as the predetermined setting condition and, generate data of the plane by the second generator circuit when the compression ratio is set to be higher than the predetermined threshold as the predetermined setting condition.

6. The image processing apparatus according to claim 4 , wherein

the generation control circuit controls the generator circuit to generate data of the plane by the first generator circuit when material property priority of the image is set as the predetermined setting condition, and generate data of the plane by the second generator circuit when image-quality priority of the image is set as the predetermined setting condition.

7. The image processing apparatus according to claim 4 , wherein

the generation control circuit controls the generator circuit to generate data of the plane by the first generator circuit when the image is a still image as the predetermined setting condition, and generate data of the plane by the second generator circuit when the image is a video image as the predetermined setting condition.

8. The image processing apparatus according to claim 3 , wherein

the data of the plane corresponding to the component of the luminance and the data of the plane corresponding to the component of the color difference are generated by conversion from the data of the planes for each component of the first color, the second color, and the third color.

9. The image processing apparatus according to claim 1 , further comprising

an adjustment control circuit configured to control whether to conduct adjustment of the white balance by the adjusting circuit depending on a predetermined setting condition.

10. The image processing apparatus according to claim 9 , wherein

the adjustment control circuit controls the adjusting circuit to adjust the white balance when the compression ratio of the compression encoding by the encoding circuit is set to be higher than a predetermined threshold as the predetermined setting condition.

11. The image processing apparatus according to claim 9 , wherein

the adjustment control circuit controls the adjusting circuit to adjust the white balance when image-quality priority of the image is set as the predetermined setting condition.

12. The image processing apparatus according to claim 9 , wherein

the adjustment control circuit controls the adjusting circuit to adjust the white balance when the image is a video image as the predetermined setting condition.

13. An image processing system comprising:

an image pickup apparatus; and

a recorder apparatus attachable to and detachable from the image pickup apparatus, wherein

the image pickup device includes a demosaicing circuit configured to conduct a demosaicing process to generate data of an image in which each pixel contains each of components of a first color, a second color, and a third color from RAW data of a captured image including the components of the first color, the second color, and the third color arranged in a predetermined matrix, an adjusting circuit configured to adjust a white balance to data subjected to the demosaicing process, a mosaicing circuit configured to conduct a mosaicing process to regenerate data of the image of the predetermined matrix from the data of which the white balance was adjusted, and a generator circuit configured to generate data of planes for each component of the first color, the second color, and the third color from data subjected to the mosaicing process, and

the recorder apparatus includes an encoding circuit configured to conduct compression encoding, after the white balance was adjusted, of the data of the planes for each component of the first color, the second color, and the third color, and memory configured to record compression-encoded data.

14. The image processing system according to claim 13 , wherein

the generator circuit includes

a first generator circuit configured to generate data of planes for each component of the first color, the second color, and the third color of the image, and

a second generator circuit configured to generate data of a plane corresponding to a component of luminance of the image and data of a plane corresponding to a component of a color difference; and

the encoding circuit conducts the compression encoding of the data of the plane generated by either one of the first generator circuit or the second generator circuit.

15. The image processing system according to claim 14 , wherein

the image pickup device includes a generation control circuit configured to control the generator circuit to generate data of the plane by the first generator circuit when a compression ratio of compression encoding by the encoding circuit is set to be equal to or lower than a predetermined threshold, and generate data of the plane by the second generator circuit when the compression ratio is set to be higher than the predetermined threshold.

16. The image processing system according to claim 13 , wherein the image pickup device includes an adjustment control circuit configured to control the adjusting circuit to adjust the white balance when the compression ratio of the compression encoding by the encoding circuit is set to be higher than a predetermined threshold.

17. An image processing system comprising:

an image pickup apparatus; and

a recorder apparatus attachable to and detachable from the image pickup apparatus, wherein

the image pickup device includes a demosaicing circuit configured to conduct a demosaicing process to generate data of an image in which each pixel contains each of components of a first color, a second color, and a third color from RAW data of a captured image including the components of the first color, the second color, and the third color arranged in a predetermined matrix, an adjusting circuit configured to adjust a white balance to data subjected to the demosaicing process, and a mosaicing circuit configured to conduct a mosaicing process to regenerate data of the image of the predetermined matrix from the data of which the white balance was adjusted by the adjusting circuit, and

the recorder apparatus includes a generator circuit configured to generate data of planes for each component of the first color, the second color, and the third color from data subjected to the mosaicing process, an encoding circuit configured to conduct compression encoding, after the white balance was adjusted and the mosaicing process was conducted, of the data of the planes for each component of the first color, the second color, and the third color, and memory configured to record compression coded data.

18. The image processing system according to claim 17 , wherein

the generator circuit includes

a first generator circuit configured to generate data of planes for each component of the first color, the second color, and the third color of the image, and

a second generator circuit configured to generate data of a plane corresponding to a component of luminance of the image and data of a plane corresponding to a component of a color difference; and

the encoding circuit conducts the compression encoding of the data of the plane generated by either one of the first generator circuit or the second generator circuit.

19. The image processing system according to claim 18 , wherein

the recorder apparatus includes generate data of the plane by the first generator circuit when a compression ratio of compression encoding by the encoding circuit is set to be equal to or lower than a predetermined threshold, and generate data of the plane by the second generator circuit when the compression ratio is set to be higher than the predetermined threshold.

20. The image processing system according to claim 17 , wherein

the image pickup device includes an adjustment control circuit configured to control the adjusting circuit to adjust the white balance when the compression ratio of the compression encoding by the encoding circuit is set to be higher than a predetermined threshold.

21. An image processing method comprising:

conducting a demosaicing process to generate data of an image in which each pixel contains each of components of a first color, a second color, and a third color from RAW data of a captured image including the components of the first color, the second color, and the third color arranged in a predetermined matrix;

adjusting a white balance to data subjected to the demosaicing process;

conducting a mosaicing process to regenerate data of the image of the predetermined matrix from the data of which the white balance was adjusted;

generating data of planes for each component of the first color, the second color, and the third color from data subjected to the mosaicing process; and

compression encoding, after the white balance was adjusted and the mosaicing process was conducted, the data of the planes for each component of the first color, the second color, and the third color.

22. A non-transitory computer-readable storage medium configured to store a program causing a computer to execute an image processing method, the image processing method comprising:

conducting a demosaicing process to generate data of an image in which each pixel contains each of components of a first color, a second color, and a third color from RAW data of a captured image including the components of the first color, the second color, and the third color arranged in a predetermined matrix;

adjusting a white balance to data subjected to the demosaicing process;

generating data of planes for each component of the first color, the second color, and the third color from data subjected to the mosaicing process; and

compression encoding, after the white balance was adjusted and the mosaicing process was conducted, the data of the planes for each component of the first color, the second color, and the third color.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2017
From: SAKAMOTO, DAISUKE
To: CANON KABUSHIKI KAISHA
Reel/Frame 044053/0986 →
Priority Claims (2)
JP 2016-098674 · May 17, 2016 · national
JP 2017-076793 · Apr 7, 2017 · national
Continuity (1)
Related Publication 20170339386A1 · Nov 23, 2017