IP Library Granted Patent US 11,115,637
Granted Patent B2
US 11,115,637 · App. 16/716,070 · Granted Sep 7, 2021

Image processing apparatus, image capturing apparatus, image processing method, and storage medium

Inventor: Kotaro Kitajima (Yokohama, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N9/735H04N5/2256H04N5/2621
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,115,637
App. No.
16/716,070
Granted
Sep 7, 2021
Kind
B2
Abstract

There is provided an image processing apparatus comprising. An identification unit identifies a target color that a pixel of a shot image corresponding to an object having a specific color is to have as a result of white balance processing performed on the shot image. A determination unit determines a target region of a virtual light source in the shot image. An image processing unit performs image processing for adding an effect of virtual light irradiation by the virtual light source to the target region. A control unit controls a color of the virtual light source such that a color close to the target color approaches the target color in the target region.

Claims (39)

1. An image processing apparatus comprising at least one processor and/or circuit configured to function as following units:

an identification unit configured to identify a target color that a pixel of a shot image corresponding to an object having a specific color is to have as a result of white balance processing performed on the shot image;

a determination unit configured to determine a target region of a virtual light source in the shot image;

an image processing unit configured to perform image processing for adding an effect of virtual light irradiation by the virtual light source to the target region; and

a control unit configured to control a color of the virtual light source such that a color close to the target color approaches the target color in the target region.

2. The image processing apparatus according to claim 1 ,

wherein the determination unit is configured to determine the target region such that a shadow region in a region of a predetermined object included in the shot image is irradiated.

3. The image processing apparatus according to claim 2 ,

wherein the identification unit is configured to determine the specific color based on a type of the predetermined object.

4. The image processing apparatus according to claim 1 ,

wherein the control unit is configured to control the color of the virtual light source such that the color close to the target color approaches the target color in the target region, based on (i) a difference between an average color of a region, in the target region, having the color close to the target color and the target color and (ii) an intensity of the virtual light source.

5. The image processing apparatus according to claim 1 ,

wherein the identification unit is configured to identify a first target color that a pixel of the shot image corresponding to an object having a first specific color is to have as a result of white balance processing performed on the shot image, and a second target color that a pixel of the shot image corresponding to an object having a second specific color is to have as a result of white balance processing performed on the shot image, and

the control unit is configured to, in a case where a region whose color is close to the first target color in the target region is larger than a threshold value, control the color of the virtual light source such that the color close to the first target color approaches the first target color in the target region, and, in a case where the region whose color is close to the first target color in the target region is smaller than the threshold value, control the color of the virtual light source such that a color close to the second target color approaches the second target color in the target region.

6. The image processing apparatus according to claim 5 ,

wherein the determination unit is configured to determine the target region such that a shadow region in a region of a predetermined object included in the shot image is irradiated,

the first specific color is white, and

the identification unit is configured to determine the second specific color based on a type of the predetermined object.

7. The image processing apparatus according to claim 1 ,

wherein the identification unit identifies white or skin color as the target color.

8. The image processing apparatus according to claim 1 ,

wherein in the case where the object having the specific color is a face, the identification unit identifies skin color as the target color.

9. The image processing apparatus according to claim 1 ,

wherein the identification unit identifies white and skin color as the target color, the white being used preferentially.

10. An image capturing apparatus comprising:

the image processing apparatus according to claim 1 ; and

at least one processor and/or circuit configured to function as following units:

an image capturing unit configured to generate the shot image; and

a white balance unit configured to perform white balance processing on the shot image generated by the image capturing unit.

11. An image processing method executed by an image processing apparatus, comprising:

identifying a target color that a pixel of a shot image corresponding to an object having a specific color is to have as a result of white balance processing performed on the shot image;

determining a target region of a virtual light source in the shot image;

performing image processing for adding an effect of virtual light irradiation by the virtual light source to the target region; and

controlling a color of the virtual light source such that a color close to the target color approaches the target color in the target region.

12. A non-transitory computer-readable storage medium which stores a program for causing a computer to execute an image processing method comprising:

identifying a target color that a pixel of a shot image corresponding to an object having a specific color is to have as a result of white balance processing performed on the shot image;

determining a target region of a virtual light source in the shot image;

performing image processing for adding an effect of virtual light irradiation by the virtual light source to the target region; and

controlling a color of the virtual light source such that a color close to the target color approaches the target color in the target region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2020
From: KITAJIMA, KOTARO
To: CANON KABUSHIKI KAISHA
Reel/Frame 051957/0205 →
Priority Claims (1)
JP JP2018-237617 · Dec 19, 2018 · national
Continuity (1)
Related Publication 20200204775A1 · Jun 25, 2020