IP Library Granted Patent US 11,330,177
Granted Patent B2
US 11,330,177 · App. 16/961,165 · Granted May 10, 2022

Image processing apparatus and image processing method

Inventor: Takanobu Kobashiri (Kanagawa, JP)
Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
H04N5/23245G06F3/04842G06F3/04845G06T11/001H04N5/232933
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,330,177
App. No.
16/961,165
Granted
May 10, 2022
Kind
B2
Abstract

An apparatus and a method for generating a high-quality one point color image are provided. A composite image generation unit that generates a composite image by executing composition processing using a color image and a monochrome image captured from different viewpoints, and an output image generation unit that generates a one point color image in which only a partial area of the image is colored are included. The output image generation unit generates a one point color image in which a colorization area in the one point color image is set as an area to which pixel values of the composite image are output, and a non-colorization area is set as an area to which pixel values of the monochrome image are output. The colorization area is selected by either user selection or automatic selection. For example, user-specified area information, subject distance information, and the like are used for the execution.

Claims (56)

1. An image processing apparatus, comprising:

circuitry configured to:

generate a composite image by execution of a composition processing operation using a color image and a monochrome image captured from different viewpoints; and

generate a one point color image in which only a partial area of the one point color image is colored, wherein

a colorization area in the one point color image is set as an area to which pixel values of the composite image are output, and

a non-colorization area in the one point color image is set as an area to which pixel values of the monochrome image are output.

2. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

determine whether a color image-based composite image or a monochrome image-based composite image has a higher image quality; and

generate one of the color image-based composite image or the monochrome image-based composite image, whichever is determined to have the higher image quality.

3. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

generate one of a color image-based composite image or a monochrome image-based composite image; and

generate the one point color image in which the colorization area in the one point color image is set as an area to which pixel values of one of the generated color image-based composite image or the generated monochrome image-based composite image are output.

4. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

input colorization area selection information for the one point color image; and

generate the one point color image in which an area determined based on the input colorization area selection information is set as the colorization area.

5. The image processing apparatus according to claim 1 , wherein

the colorization area in the one point color image is selected in one of a manual mode for user selection or an auto mode for automatic selection.

6. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

input colorization area selection information set by a user; and

generate the one point color image in which an area selected by the user is set as the colorization area based on the input colorization area selection information.

7. The image processing apparatus according to claim 1 , wherein

the colorization area in the one point color image is automatically determined based on distances to subjects included in a captured image, and

the circuitry is further configured to:

input colorization area selection information based on the distances to the subjects; and

generate the one point color image in which an area of a subject at a specific distance is set as the colorization area based on the input colorization area selection information.

8. The image processing apparatus according to claim 1 , wherein

the colorization area in the one point color image is automatically determined based on objects included in a captured image, and

the circuitry is further configured to:

input colorization area selection information based on the objects; and

generate the one point color image in which an area of a specific object is set as the colorization area based on the input colorization area selection information.

9. The image processing apparatus according to claim 1 , wherein

the colorization area in the one point color image is a face area detected by facial recognition processing from a captured image, and

the circuitry is further configured to:

input colorization area selection information corresponding to the face area; and

generate the one point color image in which the face area is set as the colorization area based on the input colorization area selection information.

10. The image processing apparatus according to claim 1 , wherein

the colorization area in the one point color image is an area having a high exposure demodulation value detected during exposure control, and

the circuitry is further configured to:

input colorization area selection information corresponding to the exposure demodulation value; and

generate the one point color image in which the area having the high exposure demodulation value is set as the colorization area based on the input colorization area selection information.

11. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

input information regarding the colorization area in the one point color image; and

execute autofocus (AF) processing to focus on the colorization area.

12. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to:

input information regarding the colorization area in the one point color image; and

execute exposure control for setting an exposure suitable for a subject in the colorization area.

13. An image processing method executed by an image processing apparatus, the method comprising:

generating a composite image by executing composition processing using a color image and a monochrome image captured from different viewpoints; and

generating a one point color image in which only a partial area of the one point color image is colored, wherein

a colorization area in the one point color image is set as an area to which pixel values of the composite image are output, and

a non-colorization area in the one point color image is set as an area to which pixel values of the monochrome image are output.

14. A non-transitory computer-readable medium having stored thereon, computer-executable instructions that when executed by an electronic device, causes the electronic device to execute operations, the operations comprising:

generating a composite image by executing composition processing using a color image and a monochrome image captured from different viewpoints; and

generating a one point color image in which only a partial area of the one point color image is colored, wherein

a colorization area in the one point color image is set as an area to which pixel values of the composite image are output, and

a non-colorization area in the one point color image is set as an area to which pixel values of the monochrome image are output.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2021
From: KOBASHIRI, TAKANOBU
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 056337/0941 →
Priority Claims (1)
JP JP2018-010643 · Jan 25, 2018 · national
Continuity (1)
Related Publication 20200366843A1 · Nov 19, 2020