IP Library › Granted Patent US 11,838,648
Granted Patent B2
US 11,838,648 · App. 16/894,174 · Granted Dec 5, 2023

Image processing device, imaging apparatus, image processing method, and program for determining a condition for high dynamic range processing

Inventor: Kazuya Okiyama (Saitama, JP)
Assignee: FUJIFILM Corporation
H04N23/76G06T7/50G06T7/70H04N23/71G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,838,648
App. No.
16/894,174
Granted
Dec 5, 2023
Kind
B2
Abstract

There are provided an image processing device, an imaging apparatus, an image processing method, and a program that are capable of performing high dynamic range processing that reflects a shooting intention of a photographer. An image processing device ( 31 ) includes a metering mode information acquiring unit ( 101 ) that acquires metering mode information indicating a metering mode set from among a plurality of metering modes; a target area setting unit ( 103 ) that sets, on the basis of the metering mode information, a target area that is to be used to calculate a representative luminance that is to be used in high dynamic range processing; a first luminance calculating unit ( 105 ) that calculates the representative luminance on the basis of luminance information of the target area set by the target area setting unit; and a first condition determining unit ( 107 ) that determines a first condition of the high dynamic range processing on the basis of the representative luminance calculated by the first luminance calculating unit.

Claims (46)

1. An image processing device, comprising:

a processor configured to:

acquire metering mode information indicating a metering mode set from among a plurality of metering modes;

set, on the basis of the metering mode information, a target area that is to be used to calculate a representative luminance that is to be used in high dynamic range processing;

calculate the representative luminance on the basis of luminance information of the target area that is set; and

determine a first condition of the high dynamic range processing on the basis of the representative luminance that is calculated;

acquire information about an in-focus position of a captured image;

acquire first distance information which is distance information of a plurality of areas in the captured image;

calculate, on the basis of the information about the in-focus position and the first distance information of the plurality of areas, for each of the plurality of areas, second distance information which is information indicating a distance from the in-focus position;

determine, on the basis of the second distance information, for each of the plurality of areas, a representative luminance calculation area for acquiring the luminance information that is to be used to calculate the representative luminance that is to be used in the high dynamic range processing,

wherein the processor compares the second distance information with a depth of field and determines that the representative luminance calculation area is the area which has the second distance information within the depth of field;

calculate the representative luminance on the basis of luminance information of the representative luminance calculation area;

determine a second condition of the high dynamic range processing on the basis of the representative luminance that is calculated; and

determine, on the basis of the metering mode information, which of the first condition and the second condition is to be used to perform the high dynamic range processing.

2. An image processing device comprising:

a processor configured to:

acquire information about an in-focus position of a captured image set by a photographer;

acquire first distance information which is distance information of a plurality of areas in the captured image;

calculate, on the basis of the information about the in-focus position and the first distance information of the plurality of areas, for each of the plurality of areas, second distance information which is information indicating a distance from the in-focus position;

determine, on the basis of the second distance information, for each of the plurality of areas, a representative luminance calculation area in which a shooting intention of the photographer is reflected for acquiring luminance information that is to be used to calculate a representative luminance that is to be used in high dynamic range processing,

wherein the processor compares the second distance information with a depth of field and determines that the representative luminance calculation area is the area which has the second distance information within the depth of field;

calculate the representative luminance in which the shooting intention of the photographer is reflected on the basis of luminance information of the representative luminance calculation area; and

determine a second condition of the high dynamic range processing on the basis of the representative luminance that is calculated.

3. The image processing device according to claim 2 , wherein the processor determines the second condition of the high dynamic range processing in which more tones are allocated to the representative luminance and luminances close to the representative luminance than to other luminances.

4. The image processing device according to claim 2 , wherein the processor determines the representative luminance calculation area on the basis of the second distance information and a depth of field.

5. The image processing device according to claim 2 , wherein the processor is further configured to:

acquire shooting mode information which is information about a shooting mode for shooting a photographic subject; and

determine, on the basis of the shooting mode information that is acquired, an upper limit or a lower limit of the luminance information of the representative luminance calculation area that is to be used to calculate the representative luminance, wherein

the processor calculates the representative luminance on the basis of the luminance information for which the upper limit or the lower limit is set.

6. The image processing device according to claim 3 , wherein the processor is further configured to determine the first condition of the high dynamic range processing in which a tone curve is a steepest in 3 to 10% of an entire range including the representative luminance.

7. An image processing method comprising:

acquiring information about an in-focus position of a captured image set by a photographer;

acquiring first distance information which is distance information of a plurality of areas in the captured image;

calculating, on the basis of the information about the in-focus position and the first distance information of the plurality of areas, for each of the plurality of areas, second distance information which is information indicating a distance from the in-focus position;

determining, on the basis of the second distance information, for each of the plurality of areas, a representative luminance calculation area in which a shooting intention of the photographer is reflected for acquiring luminance information that is to be used to calculate a representative luminance that is to be used in high dynamic range processing,

wherein the processor compares the second distance information with a depth of field and determines that the representative luminance calculation area is the area which has the second distance information within the depth of field;

calculating the representative luminance in which the shooting intention of the photographer is reflected on the basis of luminance information of the representative luminance calculation area; and

determining a second condition of the high dynamic range processing on the basis of the representative luminance that is calculated.

8. A non-transitory computer-readable recording medium that causes a computer to execute image processing in a case where a command stored in the recording medium is read by the computer, the image processing comprising:

acquiring information about an in-focus position of a captured image set by a photographer;

acquiring first distance information which is distance information of a plurality of areas in the captured image;

calculating, on the basis of the information about the in-focus position and the first distance information of the plurality of areas, for each of the plurality of areas, second distance information which is information indicating a distance from the in-focus position;

determining, on the basis of the second distance information, for each of the plurality of areas, a representative luminance calculation area in which a shooting intention of the photographer is reflected for acquiring luminance information that is to be used to calculate a representative luminance that is to be used in high dynamic range processing,

wherein the processor compares the second distance information with a depth of field and determines that the representative luminance calculation area is the area which has the second distance information within the depth of field;

calculating the representative luminance in which the shooting intention of the photographer is reflected on the basis of luminance information of the representative luminance calculation area; and

determining a second condition of the high dynamic range processing on the basis of the representative luminance that is calculated.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2020
From: OKIYAMA, KAZUYA
To: FUJIFILM CORPORATION
Reel/Frame 052863/0954 →
Priority Claims (1)
JP 2017-235173 · Dec 7, 2017 · national
Continuity (2)
Continuation PCTJP2018042073 · Nov 14, 2018
Related Publication 20200304723A1 · Sep 24, 2020