IP Library Granted Patent US 7,639,940
Granted Patent B2
US 7,639,940 · App. 11/431,592 · Granted Dec 29, 2009

Photography apparatus, photography method, and photography program using lighting condition parameters

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,639,940
App. No.
11/431,592
Granted
Dec 29, 2009
Kind
B2
Abstract

An auxiliary light source such as a flash is controlled for highly accurately reflecting a lighting condition with less effect of a factor other than the lighting condition such as contrasting density caused by shadow or black compression or white compression. For this purpose, a parameter acquisition unit obtains weighting parameters for principal components representing lighting conditions in a face region in an image detected by a face detection unit, by fitting to the detected face region a mathematical model generated according to a method of AAM using a plurality of sample images representing human faces in different lighting conditions. A flash control unit obtains a flash control condition by referring to a reference table according to the parameters, and controls flash light emission according to the control condition.

Claims (32)

1. A photography apparatus comprising:

imaging means for obtaining an image of a subject by photography thereof;

an auxiliary light source for emitting auxiliary light at the time of the photography;

parameter acquisition means for obtaining a weighting parameter for a statistical characteristic quantity representing a lighting condition for a predetermined structure in an input through image by fitting a model representing the structure to the structure in the input through image, the model having been obtained by carrying out predetermined statistical processing on a plurality of images representing the predetermined structure in different lighting conditions, and the model representing the structure by one or more statistical characteristic quantities including the statistical characteristic quantity representing the lighting condition and by weighting parameter or parameters for weighting the statistical characteristic quantity or quantities according to an individual characteristic of the structure; and

auxiliary light source control means for controlling the auxiliary light source so as to cause a condition of lighting for the subject to become appropriate according to a value of the weighting parameter having been obtained.

2. The photography apparatus according to claim 1 , wherein the predetermined structure is a human face.

3. The photography apparatus according to claim 1 further comprising detection means for detecting the structure in the input through image, wherein

the parameter acquisition means obtains the weighting parameter by fitting the model to the structure having been detected.

4. The photography apparatus according to claim 3 , further comprising model selection means for selecting the model representing the structure from at least one model having a property represented in the structure having being detected by the detection means.

5. The photography apparatus according to claim 1 further comprising selection means for obtaining a property of the structure in the input through image and for selecting the models corresponding to the obtained property from a plurality of the models representing the structure for respective properties of the predetermined structure, wherein

the parameter acquisition means obtains the weighting parameter by fitting the selected model to the structure in the input through image.

6. The photography apparatus according to claim 1 , wherein the different lighting conditions include a presence or absence of light emitted from the auxiliary light source, an intensity of light emitted, a color of light emitted, and a light source direction in the case of presence of a plurality of light sources.

7. The photography apparatus according to claim 1 , wherein the input through image is generated by serially imaging the subject at a predetermined frame rate.

8. A photography apparatus comprising:

imaging means for obtaining an image of a subject by photography thereof;

parameter acquisition means for obtaining a weighting parameter for a statistical characteristic quantity representing a lighting condition for a predetermined structure in an input through image by fitting a model representing the structure to the structure in the input through image, the model having been obtained by carrying out predetermined statistical processing on a plurality of images representing the predetermined structure in different lighting conditions, and the model representing the structure by one or more statistical characteristic quantities including the statistical characteristic quantity representing the lighting condition and by weighting parameter or parameters for weighting the statistical characteristic quantity or quantities according to an individual characteristic of the structure;

judging means for carrying out judgment as to whether a value of the weighting parameter having been obtained satisfies a predetermined criterion representing a preferable lighting condition; and

warning means for carrying out warning in the case where a result of the judgment is negative.

9. A photography method comprising the steps of:

obtaining a weighting parameter for a statistical characteristic quantity representing a lighting condition for a predetermined structure in an input through image by fitting a model representing the structure to the structure in the input through image, the model having been obtained by carrying out predetermined statistical processing on a plurality of images representing the predetermined structure in different lighting conditions, and the model representing the structure by one or more statistical characteristic quantities including the statistical characteristic quantity representing the lighting condition and by weighting parameter or parameters for weighting the statistical characteristic quantity or quantities according to an individual characteristic of the structure; and

controlling an auxiliary light source emitting auxiliary light at the time of photography of a subject so as to cause a condition of lighting for the subject to become appropriate according to a value of the weighting parameter having been obtained.

10. A photography method comprising the steps of:

obtaining a weighting parameter for a statistical characteristic quantity representing a lighting condition for a predetermined structure in an input through image by fitting a model representing the structure to the structure in the input through image, the model having been obtained by carrying out predetermined statistical processing on a plurality of images representing the predetermined structure in different lighting conditions, and the model representing the structure by one or more statistical characteristic quantities including the statistical characteristic quantity representing the lighting condition and by weighting parameter or parameters for weighting the statistical characteristic quantity or quantities according to an individual characteristic of the structure;

carrying out judgment as to whether a value of the weighting parameter having been obtained satisfies a predetermined criterion representing a preferable lighting condition; and

carrying out warning in the case where a result of the judgment is negative.

11. A computer-readable medium embodied with a photography program for causing a computer to function as:

parameter acquisition means for obtaining a weighting parameter for a statistical characteristic quantity representing a lighting condition for a predetermined structure in an input through image by fitting a model representing the structure to the structure in the input through image, the model having been obtained by carrying out predetermined statistical processing on a plurality of images representing the predetermined structure in different lighting conditions, and the model representing the structure by one or more statistical characteristic quantities including the statistical characteristic quantity representing the lighting condition and by weighting parameter or parameters for weighting the statistical characteristic quantity or quantities according to an individual characteristic of the structure; and

auxiliary light source control means for controlling an auxiliary light source emitting auxiliary light at the time of photography of a subject so as to cause a condition of lighting for the subject to become appropriate according to a value of the weighting parameter having been obtained.

12. A computer-readable medium embodied with a photography program for causing a computer to function as:

parameter acquisition means for obtaining a weighting parameter for a statistical characteristic quantity representing a lighting condition for a predetermined structure in an input through image by fitting a model representing the structure to the structure in the input through image, the model having been obtained by carrying out predetermined statistical processing on a plurality of images representing the predetermined structure in different lighting conditions, and the model representing the structure by one or more statistical characteristic quantities including the statistical characteristic quantity representing the lighting condition and by weighting parameter or parameters for weighting the statistical characteristic quantity or quantities according to an individual characteristic of the structure;

judging means for carrying out judgment as to whether a value of the weighting parameter having been obtained satisfies a predetermined criterion representing a preferable lighting condition; and

warning means for carrying out warning in the case where a result of the judgment is negative.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2007
From: FUJIFILM HOLDINGS CORPORATION (FORMERLY FUJI PHOTO FILM CO., LTD.)
To: FUJIFILM CORPORATION
Reel/Frame 018904/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2006
From: YODA, AKIRA; ITO, WATARU
To: FUJI PHOTO FILM CO., LTD.
Reel/Frame 017894/0116 →