IP Library Granted Patent US 9,420,169
Granted Patent B2
US 9,420,169 · App. 14/607,669 · Granted Aug 16, 2016

Imaging device, imaging method, and program

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,420,169
App. No.
14/607,669
Granted
Aug 16, 2016
Kind
B2
Abstract

An imaging device includes: an imaging unit imaging an object and generating image data of the object; a display unit displaying an image corresponding to the image data; a display controller controlling the display unit to display an expression guide image in which at least a part of expression of a face in the object has been changed; an expression determination unit determining similarity between the expressions in the image and in the expression guide image; an imaging controller controlling the imaging unit to continuously image the object until the expression determination unit determines that the expressions in the image and in the expression guide image are matched, wherein the display controller controls the display unit to display another expression guide image at a time the expression determination unit determines that the expressions in the image in the expression guide image are matched.

Claims (34)

1. An imaging device comprising:

an imaging unit configured to image an object and generate image data of the object;

a display unit configured to display an image corresponding to the image data generated by the imaging unit;

a display controller configured to control the display unit to display an expression guide image in which at least a part of expression of a face in the object has been changed;

an expression determination unit configured to determine similarity between the expression of the face in the object in the image corresponding to the image data generated by the imaging unit and the expression of the face in the object in the expression guide image displayed by the display unit;

an imaging controller configured to control the imaging unit to continuously image the object until the expression determination unit determines that the expression of the face in the object in the image and the expression of the face in the object in the expression guide image are matched,

wherein the display controller is configured to control the display unit to display another expression guide image at a time the expression determination unit determines that the expression of the face in the object in the image and the expression of the face in the object in the expression guide image are matched.

2. The imaging device according to claim 1 , wherein the imaging controller is configured to change a frame rate of the imaging unit or change a data size of the image data at a time the expression determination unit determines that the expression of the face in the object in the image and the expression of the face in the object in the expression guide image are not matched.

3. The imaging device according to claim 1 , further comprising a recording unit configured to record the image data generated by the imaging unit and a sample image obtained such that a model of a predetermined posture and/or expression is captured in advance as a sample, and

wherein the expression determination unit is configured to determine whether or not the expression of the face in the object in the image and the expression in the sample image are matched, and

the imaging controller is configured to record the image data generated by the imaging unit in the recording unit at a time the expression determination unit determines that the expression of the face in the object in the image and the expression in the sample image are matched.

4. The imaging device according to claim 1 , wherein the expression guide image is an image in which a direction of lines of sight of the face in the object has been changed.

5. The imaging device according to claim 1 , further comprising:

a face detection unit configured to detect the face in the object in the image;

a pupil detection unit configured to detect a sclera area and a pupil area of the face detected by the face detection unit; and

a pupil-changed image generation unit configured to generate pupil-changed image data in which a position of the pupil area in the sclera area has been changed in accordance with a detection result detected by the pupil detection unit, and

wherein the display controller is configured to control the display unit to display, as the expression guide image, a pupil-changed image corresponding to the pupil-changed image data generated by the pupil-changed image generation unit.

6. The imaging device according to claim 5 , further comprising a part position-changed image generation unit configured to generate part-changed image data in which each part that configures the face detected by the face detection unit has been moved into an arranging direction of the pupil area in the sclera area changed by the pupil-changed image generation unit, and

wherein the display controller is configured to control the display unit to display, as the expression guide image, a part position-changed image corresponding to the part position-changed image data generated by the part position-changed image generation unit.

7. The imaging device according to claim 5 , further comprising a part position-changed image generation unit configured to generate part-changed image data in which a size of each part that configures the face detected by the face detection unit has been increased or reduced in accordance with a distance between the imaging device and the object, and

wherein the display controller is configured to control the display unit to display, as the expression guide image, a part position-changed image corresponding to the part position-changed image data generated by the part position-changed image generation unit.

8. The imaging device according to claim 1 , wherein

the display unit is rotatably provided to a main body of the imaging device from a back surface side of the imaging device to a front surface side of the imaging device and includes a display area in which the image corresponding to the image data is displayed, and

the display controller is configured to control the display unit to display the expression guide image at a time the display unit has rotated to the front surface side and the display area faces the front surface side.

9. An imaging method for an imaging device including an imaging unit configured to image an object and generate image data of the object, and a display unit configured to display an image corresponding to the image data generated by the imaging unit, the imaging method comprising:

displaying step of causing the display unit to display an expression guide image in which at least a part of expression of a face in the object has been changed;

expression determination step of determining similarity between the expression of the face in the object in the image corresponding to the image data generated by the imaging unit and the expression of the face in the object in the expression guide image displayed by the display unit;

imaging control step of controlling the imaging unit to continuously image the object until the expression determination step determines that the expression of the face in the object in the image and the expression of the face in the object in the expression guide image are matched; and

second imaging step of causing the display unit to display another expression guide image at a time the expression determination step determines that the expression of the face in the object in the image and the expression of the face in the object in the expression guide image are matched.

10. A non-transitory computer-readable recording medium with an executable program stored thereon, wherein the program instructs a processor of an imaging device including an imaging unit configured to image an object and generate image data of the object, and a display unit configured to display an image corresponding to the image data generated by the imaging unit, to perform:

displaying step of causing the display unit to display an expression guide image in which at least a part of expression of a face in the object has been changed;

expression determination step of determining similarity between the expression of the face in the object in the image corresponding to the image data generated by the imaging unit and the expression of the face in the object in the expression guide image displayed by the display unit;

imaging control step of controlling the imaging unit to continuously image the object until the expression determination step determines that the expression of the face in the object in the image and the expression of the face in the object in the expression guide image are matched; and

second imaging step of causing the display unit to display another expression guide image at a time the expression determination step determines that the expression of the face in the object in the image and the expression of the face in the object in the expression guide image are matched.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: OLYMPUS CORPORATION
To: OM DIGITAL SOLUTIONS CORPORATION
Reel/Frame 058901/0912 →
CHANGE OF ASSIGNEE'S ADDRESS Recorded Jul 6, 2016
From: OLYMPUS CORPORATION
To: OLYMPUS CORPORATION
Reel/Frame 039265/0822 →
MERGER Recorded Aug 5, 2015
From: OLYMPUS IMAGING CORP.
To: OLYMPUS CORPORATION
Reel/Frame 036279/0239 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2015
From: UEMURA, TOMOMI; YAMAGUCHI, MAI; UEMURA, YUIKO; YAMAMOTO, SACHIE; NONAKA, OSAMU
To: OLYMPUS IMAGING CORP.; OLYMPUS CORPORATION
Reel/Frame 035373/0353 →