IP Library Granted Patent US 9,542,599
Granted Patent B2
US 9,542,599 · App. 14/833,896 · Granted Jan 10, 2017

Image processing device and image processing method

Inventors: Jumpei Matsunaga (Shiga, JP); Masayuki Kobayashi (Kyoto, JP)
Assignee: OMRON Corporation
G06K9/0061G06K9/00228G06T5/005G06T7/0081G06T7/408G06T11/001H04N5/23229G06T2207/10024G06T2207/30201G06T2207/30216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,542,599
App. No.
14/833,896
Granted
Jan 10, 2017
Kind
B2
Abstract

An image processing device for correcting at least a portion of a face image containing a person's face, includes an image acquisition unit that acquires a face image, a region extractor that extracts a pupil region containing a pupil from the face image, a determination unit that determines a presence or absence of halation in the pupil region, a first template acquisition unit that acquires a first template image which is a correction template image, a reference color acquisition unit that acquires a reference color corresponding to the person from the face image, a second template acquisition unit that generates a second template image using the first template image and the reference color, and a correction unit that composites the second template image with at least the region in the pupil region where the halation occurred to correct the halation.

Claims (34)

1. An image processing device for correcting at least a portion of a face image containing a person's face, the image processing device comprising:

an image acquisition unit that acquires a face image;

a region extractor that extracts a pupil region containing a pupil from the face image;

a determination unit that determines a presence or absence of halation in the pupil region;

a first template acquisition unit that acquires a first template image which is a correction template image;

a reference color acquisition unit that acquires a reference color corresponding to the person from the face image;

a second template acquisition unit that generates a second template image using the first template image and the reference color; and

a correction unit that composites the second template image with at least the region in the pupil region where the halation occurred to correct the halation.

2. The image processing device according to claim 1 ,

wherein the first template image is a grayscale image; and

wherein the second template acquisition unit uses the reference color to convert the first template image into a color image and uses the color image as the second template image.

3. The image processing device according to claim 2 , further comprising:

a correction value computing unit that computes a correction value on the basis of the reference color, the correction value used for matching the luminance of the first template image to the face image; and

wherein the second template acquisition unit uses the correction value to adjust the luminance of the first template image, and converts the first template image into a color image.

4. The image processing device according to claim 1 , wherein the reference color acquisition unit extracts a region from the pupil region corresponding to the iris in which no halation occurred, and acquires a reference color from a pixel contained in the region.

5. The image processing device according to claim 2 , wherein the reference color acquisition unit extracts a region from the pupil region corresponding to the iris in which no halation occurred, and acquires a reference color from a pixel contained in the region.

6. The image processing device according to claim 3 , wherein the reference color acquisition unit extracts a region from the pupil region corresponding to the iris in which no halation occurred, and acquires a reference color from a pixel contained in the region.

7. The image processing device according to claim 4 , wherein when there is no region within the pupil region that corresponds to the iris and in which no halation has occurred, the reference color acquisition unit extracts a region corresponding to the person's skin from the face image, and acquires the reference color on the basis of the color of a pixel contained in the region.

8. An image processing method performed in an image processing device for correcting at least a portion of a face image containing a person's face, comprising:

acquiring a face image;

extracting a pupil region containing a pupil from the face image;

determining a presence or absence of halation in the pupil region;

acquiring a first template image which is a correction template image;

acquiring a reference color corresponding to the person from the face image;

generating a second template image using the first template image and the reference color; and

compositing the second template image with at least the region in the pupil region where the halation occurred to correct the halation.

9. A program stored on a non-transitory computer-readable medium that causes a computer to perform an image processing method for correcting at least a portion of a face image containing a person's face, comprising:

acquiring a face image;

extracting a pupil region containing a pupil from the face image;

determining a presence or absence of halation in the pupil region;

acquiring a first template image which is a correction template image;

acquiring a reference color corresponding to the person from the face image;

generating a second template image using the first template image and the reference color; and

compositing the second template image with at least the region in the pupil region where the halation occurred to correct the halation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2015
From: MATSUNAGA, JUMPEI; KOBAYASHI, MASAYUKI
To: OMRON CORPORATION
Reel/Frame 037134/0879 →
Priority Claims (1)
JP 2014-179390 · Sep 3, 2014 · national
Continuity (1)
Related Publication 20160063305A1 · Mar 3, 2016