IP Library Granted Patent US 11,087,120
Granted Patent B2
US 11,087,120 · App. 16/343,935 · Granted Aug 10, 2021

Image authentication device, image authentication method, and automobile

Inventor: Taro Kumagai (Tokyo, JP)
Assignee: MITSUBISHI ELECTRIC CORPORATION
G06K9/00288B60N2/002B60Q9/00G06K9/00228G06K9/00838G06T7/70G06T2207/30201G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,087,120
App. No.
16/343,935
Granted
Aug 10, 2021
Kind
B2
Abstract

An area determining unit ( 3 ) for determining whether a detected face area is located within an area set for authenticating an occupant sitting on a front seat of a vehicle, a face orientation detecting unit ( 4 ) for detecting orientation of a face of a person on the basis of position information in a taken image of an element of the face of the person detected when the face area is determined to be located within the set area, a face orientation determining unit ( 5 ) for determining whether the orientation of the face of the person detected is within a range of the face orientation set for authenticating the occupant sitting on the front seat of the vehicle, and an authentication processing unit ( 6 ) for collating characteristic information of the taken image of the face area with characteristic information of a taken image for authentication accumulated in advance and authenticating the person whose face area is detected when the orientation of the face of the person is determined to be within the set range of the face orientation.

Claims (46)

1. An image authentication device comprising:

a processor to execute a program; and

a memory to store the program which, when executed by the processor, performs processes of,

detecting a face area in which a face of a person is located and characteristic information of the face area from a taken image in which an imaging range in which an occupant sitting on a driver seat and an occupant sitting on a passenger seat in a vehicle are able to be simultaneously imaged is imaged;

determining whether the face area detected is located within an area set partially in the imaging range for authenticating each of the occupants sitting on a front seat of the vehicle; and

when it is determined that the face area is located within the set area, collating the characteristic information of the taken image of the face area with characteristic information of a taken image for authentication accumulated in advance and authenticating the person whose face area is detected.

2. The image authentication device according to claim 1 ,

wherein the processes include:

when the person whose face area is detected cannot be authenticated, instructing to detect the face area again on a basis of a vehicle speed of the vehicle.

3. The image authentication device according to claim 1 ,

wherein the set area is set inside the vehicle than a pillar of the vehicle imaged in the take image.

4. The image authentication device according to claim 1 ,

wherein the set area is set on a side of each of the driver seat and the passenger seat in the vehicle.

5. The image authentication device according to claim 1 , wherein the processes include:

detecting an element of the face of the period from the taken image of the face area detected,

detecting orientation of the face of the person on a basis of position information in the taken image of the element of the face of the person detected,

determining whether the orientation of the face of the person detected is within a range of face orientation set for authenticating each of the occupants sitting on the front seat of the vehicle, and

when it is determined that the face area is located within the set area and that the orientation of the face of the person is within the set range of the face orientation, collating the characteristic information of the taken image of the face area with the characteristic information of the taken image for authentication accumulated in advance and authenticating the person whose face area is detected.

6. The image authentication device according to claim 1 , wherein the processes include:

detecting an element of the face of the person from the taken image of the face area detected,

determining whether eyes of the person are open on the basis of the position information in the taken image of the element of the face of the person detected, and

when it is determined that the face area is located within the set area and that the eyes of the person are open, collating the characteristic information of the taken image of the face area with the characteristic information of the taken image for authentication accumulated in advance and authenticating the person whose face area is detected.

7. The image authentication device according to claim 1 , wherein the processes include:

detecting an element of the face of the person from the taken image of the face area detected,

detecting orientation of the face of the person on a basis of position information in the taken image of the element of the face of the person detected,

determining whether the orientation of the face of the person detected is within a range of face orientation set for authenticating each of the occupants sitting on the front seat of the vehicle,

determining whether eyes of the person are open on the basis of the position information in the taken image of the element of the face of the person, and

when it is determined that the face area is located within the set area, that the orientation of the face of the person is within the set range of the face orientation and that the eyes of the person are open, collating the characteristic information of the taken image of the face area with the characteristic information of the taken image for authentication accumulated in advance and authenticating the person whose face area is detected.

8. An automobile comprising:

the image authentication device according to claim 1 ; and

a control device to control an acoustic condition of an acoustic device provided for a seat of the vehicle or the vehicle, on a basis of an authentication result input from the image authentication device.

9. The image authentication device according to claim 1 ,

wherein the processes include:

instructing to detect the face area on a basis of vehicle information of the vehicle.

10. The image authentication device according to claim 9 ,

wherein the vehicle information is information indicating opening and closing of a door of the vehicle.

11. The image authentication device according to claim 9 ,

wherein the processes include:

on a basis of a determination result that the vehicle is located at a specific point, determining a collation threshold for the person associated with the specific point, and

collating the characteristic information of the taken image of the face area detected with the characteristic information of the taken image for authentication accumulated in advance and authenticating the person on a basis of whether a collation result is equal to or larger than the collation threshold determined.

12. The image authentication device according to claim 9 ,

wherein the set area is an area set depending on a type of the vehicle information referred to.

13. An image authentication method including:

detecting a face area in which a face of a person is located and characteristic information of the face area from a taken image in which an imaging range in which an occupant sitting on a driver seat and an occupant sitting on a passenger seat in a vehicle are able to be simultaneously imaged is imaged;

determining whether the face area detected is located within an area set partially in the imaging range for authenticating each of the occupants sitting on a front seat of the vehicle; and

when it is determined that the face area is located within the set area, collating the characteristic information of the taken image of the face area with characteristic information of a taken image for authentication accumulated in advance and authenticating the person whose face area is detected.

Assignments (2)
COMPANY SPLIT Recorded Sep 4, 2024
From: MITSUBISHI ELECTRIC CORPORATION
To: MITSUBISHI ELECTRIC MOBILITY CORPORATION
Reel/Frame 068834/0585 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2019
From: KUMAGAI, TARO
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 048969/0120 →