IP Library Granted Patent US 10,755,083
Granted Patent B2
US 10,755,083 · App. 16/043,912 · Granted Aug 25, 2020

Terminal for vehicle and method for authenticating face

Inventors: Sam Yong Kim (Hwaseong-si, KR); Yu Jin Yun (Suwon-si, KR); Seong Sook Ryu (Seoul, KR); Hwal Ly Lee (Seoul, KR); Byoung Joon Lee (Suwon-si, KR); Jin Kwon Kim (Suwon-si, KR)
Assignees: HYUNDAI MOTOR COMPANY; KIA MOTORS CORPORATION
G06K9/00288B60R25/2081B60R25/245B60R25/25G06F21/32G06K9/00248
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,755,083
App. No.
16/043,912
Granted
Aug 25, 2020
Kind
B2
Abstract

A vehicle terminal automatically registering a profile image of a user to a vehicle using images stored in a mobile terminal of a user and performing a face authentication includes a communicator that performs a data communication with the mobile terminal of the user, a camera that obtains a face image of the user, and a processor that registers the profile image of the user using an image among the images stored in the mobile terminal. The processor learns a facial feature of the user using the images stored in the mobile terminal as learning data and analyzes the face image obtained through the camera based on the learned facial feature of the user to perform the face authentication of the user.

Claims (42)

1. A face authentication system comprising a vehicle terminal installed in a vehicle and a mobile terminal of a user, wherein the vehicle terminal comprises:

a communicator performing a data communication with the mobile terminal of the user;

a camera obtaining a face image of the user; and

a processor configured to:

learn a facial feature of the user using images stored in the mobile terminal as learning data; and

analyze the face image obtained through the camera based on the learned facial feature of the user to perform a face authentication of the user,

wherein the mobile terminal is configured to extract at least one or more images whose similarity with feature vectors included in facial feature information of the user authenticated through the face authentication is equal to or greater than a reference similarity from the images stored in the mobile terminal, and

the processor is further configured to register one face image among the at least one or more face images, which are provided from the mobile terminal, as a profile image of the user.

2. The face authentication system of claim 1 , wherein the communicator is configured to utilize a short-range wireless communication technology corresponding to one of a Bluetooth and a near field communication (NFC).

3. The face authentication system of claim 1 , wherein the vehicle terminal further comprises a sensing device for sensing the user who is in the vehicle, wherein the processor is configured to perform an authentication procedure on the mobile terminal through the communicator when the user who is in the vehicle is sensed.

4. The face authentication system of claim 3 , wherein the processor is configured to output a welcome message through a display when the authentication procedure performed on the mobile terminal is completed.

5. The face authentication system of claim 4 , wherein the processor is configured to output the profile image of the user corresponding to the authenticated mobile terminal with the welcome message.

6. The face authentication system of claim 1 , wherein the processor is further configured to:

identify whether the user authenticated through the face authentication is a user who is restricted in driving; and

restrict a control operation with respect to the vehicle of the user in accordance with the identified result.

7. The face authentication system of claim 1 , wherein the processor is configured to transmit facial feature information of the user authenticated through the face authentication to the mobile terminal of the user.

8. The face authentication system of claim 1 , wherein the processor is configured to register a face image having a highest similarity with the feature vectors among the at least one or more images, which are provided from the mobile terminal, as the profile image.

9. The face authentication system of claim 1 , wherein the processor is configured to:

extract a face image of another user from the at least one or more images provided from the mobile terminal;

extract feature vectors from the extracted face image; and

add the extracted feature vectors to the learning data.

10. A method for authenticating a face of a user through a face authentication system comprising a vehicle terminal installed in a vehicle and a mobile terminal of the user, comprising:

allowing the vehicle terminal to learn a facial feature of the user using images stored in the mobile terminal as learning data;

allowing the vehicle terminal to analyze a face image obtained through a camera and to perform a face authentication based on the learned facial feature;

allowing the mobile terminal to extract at least one or more face images whose similarity with facial feature vectors included in facial feature information of the authenticated user is equal to or greater than a reference similarity from the images that are stored in the mobile terminal; and

allowing the vehicle terminal to register one image among the at least one or more face images, which are provided from the mobile terminal, as a profile image of the user.

11. The method of claim 10 , wherein the performing of the face authentication comprises:

sensing whether the user is in the vehicle;

performing an authentication procedure on the mobile terminal; and

outputting a welcome message when the authentication procedure of the mobile terminal is successful.

12. The method of claim 11 , wherein the welcome message is displayed with the profile image of the user corresponding to the authenticated mobile terminal.

13. The method of claim 10 , further comprising:

allowing the vehicle terminal to identify whether the authenticated user is a user who is restricted in driving; and

allowing the vehicle terminal to restrict a control operation with respect to the vehicle by the authenticated user when the authenticated user is the user who is restricted in driving after the performing of the face authentication.

14. The method of claim 10 , wherein the mobile terminal is configured to transmit the extracted at least one or more face images to the vehicle terminal in the obtaining of the at least one or more face images from the mobile terminal of the user.

15. The method of claim 14 , wherein the vehicle terminal is configured to register a face image having a highest similarity with the facial feature vectors among the at least one or more images, which are provided from the mobile terminal, as the profile image of the user in the registering of the profile image of the user.

16. The method of claim 15 , wherein the vehicle terminal is configured to utilize the at least one or more face images provided from the mobile terminal as the learning data to learn the facial feature of the user when the profile image is registered.

17. The method of claim 16 , wherein the vehicle terminal is configured to:

extract a face image of another user from the at least one or more images provided from the mobile terminal;

extract feature vectors from the extracted face image; and

add the extracted feature vectors to the learning data.

18. The method of claim 10 , wherein the vehicle terminal is configured to transmit or receive data to or from the mobile terminal utilizing a short-range wireless communication technology corresponding to one of a Bluetooth and a near field communication (NFC).

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2018
From: KIM, SAM YONG; YUN, YU JIN; RYU, SEONG SOOK; LEE, HWAL LY; LEE, BYOUNG JOON; KIM, JIN KWON
To: HYUNDAI MOTOR COMPANY; KIA MOTORS CORPORATION
Reel/Frame 046508/0161 →
Priority Claims (1)
KR 10-2018-0051841 · May 4, 2018 · national
Continuity (1)
Related Publication 20190340423A1 · Nov 7, 2019