IP Library › Granted Patent US 12,322,212
Granted Patent B2
US 12,322,212 · App. 18/569,515 · Granted Jun 3, 2025

Image processing device and image processing method

Inventor: Naoto Kajiyama (Kanagawa, JP)
Assignee: NISSAN MOTOR CO., LTD.
G06V40/67B60K35/10B60K35/22B60K35/28G06T7/70G06V20/59G06V40/172B60K2360/165B60K2360/21B60K2360/31G06T2207/10016G06T2207/30201G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,212
App. No.
18/569,515
Granted
Jun 3, 2025
Kind
B2
Abstract

A controller of an image processing device performs registration or authentication of face data of a user by using a plurality of face images which are different from each other and in which orientations of a face captured by a camera are each within a first angle that is based on a state in which the user faces a front of the camera, and displays on a display a video in which a human face-imitating image changes its face orientation until the registration or the authentication is completed. A second angle formed by a direction from a seating position of the user toward the camera and a direction from the seating position of the user toward the display is smaller than the first angle.

Claims (29)

1. An image processing device, comprising:

a camera that captures an image of a user;

a controller that performs registration or authentication of face data of the user by using an image captured by the camera; and

a display that displays a video,

wherein the controller;

performs registration or authentication of face data of the user by using a plurality of face images which are different from each other and in which orientations of a face captured by the camera are each within a first angle that is based on a state in which the user faces a front of the camera,

displays on the display a video in which a human face-imitating image changes its face orientation until the registration or the authentication is completed,

determines whether a line of sight of the user is toward the camera or toward the display based on the image captured by the camera, and

when determining that the line of sight of the user is toward the display, sets either one of an angle at which the human face-imitating image shakes a head in a right direction and an angle at which the human face-imitating image shakes a head in a left direction to be larger than a second angle formed by a direction from a seating position of the user toward the camera and a direction from the seating position of the user toward the display.

2. The image processing device according to claim 1 , wherein the camera is installed in front of a seat in a vehicle,

wherein a direction in which the face orientation is changed includes any one of up, down, left, and right directions, or a combination of up, down, left, and right directions, and

wherein the camera and the display are installed so as to be arranged in a vehicle width direction or in a vehicle height direction.

3. The image processing device according to claim 1 , wherein while displaying the video on the display, the controller notifies the user to change a face orientation at a same speed as a speed at which the human face-imitating image changes its face orientation.

4. The image processing device according to claim 1 , wherein while displaying the video on the display, the controller notifies the user to change a face orientation in a same manner as in the video until the registration or the authentication is completed.

5. The image processing device according to claim 1 , wherein while displaying the video on the display, the controller notifies the user to face in a direction of the camera and change a face orientation in up, down, left, and right directions in a same manner as in the video until the registration or the authentication is completed.

6. The image processing device according to claim 1 , wherein the controller notifies the user of a missing orientation among face images captured by the camera and each having a different face orientation.

7. The image processing device according to claim 1 , wherein the camera is installed in front of a seat in a vehicle, and

wherein the camera and the display are installed so as to be arranged in a longitudinal direction of the vehicle.

8. The image processing device according to claim 1 , further comprising:

a sensor that detects a sitting height of the user,

wherein the controller changes the video to be displayed on the display in accordance with the sitting height detected by the sensor.

9. The image processing device according to claim 1 , wherein either one of an angle at which the human face-imitating image shakes a head in a right direction and an angle at which the human face-imitating image shakes a head in a left direction is larger than the second angle.

10. The image processing device according to claim 1 , wherein the controller, when determining that the line of sight of the user is toward the display, sets an angle opposite to either one of an angle at which the human face-imitating image shakes a head in a right direction and an angle at which the human face-imitating image shakes a head in a left direction to be smaller than the second angle.

11. The image processing device according to claim 1 , wherein in the video in which the human face-imitating image changes a face orientation, an area above a neck moves while an area below the neck does not move.

12. An image processing method for an image processing device including a camera that captures an image of a user, a controller that performs registration or authentication of face data of the user by using an image captured by the camera, and a display that displays a video, the method comprising:

performing, by a controller, registration or authentication of face data of the user by using a plurality of face images different from each other in which orientations of a face captured by the camera are each within a first angle that is based on a state in which the user faces a front of the camera,

displaying, by a controller, on the display a video in which a human face-imitating image changes its face orientation until the registration or the authentication is completed,

determining whether a line of sight of the user is toward the camera or toward the display based on the image captured by the camera, and

when determining that the line of sight of the user is toward the display, sets either one of an angle at which the human face-imitating image shakes a head in a right direction and an angle at which the human face-imitating image shakes a head in a left direction to be larger than a second angle formed by a direction from a seating position of the user toward the camera and a direction from the seating position of the user toward the display.

Priority Claims (1)
WO PCT/JP2021/022695 · Feb 15, 2021 · international
Continuity (1)
Related Publication 20240273951A1 · Aug 15, 2024
References Cited (13)
US 9602803B2 · Tamura et al. · 2017 [cited by applicant]
US 20150124053A1 · Tamura et al. · 2015 [cited by applicant]
US 20170124312A1 · Inoue · 2017 [cited by examiner]
US 20190080065A1 · Sheik-Nainar · 2019 [cited by applicant]
JP 2008015800A · 2008 [cited by applicant]
JP 2008017227A · 2008 [cited by applicant]
JP 2009113621A · 2009 [cited by applicant]
JP 2010006362A · 2010 [cited by applicant]
JP 201590662A · 2015 [cited by applicant]
JP 2019083015A · 2019 [cited by applicant]
JP 2019134397A · 2019 [cited by applicant]
JP 2019212156A · 2019 [cited by applicant]
WO 2015194135A1 · 2015 [cited by applicant]