Granted Patent B2

US 12,240,469 · App. 17/928,015 · Granted Mar 4, 2025

Inventors: Hirotaka Sakamoto (Tokyo, JP); Toshiyuki Hatta (Tokyo, JP); Shintaro Watanabe (Tokyo, JP)

Assignee: MITSUBISHI ELECTRIC CORPORATION

B60W40/09G06V20/597G06V40/28B60W2540/221B60W2540/223B60W2540/26

Abstract

Claims (34)

1. An occupant state detection device comprising:

processing circuitry configured to

acquire a captured image obtained by imaging an occupant;

acquire a temperature image indicating a temperature of a surface of a body of the occupant measured in a non-contact manner;

detect a motion of the occupant on a basis of the acquired captured image;

detect a temperature of a hand of the occupant on a basis of the acquired temperature image

estimate an awakening level of the occupant on a basis of the detected motion of the occupant and the detected temperature of the hand of the occupant;

estimate the awakening level of the occupant on a basis of the motion of the hand of the occupant in response to the motion of the occupant including a motion of the hand of the occupant such that a motion of the hand of the occupant has been detected; and

estimate the awakening level of the occupant on a basis of the detected motion of the occupant and the detected temperature of the hand of the occupant in response to the motion of the occupant not including a motion of the hand of the occupant such that a motion of the hand of the occupant has not been detected; and

control a vehicle system in response to the estimated awakening level of the occupant.

2. The occupant state detection device according to claim 1 ,

wherein the processing circuitry detects, as the motion of the occupant, a motion of an eye of the occupant, a motion of a mouth of the occupant, a motion of a body of the occupant, a motion of the hand of the occupant, or a motion of a face of the occupant.

3. The occupant state detection device according to claim 1 ,

wherein the processing circuitry detects a temperature of the hand of the occupant and a temperature of a face of the occupant, and

the processing circuitry estimates an awakening level of the occupant on a basis of the detected motion of the occupant and the temperature of the hand and the detected temperature of the face of the occupant.

4. An occupant state detection device comprising:

processing circuitry configured to

acquire a captured image obtained by imaging an occupant;

acquire a temperature image indicating a temperature of a surface of a body of the occupant measured in a non-contact manner;

detect a motion of the occupant on a basis of the acquired captured image;

detect a temperature of a hand of the occupant on a basis of the acquired temperature image;

estimate an awakening level of the occupant on a basis of information regarding the detected motion of the occupant, information regarding the detected temperature of the hand of the occupant, and a machine learning model;

estimate the awakening level of the occupant on a basis of the motion of the hand of the occupant in response to the motion occupant including a motion of the hand of the occupant such that a motion of the of the hand of the occupant has been detected; and

estimate the awakening level of the occupant on a basis of the machine learning model in response to the motion of the occupant not including a motion of the hand of the occupant such that a motion of the hand of the occupant has not been detected; and

control a vehicle system in response to the estimated awakening level of the occupant.

5. An occupant state detection method comprising:

acquiring a captured image obtained by imaging an occupant;

acquiring a temperature image indicating a temperature of a surface of a body of the occupant measured in a non-contact manner;

detecting a motion of the occupant on a basis of the captured image having been acquired;

detecting a temperature of a hand of the occupant on a basis of the acquired temperature image;

estimating an awakening level of the occupant on a basis of information regarding the detected motion of the occupant, information regarding the detected temperature of the hand of the occupant, and a machine learning model;

estimating the awakening level of the occupant on a basis of the motion of the hand of the occupant in response to the motion occupant including a motion of the hand of the occupant such that a motion of the of the hand of the occupant has been detected; and

estimating the awakening level of the occupant on a basis of the machine learning model in response to the motion of the occupant not including a motion of the hand of the occupant such that a motion of the hand of the occupant has not been detected; and

controlling a vehicle system in response to the estimated awakening level of the occupant.

Assignments (1)

Continuity (1)

References Cited (27)