IP Library › Granted Patent US 12,295,731
Granted Patent B2
US 12,295,731 · App. 17/760,957 · Granted May 13, 2025

Driver availability detection device and driver availability detection method

Inventors: Natsuki Tahara (Tokyo, JP); Genta Yoshimura (Tokyo, JP)
Assignee: Mitsubishi Electric Corporation
A61B5/18A61B5/6893A61B5/7267G06V20/597G06V40/166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,295,731
App. No.
17/760,957
Granted
May 13, 2025
Kind
B2
Abstract

A driver availability detection device includes an information acquisition unit to acquire information related to an occupant and a threshold setting unit to set an abnormal-state determination threshold for estimating the abnormal state of the occupant on a basis of an abnormal state score obtained by inputting the information related to the occupant acquired by the information acquisition unit to a machine learning model within a first threshold setting time.

Claims (30)

1. A driver availability detection device using a machine learning model, the driver availability detection device comprising:

processing circuitry

to acquire information related to the occupant,

to set an abnormal-state determination threshold that is adapted for the occupant, on a basis of an abnormal state score obtained by inputting information related to the occupant to the machine learning model that is trained using facial features, vehicle operational features, and biological features of a plurality of test occupants, within a first threshold setting time, and

to estimate an abnormal state of the occupant based on the abnormal-state determination threshold that is adapted for the occupant.

2. The driver availability detection device according to claim 1 , wherein the processing circuitry obtains one or more abnormal state scores and sets a maximum value of the one or more abnormal state scores as the abnormal-state determination threshold.

3. The driver availability detection device according to claim 1 , wherein the processing circuitry estimates that the occupant is in an abnormal state in a case where the abnormal state score obtained by inputting the information related to the occupant to the machine learning model is larger than the abnormal-state determination threshold.

4. The driver availability detection device according to claim 3 , wherein the processing circuitry individually authenticates the occupant and acquire personal identification information for identifying the occupant,

stores the abnormal-state determination threshold, which has been set, in association with the personal identification information, and

estimates the abnormal state of the occupant when acquiring the personal identification information and storing the abnormal-state determination threshold in association with the personal identification information.

5. The driver availability detection device according to claim 1 , wherein there are a plurality of the machine learning models,

the processing circuitry sets a model-specific threshold for each of the machine learning models on a basis of an abnormal state score obtained by the inputting information related to the occupant within the first threshold setting time, and

determines, after setting the model-specific threshold, whether or not an abnormal state score obtained by inputting information related to the occupant within a second threshold setting time is larger than the model-specific threshold for each of the machine learning models, and

sets a number of the machine learning models in which it is determined that the abnormal state score is larger than the model-specific threshold as the abnormal-state determination threshold.

6. The driver availability detection device according to claim 5 , wherein the processing circuitry calculates a number of machine learning models in which an abnormal state score obtained by inputting information related to the occupant is larger than a model-specific threshold, among the machine learning models, and

estimates that the occupant is in the abnormal state in a case where the number of the machine learning models is larger than the abnormal-state determination threshold.

7. The driver availability detection device according to claim 1 , wherein the processing circuitry acquires attribute information related to an attribute of the occupant,

selects one or more related machine learning models related to the attribute of the occupant among the machine learning models on a basis of the attribute information,

sets, for each of the one or more related machine learning models, a related-model-specific threshold on a basis of an abnormal state score obtained by inputting information related to the occupant within the first threshold setting time,

determines, after setting the related-model-specific threshold, whether or not an abnormal state score obtained by inputting information related to the occupant within a third threshold setting time is larger than the related-model-specific threshold for each of the one or more related machine learning models, and

sets a number of the related machine learning models in which it is determined that the abnormal state score is larger than the related-model-specific threshold as the abnormal-state determination threshold.

8. The driver availability detection device according to claim 7 , wherein the attribute of the occupant is an age of the occupant.

9. The driver availability detection device according to claim 7 , wherein the processing circuitry counts a number of related machine learning models in which an abnormal state score obtained by inputting information related to the occupant to the related machine learning model is larger than a related-model-specific threshold, among the machine learning models, and

estimates that the occupant is in an abnormal state in a case where the number of the related machine learning models is larger than the abnormal-state determination.

10. The driver availability detection device according to claim 1 , wherein the processing circuitry calculates a feature amount related to the occupant on a basis of information related to the occupant, and

sets the abnormal-state determination threshold on a basis of an abnormal state score obtained by inputting the feature amount to the machine learning model within the first threshold setting time.

11. A driver availability detection method using a machine learning model, the driver availability detection method comprising:

acquiring information related to the occupant; and

setting an abnormal-state determination threshold that is adapted for the occupant, on a basis of an abnormal state score obtained by inputting information related to the occupant to the machine learning model that is trained using facial features, vehicle operational features, and biological features of a plurality of test occupants, within a first threshold setting time; and

estimating an abnormal state of the occupant based on the abnormal-state determination threshold that is adapted for the occupant.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. 17/760,967 TO 17760957 PREVIOUSLY RECORDED ON REEL 059285 FRAME 0366. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNOR'S INTEREST. Recorded Nov 16, 2023
From: TAHARA, NATSUKI; YOSHIMURA, GENTA
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 065610/0945 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2022
From: TAHARA, NATSUKI; YOSHIMURA, GENTA
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 059285/0366 →
Continuity (1)
Related Publication 20220346684A1 · Nov 3, 2022
References Cited (19)
US 7630804B2 · Aoki · 2009 [cited by examiner]
US 9714037B2 · DeRuyck · 2017 [cited by examiner]
US 11345234B2 · Kim · 2022 [cited by examiner]
US 20030209893A1 · Breed · 2003 [cited by examiner]
US 20150314681A1 · Riley, Sr. et al. · 2015 [cited by applicant]
US 20160262683A1 · Nakano et al. · 2016 [cited by applicant]
US 20200074197A1 · Upmanue · 2020 [cited by examiner]
US 20210016805A1 · Oba et al. · 2021 [cited by applicant]
JP 200835964A · 2008 [cited by applicant]
JP 2008204056A · 2008 [cited by applicant]
JP 2010128649A · 2010 [cited by applicant]
JP 2010134490A · 2010 [cited by applicant]
JP 2016165349A · 2016 [cited by applicant]
JP 201861580A · 2018 [cited by applicant]
JP 2018171124A · 2018 [cited by applicant]
WO 2019188398A1 · 2019 [cited by applicant]
International Search Report for PCT/JP2019/039305 dated Dec. 10, 2019 (PCT/ISA/210). [cited by applicant]
Notice of Reasons for Refusal dated Dec. 12, 2023 in Japanese Application No. 2021-550920. [cited by applicant]
Office Action dated Sep. 6, 2022 from the Japanese Patent Office in JP Application No. 2021-550920. [cited by applicant]