IP Library › Granted Patent US 11,644,328
Granted Patent B2
US 11,644,328 · App. 17/547,827 · Granted May 9, 2023

Safety drive assist apparatus

Inventors: Takuya Homma (Tokyo, JP); Tsukasa Mikuni (Tokyo, JP); Toru Kato (Tokyo, JP); Ryota Nakamura (Tokyo, JP); Masatoshi Tsuge (Tokyo, JP)
Assignee: SUBARU CORPORATION
G01C21/3484G06V20/597G06V40/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,644,328
App. No.
17/547,827
Granted
May 9, 2023
Kind
B2
Abstract

A safety drive assist apparatus includes an imaging unit, an information acquisition unit, first and second determination processors, and a search control processor. The imaging unit captures an image of an occupant inside a vehicle. The information acquisition unit is provided inside and outside the vehicle and acquires information including biometric information of the occupant. The first and the second determination processors determine physical and mental fatigue levels of the occupant inside the vehicle, respectively, on the basis of the image captured by the imaging unit or the information acquired by the information acquisition unit. The search control processor searches for a recommended traveling route and a recommended stop-by point on the basis of a search condition, and propose a result of the search to the occupant. The search condition is based on one or both of determination information obtained by the first determination processor, the second determination processor.

Claims (54)

1. A safety drive assist apparatus to be applied to a vehicle, the safety drive assist apparatus comprising:

an imaging unit configured to capture an image of an occupant inside the vehicle;

an information acquisition unit configured to acquire information including biometric information of the occupant inside and outside the vehicle;

a determination processor configured to acquire occupant information based on at least one of the image of the occupant inside the vehicle captured by the imaging unit and the information including the biometric information of the occupant inside and outside the vehicle acquired by the information acquisition unit,

wherein the occupant information includes:

physical fatigue determination information including information of blood-oxygen saturation, information of respiratory rate, information of body temperature, information of blood pressure, information of hemoglobin level, information of activity amount, information of number of times of blinking, information of opening degree of an eye, information of sleep duration, information of number of times of rolling while sleeping, information of sleep state, or information of rest duration, the physical fatigue determination information not including information of heart rate and information of heart rate variability; and

mental fatigue determination information including the information of heart rate or the information of heart rate variability,

wherein the determination processor includes:

a first determination processor configured to quantify the physical fatigue determination information out of the occupant information into one or more first levels that indicate one or more numerical values in a predetermined range, and execute a first determination that the occupant is physically fatigued based on the one or more first levels; and

a second determination processor configured to quantify the mental fatigue determination information out of the occupant information into one or more second levels that indicate one or more numerical values in the predetermined range, and execute a second determination that the occupant is mentally fatigued based on the one or more second levels; and

a search control processor configured to search for a recommended traveling route and a recommended stop-by point based on a search condition, and propose one or both of the recommended traveling route and the recommended stop-by point to the occupant, the search control processor being configured to determine the search condition based on one or both of the first determination and the second determination,

wherein the search condition includes a first search condition when the first determination out of the first determination and the second determination is executed, and a second search condition when the second determination out of the first determination and the second determination is executed, and

wherein the first search condition and the second search condition are different from each other.

2. The safety drive assist apparatus according to claim 1 , wherein

the determination processor further includes a third determination processor configured to determine a rest state of the occupant inside the vehicle based on the occupant information,

the search control processor is configured to determine the search condition based on the rest state, and propose one or both of the recommended traveling route and the recommended stop-by point to the occupant.

3. The safety drive assist apparatus according to claim 1 , wherein

the first determination processor is further configured to execute a first comparison of one of the one or more first levels with a first threshold, and execute the first determination that the occupant is physically fatigued based on a result of the first comparison, and

the second determination processor is further configured to execute a second comparison of one of the one or more second levels with a second threshold, and execute the second determination that the occupant is mentally fatigued based on a result of the second comparison.

4. The safety drive assist apparatus according to claim 1 , wherein

the one or more first levels include first levels representing first items including the information of blood-oxygen saturation, the information of respiratory rate, the information of body temperature, the information of blood pressure, the information of hemoglobin level, the information of activity amount, the information of number of times of blinking, the information of opening degree of the eye, the information of sleep duration, the information of number of times of rolling while sleeping, the information of sleep state, and the information of rest duration,

the one or more second levels include second levels representing second items including the information of heart rate and the information of heart rate variability,

the first determination processor is further configured to execute a first comparison of an average value of the first levels with a first threshold, and execute the first determination that the occupant is physically fatigued based on a result of the first comparison, and

the second determination processor is further configured to execute a second comparison of an average value of the second levels with a second threshold, and execute the second determination that the occupant is mentally fatigued based on a result of the second comparison.

5. The safety drive assist apparatus according to claim 1 , wherein

the first search condition includes: a first route search condition regarding a road width, a number of traffic lights, a number of pedestrians, and a traffic amount; and a first stop-by point search condition for searching a rest spot close to a current location of the vehicle as the stop-by point, and

the second search condition includes: a second route search condition for searching a road with a nice view; and a second stop-by point search condition for searching a rest spot with a nice view as the stop-by point.

6. A safety drive assist apparatus comprising to be applied to a vehicle, the safety drive assist apparatus comprising:

an imaging unit including a first sensor, the imaging unit being configured to capture an image of an occupant inside a vehicle;

an information acquisition unit including a second sensor, the information acquisition unit is configured to acquire information including biometric information of the occupant inside and outside the vehicle; and

circuitry configured to acquire occupant information based on at least one of the image of the occupant inside the vehicle captured by the imaging unit and the acquired information including the biometric information of the occupant inside and outside the vehicle,

wherein the occupant information includes

physical fatigue determination information including information of blood-oxygen saturation, information of respiratory rate, information of body temperature, information of blood pressure, information of hemoglobin level, information of activity amount, information of number of times of blinking, information of opening degree of an eye, information of sleep duration, information of number of times of rolling while sleeping, information of sleep state, or information of rest duration, the physical fatigue determination information not including information of heart rate and information of heart rate variability, and

mental fatigue determination information including the information of heart rate or the information of heart rate variability,

wherein the circuitry is further configured to

quantify the physical fatigue determination information out of the occupant information into one or more first levels that indicate one or more numerical values in a predetermined range, and execute a first determination that the occupant is physically fatigued based on the one or more first levels, and

quantify the mental fatigue determination information out of the occupant information into one or more second levels that indicate one or more numerical values in the predetermined range, and execute a second determination that the occupant is mentally fatigued based on the one or more second levels, and

search for a recommended traveling route and a recommended stop-by point based on a search condition, and propose one or both of the recommended traveling route, and the recommended stop-by point to the occupant, the search condition being determined based on one or both of the first determination and the second determination,

wherein the search condition includes a first search condition when the first determination out of the first determination and the second determination is executed, and a second search condition when the second determination out of the first determination and the second determination is executed, and

wherein the first search condition and the second search condition are different from each other.

7. The safety drive assist apparatus according to claim 6 , wherein the circuitry is further configured to:

execute a first comparison of one of the one or more first levels with a first threshold; and

execute the first determination that the occupant is physically fatigued based on a result of the first comparison, and execute a second comparison of one of the one or more second levels with a second threshold, and execute the second determination that the occupant is mentally fatigued based on a result of the second comparison.

8. The safety drive assist apparatus according to claim 6 , wherein

the one or more first levels include first levels representing first items including the information of blood-oxygen saturation, the information of respiratory rate, the information of body temperature, the information of blood pressure, the information of hemoglobin level, the information of activity amount, the information of number of times of blinking, the information of opening degree of the eye, the information of sleep duration, the information of number of times of rolling while sleeping, the information of sleep state, and the information of rest duration,

the one or more second levels include second levels representing second items including the information of heart rate and the information of heart rate variability, and

the circuitry is further configured to:

execute a first comparison of an average value of the first levels with a first threshold, and execute the first determination that the occupant is physically fatigued based on a result of the first comparison; and

execute a second comparison of an average value of the second levels with a second threshold, and execute the second determination that the occupant is mentally fatigued based on a result of the second comparison.

9. The safety drive assist apparatus according to claim 6 , wherein

the first search condition includes:

a first route search condition regarding a road width, a number of traffic lights, a number of pedestrians, and a traffic amount; and

a first stop-by point search condition for searching a rest spot close to a current location of the vehicle as the stop-by point, and

the second search condition includes: a second route search condition for searching a road with a nice view; and a second stop-by point search condition for searching a rest spot with a nice view as the stop-by point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2021
From: HOMMA, TAKUYA; MIKUNI, TSUKASA; KATO, TORU; NAKAMURA, RYOTA; TSUGE, MASATOSHI
To: SUBARU CORPORATION
Reel/Frame 058425/0218 →
Priority Claims (2)
JP JP2020-212601 · Dec 22, 2020 · national
JP JP2021-178209 · Oct 29, 2021 · national
Continuity (1)
Related Publication 20220196423A1 · Jun 23, 2022