IP Library › Granted Patent US 12,291,198
Granted Patent B2
US 12,291,198 · App. 18/183,386 · Granted May 6, 2025

Optimal engagement of automated features to assist incapacited drivers

Inventors: Khizar Ahmad Qureshi (Pickering, CA); Mehdi Abroshan (Waterloo, CA); Reza Zarringhalam (Whitby, CA); Mohammadali Shahriari (Markham, CA); Apral Singh Hara (Lasalle, CA)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
B60W30/09B60Q9/00B60W10/18B60W10/20B60W2540/26B60W2710/18B60W2710/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,291,198
App. No.
18/183,386
Granted
May 6, 2025
Kind
B2
Abstract

Methods and systems are provided that include one or more sensors configured to obtain sensor data pertaining to both a driver of a vehicle and an environment surrounding the vehicle; and a processor that is coupled to the one or more sensors and that is configured to at least facilitate determining, using the sensor data, when the driver is incapacitated; determining, using the sensor data, when a threat is detected for the vehicle; and taking action to avoid the threat when the driver is incapacitated and the threat is detected, via instructions provided by the processor.

Claims (52)

1. A method comprising:

obtaining sensor data, from one or more sensors of a vehicle, the sensor data pertaining to both a driver of the vehicle and an environment surrounding the vehicle;

determining, via a processor using the sensor data, when the driver is incapacitated;

determining, via the processor using the sensor data, when a threat is detected for the vehicle; and

taking action to avoid the threat when the driver is incapacitated and the threat is detected, in accordance with instructions provided by the processor; and

calculating, via the processor, a safety margin for a vehicle event associated with the threat, based on a virtual receding horizon using the sensor data;

wherein the step of taking the action comprises taking the action based on the safety margin when the driver is incapacitated and the threat is detected, in accordance with the instructions provided by the processor.

2. The method of claim 1 , wherein the step of taking the action further comprises automatically providing an alarm when the driver is incapacitated and the threat is detected, in accordance with the instructions provided by the processor.

3. The method of claim 1 , wherein the step of taking the action further comprises automatically controlling movement of the vehicle when the driver is incapacitated and the threat is detected, in accordance with the instructions provided by the processor.

4. The method of claim 3 , wherein the step of automatically controlling movement of the vehicle further comprises automatically controlling braking and steering of the vehicle, in accordance with the instructions provided by the processor, when the driver is incapacitated and the threat is detected.

5. The method of claim 1 , further comprising:

calculating, via the processor, an optimal time for intervention to avoid the vehicle event, based on the safety margin using the sensor data;

wherein the step of taking the action further comprises taking the action with timing that is based also on the optimal time when the driver is incapacitated and the threat is detected, in accordance with the instructions provided by the processor.

6. The method of claim 5 , wherein the optimal time is determined via the processor as a latest possible time to safely avoid the vehicle event.

7. The method of claim 1 , further comprising:

determining, via the processor using the sensor data and the safety margin, a capability of one or more automated driving features for avoiding the vehicle event;

wherein the step of taking the action is further based on the capability of the one or more automated driving features for avoiding the vehicle event.

8. The method of claim 7 , wherein the step of taking the action further comprises providing an alert for one or more individuals outside the vehicle when it is determined that the one or more automated driving features are not capable for avoiding the vehicle event.

9. A system comprising:

one or more sensors configured to obtain sensor data pertaining to both a driver of a vehicle and an environment surrounding the vehicle; and

a processor that is coupled to the one or more sensors and that is configured to at least facilitate:

determining, using the sensor data, when the driver is incapacitated;

determining, using the sensor data, when a threat is detected for the vehicle;

calculating a safety margin for a vehicle event associated with the threat, based on a virtual receding horizon using the sensor data; and

taking action to avoid the threat based on the safety margin when the driver is incapacitated and the threat is detected, via instructions provided by the processor.

10. The system of claim 9 , wherein the processor is configured to at least facilitate automatically providing an alarm when the driver is incapacitated and the threat is detected, via the instructions provided by the processor.

11. The system of claim 9 , wherein the processor is configured to at least facilitate automatically controlling movement of the vehicle when the driver is incapacitated and the threat is detected, via the instructions provided by the processor.

12. The system of claim 11 , wherein the processor is configured to at least facilitate automatically controlling braking and steering of the vehicle, via the instructions provided by the processor, when the driver is incapacitated and the threat is detected.

13. The system of claim 9 , wherein the processor is configured to at least facilitate:

calculating an optimal time for intervention to avoid the vehicle event, based on the safety margin using the sensor data; and

taking the action with timing that is based also on the optimal time when the driver is incapacitated and the threat is detected, via the instructions provided by the processor.

14. The system of claim 13 , wherein the processor is configured to at least facilitate determining the optimal time as a latest possible time to safely avoid the vehicle event.

15. The system of claim 9 , wherein the processor is configured to at least facilitate:

determining, using the sensor data and the safety margin, a capability of one or more automated driving features for avoiding the vehicle event; and

taking the action, via the instructions provided by the processor, based on the capability of the one or more automated driving features for avoiding the vehicle event.

16. The system of claim 15 , wherein the processor is configured to at least facilitate providing an alert for one or more individuals outside the vehicle, via the instructions provided by the processor, when it is determined that the one or more automated driving features are not capable for avoiding the vehicle event.

17. A vehicle comprising:

a body;

a drive system configured to generate movement of the body;

one or more sensors disposed on or within the body and configured to obtain sensor data pertaining to both a driver of the vehicle and an environment surrounding the vehicle; and

a processor disposed within the body and coupled to the one or more sensors, the processor configured to at least facilitate:

determining, using the sensor data, when the driver is incapacitated;

determining, using the sensor data, when a threat is detected for the vehicle;

calculating a safety margin for a vehicle event associated with the threat, based on a virtual receding horizon using the sensor data; and

taking action to avoid the threat based on the safety margin when the driver is incapacitated and the threat is detected, via instructions provided by the processor.

18. The vehicle of claim 17 , wherein the processor is configured to at least facilitate:

calculating an optimal time for intervention to avoid the vehicle event, based on the safety margin using the sensor data; and

taking the action based also on the optimal time when the driver is incapacitated and the threat is detected, via the instructions provided by the processor.

19. The vehicle of claim 18 , wherein the processor is configured to at least facilitate:

providing a visual alarm based the optimal time when the driver is incapacitated and the threat is detected, via the instructions provided by the processor.

20. The vehicle of claim 18 , wherein the processor is configured to at least facilitate:

providing an audio alarm based the optimal time when the driver is incapacitated and the threat is detected, via the instructions provided by the processor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2023
From: QURESHI, KHIZAR AHMAD; ABROSHAN, MEHDI; ZARRINGHALAM, REZA; SHAHRIARI, MOHAMMADALI; HARA, APRAL SINGH
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 062974/0582 →
Continuity (1)
Related Publication 20240308501A1 · Sep 19, 2024
References Cited (8)
US 7124027B1 · Ernst, Jr. · 2006 [cited by examiner]
US 20130204457A1 · King · 2013 [cited by examiner]
US 20170291602A1 · Newman · 2017 [cited by examiner]
US 20190235515A1 · Shirvani · 2019 [cited by examiner]
US 20240153380A1 · Barcia · 2024 [cited by examiner]
EP 3576074A1 · 2019 [cited by examiner]
Youngjae et al., “Detecting Driver Fatigue based on the Driver's Response Pattern and the Front View Environment of an Automobile,” 2008, Publisher: IEEE. [cited by examiner]
A. R. Beukman et al., “A multi-sensor system for detection of driver fatigue,” 2016, Publisher: IEEE. [cited by examiner]