IP Library › Granted Patent US 11,535,280
Granted Patent B2
US 11,535,280 · App. 17/006,703 · Granted Dec 27, 2022

Method and device for determining an estimate of the capability of a vehicle driver to take over control of a vehicle

Inventors: Alexander Barth (Wermelskirchen, DE); David Schiebener (Mettmann, DE)
Assignee: Aptiv Technologies Limited
B60W60/0059B60W40/02B60W40/08B60W50/14B60W60/0054B60W60/0057G06V20/597G06V40/107G06V40/28B60W2540/227B60W2540/229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,535,280
App. No.
17/006,703
Granted
Dec 27, 2022
Kind
B2
Abstract

A computer-implemented method for determining an estimate of the capability of a vehicle driver to take over control of a vehicle, wherein the method comprises: determining at least one estimation parameter, the at least one estimation parameter representing an influencing factor for the capability of the vehicle driver to take over control of the vehicle; and determining an estimate on the basis of the at least one estimation parameter by means of a predefined estimation rule, the estimate representing the capability of the vehicle driver to take over control of the vehicle.

Claims (110)

1. A method for determining an estimate of capability of a vehicle driver to take over control of a vehicle, the method comprising:

determining a similarity between a current position of the vehicle driver and a plurality of position classes for positions of the vehicle driver in which taking over control of the vehicle is expected to be feasible or facilitated for the driver;

selecting one of the plurality of position classes having maximum similarity to the current position;

determining at least one estimation parameter as at least one distance between the selected one of the plurality of position classes and the current position of the vehicle driver, the at least one estimation parameter representing an influencing factor for the capability of the vehicle driver to take over control of the vehicle; and

determining an estimate based on the at least one estimation parameter by means of a predefined estimation rule, the estimate representing the capability of the vehicle driver to take over control of the vehicle.

2. The method of claim 1 , wherein:

the estimate comprises a time period in which the driver is expected to take over control of the vehicle in response to a warning signal; and

the estimate comprises information on whether within a predefined time period the driver is capable to take over control of the vehicle in response to the warning signal.

3. The method of claim 1 , wherein:

the estimate represents the capability of the driver to take over at least partial control of the vehicle;

the driver is expected to have at least partial control of the vehicle if at least one hand of the driver cooperates with a manual steering element of the vehicle or at least one portion of a body of the driver matches a predefined driving position;

the estimate represents the capability of the driver to take over full control of the vehicle; and

the driver is expected to have full control of the vehicle if both hands of the driver cooperate with a manual steering element of the vehicle or if the body of the driver or the at least one portion of the body matches the predefined driving position.

4. The method of claim 3 , wherein:

the estimate comprises a minimum time period in which the driver is expected to take over partial control of the vehicle in response to a warning signal; and

the estimate comprises a maximum time period in which the driver is expected to take over full control of the vehicle in response to a warning signal.

5. The method of claim 1 , wherein:

the at least one estimation parameter represents position or distance information on at least one portion of a body of the driver; and

the at least one estimation parameter includes position or distance information on one or more of:

one or more hands of the driver;

a head of the driver;

an upper part of the body of the driver;

one or more hips or an abdomen area of the driver;

one or more eyes of the driver; and

one or more eyelids of the driver.

6. The method of claim 1 , wherein:

the at least one estimation parameter is determined with respect to a reference object or a reference position,

the at least one estimation parameter is determined as a time period in which the driver is expected to reach the reference object or reference position in response to a warning signal so as to satisfy at least one target condition,

the driver is expected to be in control of the vehicle if the at least one target condition is satisfied or wherein taking over control of the vehicle is expected to be feasible or facilitated for the driver if the at least one target condition is satisfied.

7. The method of claim 1 , wherein:

the at least one estimation parameter represents interaction or object information on at least one portion of a body of the driver;

the at least one estimation parameter includes one or more of:

information on whether one or more hands of the driver cooperate with a manual steering element of the vehicle;

information on whether one or more hands of the driver cooperate with an object other than the steering element;

information on whether an object is placed on a lap of the driver; and

information on whether an object is present on an ear of the driver.

8. The method of claim 1 , wherein:

the at least one estimation parameter represents distraction information of the driver; and

the at least one estimation parameter includes information of one or more of:

activity of the driver for example operation of a mobile or stationary device;

additional passengers in the vehicle for example number or position of additional passengers within the vehicle;

operation of electronic media inside the vehicle;

telephone conversation inside the vehicle; and

conversation noise inside the vehicle.

9. The method of claim 1 , wherein:

the at least one estimation parameter represents information on an operational state or environment of the vehicle; and

the at least one estimation parameter includes information on one or more of:

vehicle speed;

a property of air inside or outside the vehicle including one or more of pressure, temperature, and humidity;

opening state of one or more windows of the vehicle;

operation of one or more wipers of the vehicle;

configuration of a driver seat of the vehicle;

quantity or position of objects around the vehicle;

quantity or size of traffic signs detected by the vehicle;

traffic environment of the vehicle; and

street condition.

10. The method of claim 1 , wherein:

the at least one estimation parameter represents fitness or personal information on the driver; and

the at least one parameter includes information on one or more of:

drowsiness of the driver;

mood of the driver;

properties of a body of the driver; and

predefined reaction-capability values.

11. The method of claim 1 , wherein determining the at least one parameter comprises:

taking at least one image by means of at least one image sensor mounted on the vehicle, wherein the at least one image captures an interior portion of the vehicle, at least a steering element of the vehicle, or an area in which at least a portion of the driver is expected to be located while the driver is in control of the vehicle; and

determining, based on the at least one image, the at least one estimation parameter, wherein an automated control function of the vehicle is deactivated if the estimate satisfies a predefined safety condition and wherein otherwise an emergency control function of the vehicle is activated.

12. A system comprising a processing unit configured estimate a capability of a driver of a vehicle to take over control of the vehicle by:

determining a similarity between a current position of the vehicle driver and a plurality of position classes for positions of the vehicle driver in which taking over control of the vehicle is expected to be feasible or facilitated for the driver;

selecting one of the plurality of position classes having maximum similarity to the current position;

determining at least one estimation parameter as at least one distance between the selected one of the plurality of position classes and the current position of the vehicle driver, the at least one estimation parameter representing an influencing factor for the capability of the driver to take over control of the vehicle; and

determining an estimate based on the at least one estimation parameter by means of a predefined estimation rule, the estimate representing the capability of the driver to take over control of the vehicle.

13. The system of claim 12 , wherein:

the system comprises at least one sensor configured to take at least one image capturing at least a steering element of a vehicle and/or an area in which at least a portion of the driver is expected to be located while the driver is in control of the vehicle; and

the at least one sensor is configured to provide three-dimensional image data for the at least one image.

14. A non-transitory computer readable medium comprising instructions, which when executed by a processing unit, cause the processing unit to estimate a capability of a driver of a vehicle to take over control of the vehicle by:

determining a similarity between a current position of the vehicle driver and a plurality of position classes for positions of the vehicle driver in which taking over control of the vehicle is expected to be feasible or facilitated for the driver;

selecting one of the plurality of position classes having maximum similarity to the current position;

determining at least one estimation parameter as at least one distance between the selected one of the plurality of position classes and the current position of the vehicle driver, the at least one estimation parameter representing an influencing factor for the capability of the driver to take over control of the vehicle; and

determining an estimate based on the at least one estimation parameter by means of a predefined estimation rule, the estimate representing the capability of the driver to take over control of the vehicle.

15. The non-transitory computer readable medium of claim 14 , wherein the instructions, when executed, cause the processing unit to determine the at least one parameter by:

taking at least one image by means of at least one image sensor mounted on the vehicle, wherein the at least one image captures an interior portion of the vehicle, at least a steering element of the vehicle, or an area in which at least a portion of the driver is expected to be located while the driver is in control of the vehicle; and

determining, based on the at least one image, the at least one estimation parameter, wherein an automated control function of the vehicle is deactivated if the estimate satisfies a predefined safety condition and wherein otherwise an emergency control function of the vehicle is activated.

16. The non-transitory computer readable medium of claim 14 , wherein:

the estimate comprises a time period in which the driver is expected to take over control of the vehicle in response to a warning signal; and

the estimate comprises information on whether within a predefined time period the driver is capable to take over control of the vehicle in response to the warning signal.

17. The non-transitory computer readable medium of claim 14 , wherein:

the estimate represents the capability of the driver to take over at least partial control of the vehicle;

the driver is expected to have at least partial control of the vehicle if at least one hand of the driver cooperates with a manual steering element of the vehicle or at least one portion of a body of the driver matches a predefined driving position;

the estimate represents the capability of the driver to take over full control of the vehicle; and

the driver is expected to have full control of the vehicle if both hands of the driver cooperate with a manual steering element of the vehicle or if the body of the driver or the at least one portion of the body of the driver matches the predefined driving position.

18. The non-transitory computer readable medium of claim 14 , wherein:

the at least one estimation parameter represents position or distance information on at least one portion of a body of the driver; and

the at least one estimation parameter includes position or distance information on one or more of:

one or more hands of the driver;

a head of the driver;

an upper part of the body of the driver;

one or more hips or an abdomen area of the driver;

one or more eyes of the driver; and

one or more eyelids of the driver.

19. The non-transitory computer readable medium of claim 14 , wherein:

the at least one estimation parameter is determined with respect to a reference object or a reference position,

the at least one estimation parameter is determined as a time period in which the driver is expected to reach the reference object or reference position in response to a warning signal so as to satisfy at least one target condition,

the driver is expected to be in control of the vehicle if the at least one target condition is satisfied or wherein taking over control of the vehicle is expected to be feasible or facilitated for the driver if the at least one target condition is satisfied.

20. The non-transitory computer readable medium of claim 14 , wherein:

the at least one estimation parameter represents interaction or object information on at least one portion of a body of the driver;

the at least one estimation parameter includes one or more of:

information on whether one or more hands of the driver cooperate with a manual steering element of the vehicle;

information on whether one or more hands of the driver cooperate with an object other than the steering element;

information on whether an object is placed on a lap of the driver; and

information on whether an object is present on an ear of the driver.

Assignments (4)
MERGER Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES (2) S.À R.L.
To: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
Reel/Frame 066566/0173 →
ENTITY CONVERSION Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES LIMITED
To: APTIV TECHNOLOGIES (2) S.À R.L.
Reel/Frame 066746/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2024
From: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
To: APTIV TECHNOLOGIES AG
Reel/Frame 066551/0219 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2020
From: BARTH, ALEXANDER; SCHIEBENER, DAVID
To: APTIV TECHNOLOGIES LIMITED
Reel/Frame 053635/0092 →
Priority Claims (1)
EP 19197824 · Sep 17, 2019 · regional
Continuity (1)
Related Publication 20210078609A1 · Mar 18, 2021
Cited By (1)
US 12,546,896