IP Library Granted Patent US 11,040,725
Granted Patent B2
US 11,040,725 · App. 14/845,356 · Granted Jun 22, 2021

Manual vehicle control notification

Inventor: Christopher L. Scofield (Seattle, WA)
Assignee: INRIX Inc.
B60W50/14B60K28/00G05D1/0061G08G1/096725G08G1/096791G08G1/163G08G1/165B60W2050/143B60W2540/22B60W2554/00G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,040,725
App. No.
14/845,356
Granted
Jun 22, 2021
Kind
B2
Abstract

One or more techniques and/or systems are provided for notifying drivers to assume manual vehicle control of vehicles. For example, sensor data is acquired from on-board vehicles sensors (e.g., radar, sonar, and/or camera imagery of a crosswalk) of a vehicle that is in an autonomous driving mode. In an example, the sensor data is augmented with driving condition data aggregated from vehicle sensor data of other vehicles (e.g., a cloud service collects and aggregates vehicle sensor data from vehicles within the crosswalk to identify and provide the driving condition data to the vehicle). The sensor data (e.g., augmented sensor data) is evaluated to identify a driving condition of a road segment, such as the crosswalk (e.g., pedestrians protesting within the crosswalk). Responsive to the driving condition exceeding a complexity threshold for autonomous driving decision making functionality, a driver alert to assume manual vehicle control may be provided to a driver.

Claims (55)

1. A method for notifying a driver to assume manual vehicle control, comprising:

evaluating sensor data, acquired from one or more on-board sensors of a vehicle that is in an autonomous driving mode, to determine a driving condition of a road segment that is to be traveled by the vehicle;

determining a cognitive load of the driver based upon a type of activity associated with a first location from which the vehicle is traveling;

responsive to determining that the driving condition exceeds a complexity threshold, derived from the cognitive load, for autonomous driving decision making functionality, generating a driver alert to assume manual vehicle control;

determining a point in time at which to provide the driver alert relative to a point in time at which the road segment is encountered based upon the cognitive load, wherein:

when the cognitive load of the driver has a first cognitive load value, selecting the point in time at which to provide the driver alert to be a first time interval away from the point in time at which the road segment is encountered,

when the cognitive load of the driver has a second cognitive load value different than the first cognitive load value, selecting the point in time at which to provide the driver alert to be a second time interval, different than the first time interval, away from the point in time at which the road segment is encountered; and

providing the driver alert to the driver of the vehicle at the point in time, relative to the point in time at which the road segment is encountered.

2. The method of claim 1 , wherein determining the cognitive load comprises determining the cognitive load of the driver by monitoring activity of the driver.

3. The method of claim 1 , comprising:

identifying a potential alternate route to avoid the road segment, wherein determining the point in time at which to provide the driver alert comprises determining the point in time based upon a current location of the vehicle and a location of the potential alternate route.

4. The method of claim 1 , comprising:

utilizing travel prediction functionality to predict a route of the vehicle; and

identifying the road segment based upon the route and a current location of the vehicle.

5. The method of claim 1 , comprising:

receiving driving condition data for the road segment from a remote computing device over a communication connection; and

augmenting the sensor data with the driving condition data.

6. The method of claim 1 , comprising:

predicting an amount of time required to determine an appropriate driving action based upon the driving condition; and

setting the complexity threshold based upon the amount of time required to determine the appropriate driving action relative to an amount of time remaining before reaching the road segment.

7. The method of claim 5 , the driving condition data corresponding to an aggregation of vehicle sensor data from one or more vehicles while the one or more vehicles traveled the road segment.

8. The method of claim 1 , comprising:

receiving, from a remote computing device over a communication connection, a second driving condition for a second road segment that is to be traveled by the vehicle;

responsive to determining that the second driving condition exceeds the complexity threshold for autonomous driving decision making functionality, generating a second driver alert to assume manual vehicle control; and

providing the second driver alert to the driver of the vehicle at a second point in time, relative to the second road segment, based upon the second driving condition.

9. The method of claim 1 , the driving condition corresponding to at least one of a road condition, a weather condition, a pedestrian, an accident, an ethical decision, or a driving impediment.

10. The method of claim 1 , wherein determining the cognitive load comprises determining the cognitive load of the driver utilizing at least one of a microphone or a camera.

11. The method of claim 1 , wherein determining the cognitive load comprises determining the cognitive load based upon conversations between the driver and another person.

12. The method of claim 1 , wherein monitoring activity of the driver comprises observing whether the driver is at least one of: eating, sleeping, or engaging a computing device.

13. A method for notifying a driver to assume manual vehicle control, comprising:

evaluating sensor data, acquired from one or more on-board sensors of a vehicle that is in an autonomous driving mode, to determine a driving condition of a road segment that is to be traveled by the vehicle;

determining a cognitive load of the driver based upon a type of activity associated with a first location from which the vehicle is traveling;

responsive to determining that the driving condition exceeds a complexity threshold, derived from the cognitive load, for autonomous driving decision making functionality, generating a driver alert to assume manual vehicle control;

determining a point in time at which to provide the driver alert relative to a point in time at which the road segment is encountered based upon the cognitive load, wherein:

when the cognitive load of the driver has a first cognitive load value, selecting the point in time at which to provide the driver alert to be a first time interval away from the point in time at which the road segment is encountered,

when the cognitive load of the driver has a second cognitive load value, selecting the point in time at which to provide the driver alert to be a second time interval, different than the first time interval, away from the point in time at which the road segment is encountered; and

providing the driver alert to the driver of the vehicle at the point in time, relative to the point in time at which the road segment is encountered.

14. The method of claim 13 , wherein the complexity threshold is based upon the cognitive load.

15. The method of claim 13 , wherein determining the cognitive load of the driver comprises determining the cognitive load of the driver by monitoring activity of the driver using at least one of a camera in the vehicle or a microphone in the vehicle.

16. The method of claim 15 , wherein the complexity threshold is based upon the cognitive load.

17. The method of claim 13 , wherein determining the cognitive load of the driver comprises determining the cognitive load of the driver based upon social media posts associated with the driver.

18. The method of claim 13 , wherein social media posts associated with the driver corresponds to social media posts by the driver.

19. The method of claim 13 , comprising:

utilizing travel prediction functionality to predict a route of the vehicle; and

identifying the road segment based upon the route and a current location of the vehicle.

20. A system, comprising:

a processor; and

memory that when executed by the processor performs operations for notifying a driver to assume manual vehicle control, the operations comprising:

evaluating sensor data, acquired from one or more on-board sensors of a vehicle that is in an autonomous driving mode, to determine a driving condition of a road segment that is to be traveled by the vehicle;

determining a cognitive load of the driver based upon a type of activity associated with a first location from which the vehicle is traveling;

responsive to determining that the driving condition exceeds a complexity threshold, derived from the cognitive load, for autonomous driving decision making functionality, generating a driver alert to assume manual vehicle control;

determining a point in time at which to provide the driver alert relative to a point in time at which the road segment is encountered based upon the cognitive load, wherein:

when the cognitive load of the driver has a first cognitive load value, selecting the point in time at which to provide the driver alert to be a first time interval away from the point in time at which the road segment is encountered,

when the cognitive load of the driver has a second cognitive load value, selecting the point in time at which to provide the driver alert to be a second time interval away from the point in time at which the road segment is encountered; and

providing the driver alert to the driver of the vehicle at the point in time, relative to the point in time at which the road segment is encountered.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Jun 28, 2023
From: RUNWAY GROWTH FINANCE CORP. (F/K/A RUNWAY GROWTH CREDIT FUND INC.)
To: INRIX, INC.
Reel/Frame 064159/0320 →
SECURITY INTEREST Recorded Jul 26, 2019
From: INRIX, INC.
To: RUNWAY GROWTH CREDIT FUND INC.
Reel/Frame 049879/0427 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2015
From: SCOFIELD, CHRISTOPHER L
To: INRIX INC.,
Reel/Frame 036492/0857 →