IP Library Granted Patent US 11,119,477
Granted Patent B1
US 11,119,477 · App. 15/409,243 · Granted Sep 14, 2021

Anomalous condition detection and response for autonomous vehicles

Inventors: Blake Konrardy (Bloomington, IL); Scott T. Christensen (Salem, OR); Gregory Hayward (Bloomington, IL); Scott Farris (Bloomington, IL)
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
G05D1/0055B60Q1/50G05D1/0088G05D1/0214
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,119,477
App. No.
15/409,243
Granted
Sep 14, 2021
Kind
B1
Abstract

Methods and systems for autonomous and semi-autonomous vehicle control relating to anomalies are disclosed. Anomalous conditions with a vehicle operating environment, such as ice patches or flooded roads, may be identified and categorized using autonomous vehicle operating data, and corrective actions to mitigate the impact of such anomalies may be taken. Corrective actions may include maneuvering the vehicle in the area of the anomaly or rerouting the vehicle around the area of the anomaly. A vehicle encountering an anomaly may further communicate an alert to warn other nearby vehicles, including non-autonomous vehicles. Such communication may be limited to anomalies of certain types or severity, and duplicative communications may be suppressed. Vehicles receiving such alerts may take corrective actions or present information regarding the anomaly for operator response.

Claims (60)

1. A computer-implemented method for anomalous condition detection and response by a vehicle having one or more autonomous operation features, comprising:

obtaining, by one or more processors, environmental data regarding an operating environment ahead of the vehicle during vehicle operation along a route to a destination, the environmental data being associated with the one or more autonomous operation features and including a GPS location of the vehicle;

identifying, by one or more processors, an anomaly in a road segment of the operating environment based upon the environmental data, including determining a type of the anomaly and a severity of the anomaly indicating the anomaly limits or prevents continuing operation of the vehicle along the route, the severity of the anomaly is determined as a risk level indicative of vehicle damage or accident occurrence due to the anomaly in the road segment;

determining, by one or more processors, a corrective action relating to the anomaly based upon the type and severity of the anomaly, wherein the corrective action includes routing the vehicle to avoid the road segment associated with the anomaly during continuing operation to the destination by continuing operation along an alternative route to the destination;

implementing, by one or more processors, the corrective action to adjust operation of the vehicle in response to the anomaly; and

communicating, by a communication component of the vehicle, an alert to one or more other vehicles, wherein the alert includes an indication of the type of the anomaly and an indication of a location of the anomaly.

2. The computer-implemented method of claim 1 , wherein identifying the anomaly includes evaluating the environmental data using a machine learning model, the machine learning model having previously been trained using data associated with known anomalous conditions.

3. The computer-implemented method of claim 1 , wherein:

determining the corrective action includes determining the risk level is above a response threshold.

4. The computer-implemented method of claim 1 , wherein the severity of the anomaly is determined as a risk level associated with the anomaly, and further comprising:

determining, by one or more processors, the risk level is above a broadcast threshold level prior to communicating the alert.

5. The computer-implemented method of claim 4 , further comprising:

receiving, at a processor associated with at least one of the other vehicles, the alert; and

implementing, by the processor associated with the at least one of the other vehicles, one or more of the following actions: (i) presenting a notification to a vehicle operator of the at least one of the other vehicles, or (ii) controlling the at least one of the other vehicles to avoid the anomaly.

6. The computer-implemented method of claim 4 , wherein:

communicating the alert to the one or more other vehicles includes communicating the alert to a remote server that communicates the alert to the one or more other vehicles via a communication network; and

the remote server updates a map database to associate information regarding the anomaly with data regarding suitability for autonomous vehicle operation of the road segment associated with the location of the anomaly.

7. The computer-implemented method of claim 6 , wherein the other vehicles are prevented from generating alerts regarding the anomaly for a predetermined period of time.

8. The computer-implemented method of claim 4 , wherein the alert is communicated to the one or more other vehicles by controlling one or more external lights of the vehicle to transmit data by a controlled sequence of variable periods of illumination specifying the alert.

9. The computer-implemented method of claim 1 , further comprising:

controlling, by one or more processors, operation of the vehicle using at least one of the one or more autonomous operation features;

wherein the one or more autonomous operation features are associated with a plurality of sensors disposed within the vehicle; and

wherein the environmental data is obtained from one or more of the plurality of sensors.

10. The computer-implemented method of claim 9 , wherein:

the environmental sensor data includes information regarding observed operation of another vehicle ahead of the vehicle; and

the anomaly is identified based upon observed movements of the other vehicle ahead of the vehicle.

11. The computer-implemented method of claim 1 , wherein:

the one or more autonomous operation features include an autonomous communication feature configured to communicate autonomously with other vehicles;

the environmental data is received as an autonomous message from another vehicle via the autonomous communication feature; and

the anomaly is identified based upon information included in the autonomous message.

12. The computer-implemented method of claim 1 , wherein the type of the anomaly comprises one or more of: (i) road construction; (ii) a flooded road; (iii) a pot hole; (iv) debris in a traffic lane; (v) inadequate road or lane marking visibility; (vi) presence of a bicycle lane; (vii) inoperable traffic lights; (viii) inadequate road lighting from street lights; (ix) presence of a pedestrian; (x) presence of a school bus stop; (xi) presence of a school zone; (xii) traffic direction by emergency personnel; (xiii) a traffic accident; (xiv) a detour; (xv) presence of children; or (xvi) presence of an animal.

13. A computer system for anomalous condition detection and response by a vehicle having one or more autonomous operation features, comprising:

one or more processors disposed within the vehicle; and

a program memory coupled to the one or more processors and storing executable instructions that, when executed by the one or more processors, cause the computer system to:

obtain environmental data regarding an operating environment ahead of the vehicle during vehicle operation along a route to a destination, the environmental data being associated with the one or more autonomous operation features and including a GPS location of the vehicle;

identify an anomaly in a road segment of the operating environment based upon the environmental data, including determining a type of the anomaly and a severity of the anomaly indicating the anomaly limits or prevents continuing operation of the vehicle along the route, the severity of the anomaly is determined as a risk level indicative of vehicle damage or accident occurrence due to the anomaly in the road segment;

determine a corrective action relating to the anomaly based upon the type and severity of the anomaly, wherein the corrective action includes routing the vehicle to avoid the road segment associated with the anomaly during continuing operation to the destination by continuing operation along an alternative route to the destination;

implement the corrective action to adjust operation of the vehicle in response to the anomaly; and

communicate an alert to one or more other vehicles by the autonomous communication feature of the vehicle, the alert including an indication of the type of the anomaly and an indication of a location of the anomaly.

14. The computer system of claim 13 , wherein:

the one or more autonomous operation features are associated with a plurality of sensors disposed within the vehicle;

the environmental data is obtained from one or more of the plurality of sensors;

the environmental sensor data includes information regarding observed operation of another vehicle ahead of the vehicle; and

the anomaly is identified based upon observed movements of the other vehicle ahead of the vehicle.

15. The computer system of claim 13 , further comprising an autonomous communication feature configured to communicate autonomously with other vehicles, wherein:

the executable instructions further cause the computer system to:

determine the risk level is above a broadcast threshold level prior to communicating the alert.

16. The computer system of claim 13 , further comprising an autonomous communication feature configured to communicate autonomously with other vehicles, wherein:

the one or more autonomous operation features include the autonomous communication feature;

the environmental data is received as an autonomous message from another vehicle via the autonomous communication feature; and

the anomaly is identified based upon information included in the autonomous message.

17. A tangible, non-transitory computer-readable medium storing executable instructions for anomalous condition detection and response by a vehicle having one or more autonomous operation features that, when executed by at least one processor of a computer system, cause the computer system to:

obtain environmental data regarding an operating environment ahead of the vehicle during vehicle operation along a route to a destination, the environmental data being associated with the one or more autonomous operation features and including a GPS location of the vehicle;

identify an anomaly in a road segment of the operating environment based upon the environmental data, including determining a type of the anomaly and a severity of the anomaly indicating the anomaly limits or prevents continuing operation of the vehicle along the route, the severity of the anomaly is determined as a risk level indicative of vehicle damage or accident occurrence due to the anomaly in the road segment;

determine a corrective action relating to the anomaly based upon the type and severity of the anomaly, wherein the corrective action includes routing the vehicle to avoid the road segment associated with the anomaly during continuing operation to the destination by continuing operation along an alternative route to the destination;

implement the corrective action to adjust operation of the vehicle in response to the anomaly; and

communicate an alert to one or more other vehicles by an autonomous communication feature of the vehicle, the alert including an indication of the type of the anomaly and an indication of a location of the anomaly.

18. The tangible, non-transitory computer-readable medium of claim 17 , wherein:

the executable instructions further cause the computer system to:

determine the risk level is above a broadcast threshold level prior to communicating the alert.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2017
From: KONRARDY, BLAKE; CHRISTENSEN, SCOTT T.; HAYWARD, GREGORY; FARRIS, SCOTT
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 041471/0673 →
Continuity (35)
Provisional Application 62434359 · Dec 14, 2016
Provisional Application 62434355 · Dec 14, 2016
Provisional Application 62434361 · Dec 14, 2016
Provisional Application 62434370 · Dec 14, 2016
Provisional Application 62434368 · Dec 14, 2016
Provisional Application 62434365 · Dec 14, 2016
Provisional Application 62430215 · Dec 5, 2016
Provisional Application 62428843 · Dec 1, 2016
Provisional Application 62424078 · Nov 18, 2016
Provisional Application 62424093 · Nov 18, 2016
Provisional Application 62419017 · Nov 8, 2016
Provisional Application 62418999 · Nov 8, 2016
Provisional Application 62419009 · Nov 8, 2016
Provisional Application 62418988 · Nov 8, 2016
Provisional Application 62419023 · Nov 8, 2016
Provisional Application 62419002 · Nov 8, 2016
Provisional Application 62415672 · Nov 1, 2016
Provisional Application 62415668 · Nov 1, 2016
Provisional Application 62415678 · Nov 1, 2016
Provisional Application 62415673 · Nov 1, 2016
Provisional Application 62406605 · Oct 11, 2016
Provisional Application 62406600 · Oct 11, 2016
Provisional Application 62406595 · Oct 11, 2016
Provisional Application 62406611 · Oct 11, 2016
Provisional Application 62381848 · Aug 31, 2016
Provisional Application 62380686 · Aug 29, 2016
Provisional Application 62376044 · Aug 17, 2016
Provisional Application 62373084 · Aug 10, 2016
Provisional Application 62351559 · Jun 17, 2016
Provisional Application 62349884 · Jun 14, 2016
Provisional Application 62312109 · Mar 23, 2016
Provisional Application 62303500 · Mar 4, 2016
Provisional Application 62302990 · Mar 3, 2016
Provisional Application 62287659 · Jan 27, 2016
Provisional Application 62286017 · Jan 22, 2016
Cited By (8)
US 12,205,468 US 12,313,414 US 12,345,536 US 12,359,927 US 12,461,233 US 12,560,443 US 12,662,161 US 12,662,162