IP Library Granted Patent US 11,440,494
Granted Patent B1
US 11,440,494 · App. 16/669,097 · Granted Sep 13, 2022

Detecting and responding to autonomous vehicle incidents

Inventors: Blake S. Konrardy (San Francisco, CA); Gregory L. Hayward (Bloomington, IL); Scott Farris (Bloomington, IL); Scott T. Christensen (Salem, OR)
Assignee: State Farm Mutual Automobile Insurance Company
B60R21/0136B60R21/34G05D1/0011G05D1/0061G05D1/0088G07C5/008G07C5/0808G07C5/0816B60R2021/0027B60R2021/01013
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,440,494
App. No.
16/669,097
Granted
Sep 13, 2022
Kind
B1
Abstract

Methods and systems for assessing, detecting, and responding to malfunctions involving components of autonomous vehicles and/or smart homes are described herein. Autonomous operation features and related components can be assessed using direct or indirect data regarding operation. Vehicle collision and/or smart home incident monitoring, damage detection, and responses are also described, with particular focus on the particular challenges associated with incident response for unoccupied vehicles and/or smart homes. Operating data associated with the autonomous vehicle and/or smart home may be received. Within the operating, an unusual condition indicative of a likelihood of incident may be detected. Based on the unusual condition, it may be determined that the incident occurred. Accordingly, a response to the incident may be determined. The response may be implemented by the autonomous vehicle and/or smart home.

Claims (57)

1. A computer-implemented method for detecting and responding to an autonomous vehicle collision, comprising:

monitoring, by one or more processors, operation of an autonomous vehicle by receiving and processing operating data associated with a plurality of autonomous operation features while the autonomous vehicle is operating;

identifying, by one or more processors, an unusual condition in the operating data, the unusual condition indicative of a likelihood of an incident occurring during operation of the autonomous vehicle;

causing, by one or more processors, one or more sensors to be activated and further to obtain additional operating data;

determining, by one or more processors, that a collision has occurred based upon a portion of the operating data associated with the unusual condition and the additional operating data;

determining, by one or more processors, a response to the collision based upon the received operating data and the additional operating data; and

causing, by one or more processors, the autonomous vehicle to implement the determined response.

2. The computer-implemented method of claim 1 , wherein the operating data includes sensor data from a plurality of sensors associated with the autonomous operation features and control data generated by the plurality of autonomous operation features.

3. The computer-implemented method of claim 1 , wherein:

determining the response to the collision includes determining, by one or more processors, to continue operating the autonomous vehicle based upon the received operating data; and

causing the autonomous vehicle to implement the determined response includes causing, by one or more processors, the autonomous vehicle to continue operating to a destination.

4. The computer-implemented method of claim 1 , wherein:

determining the response to the collision includes determining, by one or more processors, not to continue operating the autonomous vehicle based upon the received operating data; and

causing the autonomous vehicle to implement the determined response includes causing, by one or more processors, the autonomous vehicle to cease operation.

5. The computer-implemented method of claim 1 , further comprising:

transmitting, via a communication network, (i) image data from one or more image capture devices within the autonomous vehicle and/or (ii) operating data associated with the autonomous vehicle to a computing device associated with a human reviewer; and

receiving, via the communication network, an indication verifying the determined collision,

wherein the response is determined based upon the received indication verifying the determined collision.

6. The computer-implemented method of claim 5 , wherein the indication verifying the determined collision further includes one or more instructions regarding the response to be implemented by the autonomous vehicle.

7. The computer-implemented method of claim 1 , wherein the unusual condition includes a discontinuity in the operating data, a divergence between sensor data from one or more sensors and control data from one or more autonomous operation features, or a plurality of sensor malfunctions.

8. The computer-implemented method of claim 1 , further comprising:

determining, by one or more processors, that damage to another object has occurred based upon the received operating data; and

communicating, by one or more processors, information regarding the damage to another object.

9. The computer-implemented method of claim 1 , further comprising:

determining, by one or more processors, that the determined collision has resulted in an injury to a person outside the autonomous vehicle; and

causing, by one or more processors, an emergency action to be implemented.

10. The computer-implemented method of claim 9 , wherein the emergency action includes enabling communication between the person and an emergency assistance representative using (i) one or more speakers disposed within the autonomous vehicle and/or (ii) video communication equipment disposed within the autonomous vehicle.

11. The computer-implemented method of claim 9 , wherein the emergency action includes operating the autonomous vehicle in the fully autonomous mode to convey the person to a facility associated with emergency services.

12. The computer-implemented method of claim 11 , wherein the facility is a hospital.

13. The computer-implemented method of claim 1 , further comprising:

determining, by one or more processors, damage to the autonomous vehicle from the collision,

wherein the response includes (i) causing the autonomous vehicle to travel to a vehicle repair facility for repair of the determined damage and (ii) causing the autonomous vehicle to resume travel to a destination following repair.

14. The computer-implemented method of claim 1 , wherein the response includes causing the autonomous vehicle to move out of a traffic lane of a roadway.

15. The computer-implemented method of claim 1 , wherein the response includes establishing a two-way communication link between the autonomous vehicle and a remote user using input and output components of the autonomous vehicle.

16. The computer-implemented method of claim 15 , wherein:

the remote user is an owner or operator of the autonomous vehicle,

the input component includes a microphone and/or camera, and

the output component includes a speaker and/or a display.

17. The computer-implemented method of claim 1 , wherein the response includes allowing manual control of the autonomous vehicle for a limited distance or duration of operation following the collision.

18. The computer-implemented method of claim 1 , wherein the response includes granting remote control of the autonomous vehicle to a remote agent following the collision.

19. A computer system configured to detect and respond to an autonomous vehicle collision, comprising:

one or more processors;

one or more transceivers adapted to communicate with a plurality of components associated with autonomous operation features of the autonomous vehicle; and

a non-transitory program memory coupled to the one or more processors and storing executable instructions that, when executed by the one or more processors, cause the computer system to:

monitor operation of an autonomous vehicle by receiving, via the one or more transceivers, and processing operating data associated with the plurality of autonomous operation features while the autonomous vehicle is operating;

identify an unusual condition in the operating data, such unusual condition indicative of a likelihood of an incident occurring during operation of the autonomous vehicle;

cause one or more sensors to activate and further to obtain additional operating data;

determine that a collision has occurred based upon a portion of the operating data associated with the unusual condition and the additional operating data;

determine a response to the collision based upon the received operating data and the additional operating data; and

cause the autonomous vehicle to implement the determined response.

20. A non-transitory computer-readable storage medium storing processor-executable instructions, that when executed cause one or more processors to:

monitor operation of an autonomous vehicle by receiving, via one or more transceivers, and processing operating data associated with the plurality of autonomous operation features while the autonomous vehicle is operating;

identify an unusual condition in the operating data, such unusual condition indicative of a likelihood of an incident occurring during operation of the autonomous vehicle;

cause one or more sensors to be activated and further to obtain additional operating data;

determine that a collision has occurred based upon a portion of the operating data associated with the unusual condition and the additional operating data;

determine a response to the collision based upon the received operating data and the additional operating data; and

cause the autonomous vehicle to implement the determined response.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2019
From: KONRARDY, BLAKE; CHRISTENSEN, SCOTT T.; HAYWARD, GREGORY; FARRIS, W. SCOTT
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 050874/0032 →
Continuity (36)
Continuation 15409359 · Jan 18, 2017
Provisional Application 62434359 · Dec 14, 2016
Provisional Application 62434365 · Dec 14, 2016
Provisional Application 62434370 · Dec 14, 2016
Provisional Application 62434361 · Dec 14, 2016
Provisional Application 62434368 · Dec 14, 2016
Provisional Application 62434355 · Dec 14, 2016
Provisional Application 62430215 · Dec 5, 2016
Provisional Application 62428843 · Dec 1, 2016
Provisional Application 62424093 · Nov 18, 2016
Provisional Application 62424078 · Nov 18, 2016
Provisional Application 62419002 · Nov 8, 2016
Provisional Application 62419023 · Nov 8, 2016
Provisional Application 62418999 · Nov 8, 2016
Provisional Application 62419017 · Nov 8, 2016
Provisional Application 62419009 · Nov 8, 2016
Provisional Application 62418988 · Nov 8, 2016
Provisional Application 62415668 · Nov 1, 2016
Provisional Application 62415678 · Nov 1, 2016
Provisional Application 62415672 · Nov 1, 2016
Provisional Application 62415673 · Nov 1, 2016
Provisional Application 62406611 · Oct 11, 2016
Provisional Application 62406595 · Oct 11, 2016
Provisional Application 62406605 · Oct 11, 2016
Provisional Application 62406600 · Oct 11, 2016
Provisional Application 62381848 · Aug 31, 2016
Provisional Application 62380686 · Aug 29, 2016
Provisional Application 62376044 · Aug 17, 2016
Provisional Application 62373084 · Aug 10, 2016
Provisional Application 62351559 · Jun 17, 2016
Provisional Application 62349884 · Jun 14, 2016
Provisional Application 62312109 · Mar 23, 2016
Provisional Application 62303500 · Mar 4, 2016
Provisional Application 62302990 · Mar 3, 2016
Provisional Application 62287659 · Jan 27, 2016
Provisional Application 62286017 · Jan 22, 2016