Detecting and responding to autonomous environment incidents
Methods and systems for assessing, detecting, and responding to malfunctions involving components of autonomous vehicles and/or smart homes are described herein. Autonomous operation features and related components can be assessed using direct or indirect data regarding operation. Vehicle collision and/or smart home incident monitoring, damage detection, and responses are also described, with particular focus on the particular challenges associated with incident response for unoccupied vehicles and/or smart homes. Operating data associated with the autonomous vehicle and/or smart home may be received. Within the operating, an unusual condition indicative of a likelihood of incident may be detected. Based on the unusual condition, it may be determined that the incident occurred. Accordingly, a response to the incident may be determined. The response may be implemented by the autonomous vehicle and/or smart home.
1. A computer-implemented method for detecting and responding to a smart home incident, the method being implemented at a smart home controller storing a plurality of software routines and comprising:
detecting, by one or more processors, that a smart home is operating in a fully autonomous mode without occupants;
monitoring, by one or more processors executing a first sensor control routine of the plurality of software routines, operation of the smart home by receiving and processing operating data associated with a plurality of autonomous operation features while the smart home is operating;
identifying, by one or more processors, an unusual condition in the operating data, the unusual condition indicative of a likelihood of an incident occurring during operation of the smart home;
determining, by one or more processors, that an incident has occurred based upon a portion of the operating data associated with the unusual condition, wherein determining that an incident has occurred includes determining that damage has occurred to one or more components of the smart home;
selecting, by one or more processors, a response to the incident from a plurality of responses based upon the received operating data;
causing, by one or more processors, the smart home to implement the selected response by calling an autonomous control routine of the plurality of software routines associated with the selected response to automatically control smart equipment disposed in the smart home, wherein implementing the selected response includes continuing to operate the smart home; and
in response to the smart home continuing to operate, further monitoring, by the one or more processors executing a second sensor control routine of the plurality of software routines, further operation of the smart home to identify a further unusual condition, wherein the second sensor control routine configures the one or more processors to exclude further operating data received from the one or more damaged components of the smart home when identifying the further unusual condition.
2. The computer-implemented method of claim 1 , wherein the operating data includes sensor data from a plurality of sensors associated with the autonomous operation features and control data generated by the plurality of autonomous operation features.
3. The computer-implemented method of claim 1 , further comprising:
transmitting, via a communication network, (i) image data from one or more image capture devices within the smart home and/or (ii) operating data associated with the smart home to a computing device associated with a human reviewer; and
receiving, via the communication network, an indication verifying the determined incident,
wherein the response is selected based upon the received indication verifying the determined incident.
4. The computer-implemented method of claim 3 , wherein the indication verifying the determined incident further includes one or more instructions regarding the response to be implemented by the smart home.
5. The computer-implemented method of claim 1 , wherein the unusual condition includes a discontinuity in the operating data, a divergence between sensor data from one or more sensors and control data from one or more autonomous operation features, or a plurality of sensor malfunctions.
6. The computer-implemented method of claim 1 , further comprising:
determining, by one or more processors, that damage to another object has occurred based upon the received operating data; and
communicating, by one or more processors, information regarding the damage to another object.
7. The computer-implemented method of claim 1 , further comprising:
determining, by one or more processors, that the determined incident has resulted in an injury to a person outside the smart home; and
causing, by one or more processors, an emergency action to be implemented.
8. The computer-implemented method of claim 7 , wherein the emergency action includes enabling communication between the person and an emergency assistance representative using (i) one or more speakers disposed within the smart home and/or (ii) video equipment disposed within the smart home.
9. The computer-implemented method of claim 1 , wherein the response includes establishing a two-way communication link between the smart home and a remote user using input and output components of the smart home.
10. The computer-implemented method of claim 9 , wherein:
the remote user is an owner or operator of the smart home,
the input component includes a microphone and/or a camera, and
the output component includes a speaker and/or a display.
11. The computer-implemented method of claim 1 , wherein the response includes allowing manual control of the smart home for a limited duration of operation following the incident.
12. The computer-implemented method of claim 1 , wherein the response includes granting autonomous control of the smart home to a remote agent following the incident.
13. A computer system configured to detect and respond to a smart home incident, comprising:
one or more processors;
a communication module adapted to communicate with a plurality of components associated with autonomous operation features of the smart home;
a database storing a plurality of software routines; and
a non-transitory program memory coupled to the one or more processors and storing executable instructions that, when executed by the one or more processors, cause the computer system to:
detect that a smart home is operating in a fully autonomous mode without occupants;
monitor operation of the smart home via a first sensor control routine of the plurality of software routines and by receiving, via the communication module, and processing operating data associated with the plurality of autonomous operation features while the smart home is operating;
identify an unusual condition in the operating data, such unusual condition indicative of a likelihood of an incident occurring during operation of the smart home;
determine that an incident has occurred based upon a portion of the operating data associated with the unusual condition, wherein determining that an incident has occurred includes determining that damage has occurred to one or more components of the plurality of components;
select a response to the incident from a plurality of responses based upon the received operating data;
cause the smart home to implement the selected response by calling an autonomous control routine of the plurality of software routines associated with the selected response to automatically control at least one of the plurality of components, wherein implementing the selected response includes continuing to operate the smart home;
and in response to the smart home continuing to operate, further monitor via a second sensor control routine of the plurality of software routines, further operation of the smart home to identify a further unusual condition, wherein the second sensor control routine excludes analyzing further operating data received from the one or more damaged components of the smart home when identifying the further unusual condition.
14. The computer system of claim 13 , wherein, the instructions, when executed by the one or more processors, further cause the computer system to:
transmit, via a communication network, (i) image data from one or more image capture devices within the smart home and/or (ii) operating data associated with the smart home to a computing device associated with a human reviewer; and
receive, via the communication network, an indication verifying the determined incident,
wherein the response is selected based upon the received indication verifying the determined incident.
15. The computer system of claim 14 , wherein the indication verifying the determined incident further includes one or more instructions regarding the response to be implemented by the smart home.
16. The computer system of claim 13 , wherein the response includes establishing a two-way communication link between the smart home and a remote user using input and output components of the smart home.
17. The computer system of claim 16 , wherein:
the remote user is an owner or operator of the smart home,
the input component includes a microphone and/or a camera, and
the output component includes a speaker and/or a display.
18. A non-transitory computer-readable storage medium storing processor-executable instructions, that when executed cause one or more processors to:
detect that a smart home is operating in a fully autonomous mode without occupants;
execute a first sensor control routine to monitor operation of the smart home by receiving, via a communication network, and processing operating data associated with a plurality of autonomous operation features while the smart home is operating;
identify an unusual condition in the operating data, such unusual condition indicative of a likelihood of an incident occurring during operation of the smart home;
determine that an incident has occurred based upon a portion of the operating data associated with the unusual condition, wherein determining that an incident has occurred includes determining that damage has occurred to one or more components of the smart home;
select a response to the incident from a plurality of responses based upon the received operating data;
cause the smart home to implement the selected response by calling an autonomous control routine associated with the selected response to automatically control smart equipment disposed in the smart home, wherein implementing the selected response includes continuing to operate the smart home; and
in response to the smart home continuing to operate, execute a second sensor control routine to further monitor further operation of the smart home to identify a further unusual condition, wherein the second sensor control routine excludes analyzing further operating data received from the one or more damaged components of the smart home when identifying the further unusual condition.