Systems, apparatuses and methods for detecting driving behavior and triggering actions based on detected driving behavior
Systems, apparatuses and methods for detecting the presence of certain driving behavior are disclosed. Driving behavior is detected by capturing and characterizing image data and sampling vehicle telemetry data. Real-time characterization techniques include object and shape recognition analytics to detect specifically designated content in captured image data. Actions are triggered based upon such detection.
1. A system structured for use in association with a vehicle, the system comprising:
at least one camera device configured to capture image data;
at least one microphone configured to capture voice data;
a sensor system comprising:
at least one sensor configured to capture vehicle telemetry data;
a global positioning system (GPS) device to capture current location data; and
a speed sensor or an accelerometer; and
a microprocessor communicatively coupled to the at least one camera device and the sensor system, wherein the microprocessor is configured with instructions to cause the microprocessor to:
receive information regarding analysis of captured image data and captured vehicle telemetry data;
detect an occurrence of at least one designated event based on the analysis;
obtain the current location data from the sensor system;
determine that the at least one camera device is within a proximity threshold with respect to the current location data and a location of capture of the image data causing the at least one designated event; and
trigger one or more actions based on the determination, the one or more actions including:
initiating transmission of a live stream of image data from the at least one camera device to at least one other device located in a second vehicle or located at a facility, wherein the live stream transmission is observable with the other device by at least one user located in the second vehicle or located at the facility,
capturing voice data with the microphone, and
creating a text file representation of the captured voice data.
2. The system of claim 1 , wherein the at least one designated event comprises at least one of (i) a speed or acceleration of the vehicle is outside of a threshold, (ii) failure to stop at a traffic light, (iii) failure to stop at a stop sign, (iv) a collision, (v) a near collision, (vi) reckless driving, and (vii) rollover of the vehicle.
3. The system of claim 1 , wherein the instructions to cause the microprocessor to trigger one or more actions further comprise instructions to cause the microprocessor to initiate an action to:
record image data captured by the at least one camera device to internal memory; and
bookmark the at least one designated event in metadata associated with the image data captured by the at least one camera device.
4. The system of claim 1 , wherein triggering the one or more actions comprises initiating an action to intervene into driving dynamics of the vehicle.
5. The system of claim 3 , wherein the instructions to cause the microprocessor to bookmark include instructions to cause the microprocessor to create a timestamp index in an image data recording associated with particular image data selected from the captured image data, the particular image data pertaining to the designated event.
6. The system of claim 1 , wherein triggering the one or more actions comprises initiating an action to activate data recording by the at least one camera device or another device.
7. The system of claim 6 , wherein the activating data recording by the at least one camera device or another device comprises at least one of:
(i) activating one or more camera devices located external to the vehicle and within a set range of a location of the occurrence of at least one designated event, or
(ii) causing one or more devices, located external to the vehicle and within a set range of a location of the occurrence of at least one designated event, to start analyzing captured image data.
8. The system of claim 1 , wherein triggering the one or more actions comprises performing a keyword search of the text file representative of the captured voice data.
9. The system of claim 1 , wherein triggering the one or more actions comprises initiating an action to display an image pertaining to the at least one designated event on a display in the vehicle.
10. The system of claim 1 , wherein the system further comprises:
a receiver communicatively coupled to the microprocessor and operable to receive communications via a communications network, wherein the microprocessor is operable to receive communications via the receiver;
a memory communicatively coupled to the microprocessor and operable to store data, wherein the microprocessor is operable to store data in the memory; and
a communication connection to a remote server communicatively coupled to the at least one camera device via a communications network and operable to receive image data captured by the at least one camera device.
11. The system of claim 1 , wherein the transmission of the live stream of the image data comprises transmission of current image data to a device external to the vehicle as new image data is being captured.
12. The system of claim 1 , wherein the analysis of captured image data and captured vehicle telemetry data comprises defining a bounding box in a video frame of the captured image data and comparing dimensions of the bounding box over time, the bounding box representing an object or person external to the vehicle.
13. A method, comprising:
capturing image data using a camera device, wherein the camera device is mounted to a vehicle;
sampling telemetry data from at least one sensor of a sensor system, wherein the at least one sensor is mounted to the vehicle and comprises a speed sensor or an accelerometer;
obtaining current location data of the vehicle from a global positioning system (GPS) of the sensor system;
detecting an occurrence of at least one designated event from at least one of (i) the sampled telemetry data and (ii) the captured image data, based on analysis of at least one of the captured image data and the sampled telemetry data;
determining that the at least one camera device is within a proximity threshold with respect to the current location data and a location of capture of the image data causing the at least one designated event; and
triggering one or more actions based on the determining, the one or more actions including
initiating transmission of a live stream of captured image data from the at least one camera device to at least one other device located in a second vehicle or located at a facility, wherein the live stream transmission is observable with the other device by at least one user located in the second vehicle or located at the facility,
capturing voice data with at least one microphone, and
creating a text file representation of the captured voice data.
14. The method of claim 13 , wherein the at least one designated event comprises at least one of (i) a speed or acceleration of the vehicle is outside of a threshold, (ii) failure to stop at a traffic light, (iii) failure to stop at a stop sign, (iv) a collision, (v) a near collision, (vi) reckless driving, and (vii) rollover of the vehicle.
15. The method of claim 13 , wherein triggering the one or more actions comprises initiating an action to cause:
recording the image data captured by the camera device to internal memory; and
bookmarking the at least one designated event in metadata associated with the image data captured by the camera device.
16. The method of claim 13 , wherein triggering the one or more actions comprises initiating an action to intervene into driving dynamics of the vehicle.
17. The method of claim 13 , wherein triggering the one or more actions comprises initiating an action to activate data recording by the camera device or another device.
18. The method of claim 17 , wherein the initiating an action to activate data recording by the camera device or another device comprises at least one of:
(i) activating one or more camera devices located external to the vehicle and within a set range of a location of the occurrence of at least one designated event, or
(ii) causing one or more devices, located external to the vehicle and within a set range of a location of the occurrence of at least one designated event, to start analyzing captured image data.
19. The method of claim 13 , wherein triggering the one or more actions comprises initiating an action to perform a keyword search of the text file representative of the captured voice data.
20. The method of claim 13 , wherein triggering the one or more actions comprises initiating an action to display an image pertaining to the at least one designated event on a display in the vehicle.
21. The method of claim 13 , further comprising:
using a receiver, receiving communications via a communications network; and
transmitting at least one of:
(i) image data captured by the camera device, or
(ii) telemetry data sampled from the at least one sensor;
wherein the transmitting is to at least one of (i) a local memory or (ii) remote storage.