Object-model based event detection system
Example embodiments described herein therefore relate to an object-model based event detection system that comprises a plurality of sensor devices, to perform operations that include: generating sensor data at the plurality of sensor devices; accessing the sensor data generated by the plurality of sensor devices; detecting an event, or precursor to an event, based on the sensor data, wherein the detected event corresponds to an event category; accessing an object model associated with the event type in response to detecting the event, wherein the object model defines a procedure to be applied by the event detection system to the sensor data; and streaming at least a portion of a plurality of data streams generated by the plurality of sensor devices to a server system based on the procedure, wherein the server system may perform further analysis or visualization based on the portion of the plurality of data streams.
1. A system comprising:
a plurality of sensor devices that generate sensor data that comprises a plurality of data streams;
a memory; and
at least one hardware processor to perform operations comprising:
accessing a video stream generated by a first sensor device from among the plurality of sensor devices of a vehicle, the video-stream comprising a video frame;
detecting a feature within the video frame of the video-stream;
identifying an object model that corresponds with the feature from among a plurality of object models, the object model comprising a set of display instructions, an identification of a second sensor device from among the plurality of sensor devices, and a client device from among one or more client devices;
accessing the second sensor device from among the plurality of sensor devices based on the object model, the second sensor device configured to generate sensor data;
generating a visualization of the sensor data based on the set of display instructions of the object model; and
presenting a notification that includes the visualization of the sensor data generated by the second sensor device at the client device identified by the object model.
2. The system of claim 1 , wherein the plurality of data streams comprise one or more of:
an audio stream that comprises audio data;
an accelerometer stream that comprises the inertial data; and
a global positioning system stream that comprises location data.
3. The system of claim 1 , wherein the video frame comprises a timestamp, and the transmitting the sensor data generated by the second sensor device further comprises:
accessing a portion of the second sensor data based on the timestamp of the video frame; and
transmitting the portion of the second sensor data to the server.
4. The system of claim 1 , wherein the first sensor device comprises a driver-facing dashcam.
5. The system of claim 1 , wherein the transmitting the sensor data to the server comprises transmitting a first portion of the sensor data to the server, and the operations further comprise:
detecting a trigger event at the server based on the first portion of the sensor data generated by the second sensor device; and
transmitting a second portion of the sensor device to the server based on the detecting the trigger event.
6. A method comprising:
accessing a video stream generated by a first sensor device from among the plurality of sensor devices of a vehicle, the video-stream comprising a video frame;
detecting a feature within the video frame of the video-stream;
identifying an object model that corresponds with the feature from among a plurality of object models, the object model comprising a set of display instructions, an identification of a second sensor device from among the plurality of sensor devices, and a client device from among one or more client devices;
accessing the second sensor device from among the plurality of sensor devices based on the object model, the second sensor device configured to generate sensor data;
generating a visualization of the sensor data based on the set of display instructions of the object model; and
presenting a notification that includes the visualization of the sensor data generated by the second sensor device at the client device identified by the object model.
7. The method of claim 6 , wherein the plurality of data streams comprise one or more of:
an audio stream that comprises audio data;
an accelerometer stream that comprises the inertial data; and
a global positioning system stream that comprises location data.
8. The method of claim 6 , wherein the video frame comprises a timestamp, and the transmitting the sensor data generated by the second sensor device further comprises:
accessing a portion of the second sensor data based on the timestamp of the video frame; and
transmitting the portion of the second sensor data to the server.
9. The method of claim 6 , wherein the first sensor device comprises a driver-facing dashcam.
10. The method of claim 6 , wherein the transmitting the sensor data to the server comprises transmitting a first portion of the sensor data to the server, and the method further comprises:
detecting a trigger event at the server based on the first portion of the sensor data generated by the second sensor device; and
transmitting a second portion of the sensor device to the server based on the detecting the trigger event.
11. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
accessing a video stream generated by a first sensor device from among the plurality of sensor devices of a vehicle, the video-stream comprising a video frame;
detecting a feature within the video frame of the video-stream;
identifying an object model that corresponds with the feature from among a plurality of object models, the object model comprising a set of display instructions, an identification of a second sensor device from among the plurality of sensor devices, and a client device from among one or more client devices;
accessing the second sensor device from among the plurality of sensor devices based on the object model, the second sensor device configured to generate sensor data;
generating a visualization of the sensor data based on the set of display instructions of the object model; and
presenting a notification that includes the visualization of the sensor data generated by the second sensor device at the client device identified by the object model.
12. The non-transitory machine-readable storage medium of claim 11 , wherein the plurality of data streams comprise one or more of:
an audio stream that comprises audio data;
an accelerometer stream that comprises the inertial data; and
a global positioning system stream that comprises location data.
13. The non-transitory machine-readable storage medium of claim 11 , wherein the video frame comprises a timestamp, and the transmitting the sensor data generated by the second sensor device further comprises:
accessing a portion of the second sensor data based on the timestamp of the video frame; and
transmitting the portion of the second sensor data to the server.
14. The non-transitory machine-readable storage medium of claim 11 , wherein the first sensor device comprises a driver-facing dashcam.