Systems and methods for categorizing motion events
The various embodiments described herein include methods, devices, and systems for categorizing motion events. In one aspect, a method is performed at a camera device. The method includes: (1) capturing a plurality of video frames via the image sensor, the plurality of video frames corresponding to a scene in a field of view of the camera; (2) sending the video frames to the remote server system in real-time; (3) while sending the video frames to the remote server system in real-time: (a) determining that motion has occurred within the scene; (b) in response to determining that motion has occurred within the scene, characterizing the motion as a motion event; and (c) generating motion event metadata for the motion event; and (4) sending the generated motion event metadata to the remote server system concurrently with the video frames.
1. A method, comprising:
at a camera device having an image sensor, one or more processors, and memory:
capturing a plurality of video frames via the image sensor, the plurality of video frames corresponding to a scene in a field of view of the camera device;
sending the video frames to the remote server system in real-time;
while sending the video frames to the remote server system in real-time:
determining that motion has occurred within the scene;
in response to determining that motion has occurred within the scene, characterizing the motion as a motion event; and
generating motion event metadata for the motion event, the motion event metadata identifying one or more video frames associated with the motion event; and
sending the generated motion event metadata to the remote server system concurrently with the video frames.
2. The method of claim 1 , further comprising identifying within the motion event one or more motion entities; and
wherein the motion event metadata includes identification information for the one or more motion entities.
3. The method of claim 1 , further comprising calculating, at the camera device, an amount of motion between frames in the plurality of video frames; and
wherein the motion event metadata further includes information regarding the amount of motion between frames in the plurality of video frames.
4. The method of claim 1 , further comprising generating, at the remote server system, a classification for the motion event based on an analysis of the plurality of video frames and the received motion event metadata.
5. The method of claim 1 , further comprising generating an alert for the motion event.
6. The method of claim 1 , further comprising sending, from the camera device, camera mode information to the remote server system.
7. The method of claim 1 , further comprising sending, from the camera device, environmental information to the remote server system.
8. The method of claim 1 , wherein the determining is based on an amount of pixel differences between frames in the plurality of video frames.
9. A camera device, comprising:
an image sensor configured to capture a scene;
one or more processors coupled to the image sensor; and
memory coupled to the one or more processors, the memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
capturing a plurality of video frames via the image sensor, the plurality of video frames corresponding to a scene in a field of view of the camera device;
sending the video frames to the remote server system in real-time;
while sending the video frames to the remote server system in real-time:
determining that motion has occurred within the scene;
in response to determining that motion has occurred within the scene, characterizing the motion as a motion event; and
generating motion event metadata for the motion event, the motion event metadata identifying one or more video frames associated with the motion event; and
sending the generated motion event metadata to the remote server system concurrently with the video frames.
10. The device of claim 9 , wherein the one or more programs further include instructions for identifying within the motion event one or more motion entities; and
wherein the motion event metadata includes identification information for the one or more motion entities.
11. The device of claim 9 , wherein the one or more programs further include instructions for calculating an amount of motion between frames in the plurality of video frames; and
wherein the motion event metadata further includes information regarding the amount of motion between frames in the plurality of video frames.
12. The device of claim 9 , wherein the one or more programs further include instructions for generating an alert for the motion event.
13. The device of claim 9 , wherein the one or more programs further include instructions for sending camera mode information to the remote server system.
14. The device of claim 9 , wherein the one or more programs further include instructions for sending environmental information to the remote server system.
15. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a camera device, cause the camera device to:
capture a plurality of video frames via the image sensor, the plurality of video frames corresponding to a scene in a field of view of the camera device;
send the video frames to the remote server system in real-time;
while sending the video frames to the remote server system in real-time:
determining that motion has occurred within the scene;
in response to determining that motion has occurred within the scene, characterize the motion as a motion event; and
generate motion event metadata for the motion event, the motion event metadata identifying one or more video frames associated with the motion event; and
send the generated motion event metadata to the remote server system concurrently with the video frames.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the one or more programs further include instructions, which when executed by the camera device, cause the camera device to identify within the motion event one or more motion entities; and
wherein the motion event metadata includes identification information for the one or more motion entities.
17. The non-transitory computer-readable storage medium of claim 15 , wherein the one or more programs further include instructions, which when executed by the camera device, cause the camera device to calculate an amount of motion between frames in the plurality of video frames; and
wherein the motion event metadata further includes information regarding the amount of motion between frames in the plurality of video frames.
18. The non-transitory computer-readable storage medium of claim 15 , wherein the one or more programs further include instructions, which when executed by the camera device, cause the camera device to generate an alert for the motion event.
19. The non-transitory computer-readable storage medium of claim 15 , wherein the one or more programs further include instructions, which when executed by the camera device, cause the camera device to send camera mode information to the remote server system.
20. The non-transitory computer-readable storage medium of claim 15 , wherein the one or more programs further include instructions, which when executed by the camera device, cause the camera device to send environmental information to the remote server system.