Video camera and sensor integration
View Patent ↗Video camera and sensor integration, in which an event is detected at a property based on sensor data and, based on the detected event, multiple cameras are controlled to operate in a tracking mode. One or more moving objects are detected in images captured by the cameras and metadata related to capture of the one or more moving objects is determined. Tracking operations of the cameras is coordinated based on the metadata.
1. A system for monitoring a property, the system comprising:
one or more sensors that are installed at a property and that are configured to sense attributes of the property;
a first camera that is installed at the property, that is configured to pan and tilt, and that is configured to image a first area of the property;
a second camera that is installed at the property, that is configured to pan and tilt, and that is configured to image a second area of the property, the second area of the property being different than the first area; and
at least one controller configured to perform operations comprising:
detecting an event at the property based on sensor data from the one or more sensors that are installed at the property and that are configured to sense attributes of the property;
based on the detected event:
controlling the first camera to enter a tracking mode in which the first camera scans for a moving object by panning and tilting over the first area of the property imaged by the first camera, and
controlling the second camera to enter the tracking mode in which the second camera scans for a moving object by panning and tilting over the second area of the property imaged by the second camera;
detecting a first moving object imaged by the first camera in the tracking mode;
based on detection of the first moving object imaged by the first camera in the tracking mode:
tracking the first moving object by panning and tilting in a manner that follows movements of the first moving object throughout the first area of the property imaged by the first camera, and
determining first metadata related to capture of images of the first moving object tracked by the first camera;
detecting a second moving object imaged by the second camera in the tracking mode;
based on detection of the second moving object imaged by the second camera in the tracking mode:
tracking the second moving object by panning and tilting in a manner that follows movements of the second moving object throughout the second area of the property imaged by the second camera, and
determining second metadata related to capture of images of the second moving object tracked by the second camera; and
coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata,
wherein the at least one controller is configured to perform operations further comprising determining first power available to the first camera and determining second power available to the second camera,
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata comprises coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first power available to the first camera, and the second power available to the second camera,
wherein determining first power available to the first camera comprises determining that the first camera is operating on battery power,
wherein determining second power available to the second camera comprises determining that the second camera is operating on a primary power source provided at the property, and
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first power available to the first camera, and the second power available to the second camera comprises determining that the first moving object and the second moving object are the same based on the first metadata and the second metadata, determining to track the first moving object using the first camera based on a first rating for quality of images of the first moving object captured by the first camera and a second rating for quality of images of the second moving object captured by the second camera, overriding the determination to track the first moving object using the first camera based on the determination that the first camera is operating on battery power and the second camera is operating on the primary power source provided at the property, and controlling the first camera to stop tracking and the second camera to continue tracking based on overriding the determination to track the first moving object using the first camera.
2. The system of claim 1 :
wherein determining first metadata related to capture of images of the first moving object tracked by the first camera comprises determining a first rating for quality of images of the first moving object captured by the first camera;
wherein determining second metadata related to capture of images of the second moving object tracked by the second camera comprises determining a second rating for quality of images of the second moving object captured by the second camera; and
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata comprises coordinating tracking operation of the first camera and the second camera based on the first rating for quality of images of the first moving object captured by the first camera and the second rating for quality of images of the second moving object captured by the second camera.
3. The system of claim 2 , wherein coordinating tracking operation of the first camera and the second camera based on the first rating for quality of images of the first moving object captured by the first camera and the second rating for quality of images of the second moving object captured by the second camera comprises ceasing tracking of the first moving object by the first camera based on the first rating for quality being below a quality threshold.
4. The system of claim 1 :
wherein determining first metadata related to capture of images of the first moving object tracked by the first camera comprises determining first descriptive information of the first moving object captured by the first camera;
wherein determining second metadata related to capture of images of the second moving object tracked by the second camera comprises determining second descriptive information of the second moving object captured by the second camera; and
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata comprises coordinating tracking operation of the first camera and the second camera based on the first descriptive information and the second descriptive information.
5. The system of claim 4 , wherein coordinating tracking operation of the first camera and the second camera based on the first descriptive information and the second descriptive information comprises determining that the first moving object is the same as the second moving object based on the first descriptive information and the second descriptive information, based on the determination that the first moving object is the same as the second moving object, determining that the first camera is closer to the first moving object than the second camera is to the second moving object, and, based on the determination that the first camera is closer to the first moving object than the second camera is to the second moving object, controlling the first camera to continue tracking the first moving object and the second camera to scan for other objects.
6. The system of claim 4 :
wherein determining first metadata related to capture of images of the first moving object tracked by the first camera comprises determining a first rating for quality of images of the first moving object captured by the first camera;
wherein determining second metadata related to capture of images of the second moving object tracked by the second camera comprises determining a second rating for quality of images of the second moving object captured by the second camera; and
wherein coordinating tracking operation of the first camera and the second camera based on the first descriptive information and the second descriptive information comprises coordinating tracking operation of the first camera and the second camera based on the first descriptive information, the second descriptive information, the first rating for quality of images of the first moving object captured by the first camera, and the second rating for quality of images of the second moving object captured by the second camera.
7. The system of claim 6 , coordinating tracking operation of the first camera and the second camera based on the first descriptive information, the second descriptive information, the first rating for quality of images of the first moving object captured by the first camera, and the second rating for quality of images of the second moving object captured by the second camera comprises determining that the first moving object is the same as the second moving object based on the first descriptive information and the second descriptive information, based on the determination that the first moving object is the same as the second moving object, determining that the first rating for quality is higher than the second rating for quality, and, based on the determination that the first rating for quality is higher than the second rating for quality, controlling the first camera to continue tracking the first moving object and the second camera to scan for other objects.
8. The system of claim 1 , wherein the at least one controller is configured to perform operations comprising determining a direction of movement of the first moving object and controlling the first camera to pan and tilt in the determined direction of movement of the first moving object.
9. The system of claim 1 :
wherein the at least one controller is configured to perform operations comprising determining first power available to the first camera and determining second power available to the second camera, and
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata comprises coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first power available to the first camera, and the second power available to the second camera.
10. The system of claim 1 :
wherein determining first metadata related to capture of images of the first moving object tracked by the first camera comprises:
initially determining basic metadata based on image analysis of one or more images of the first moving object without reference to prior images captured by the first camera, and
subsequently determining rich metadata based on analysis of the one or more images of the first moving object in comparison with prior images captured by the first camera, and
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata comprises:
initially coordinating tracking operation of the first camera and the second camera based on the basic metadata, and
modifying tracking operation of the first camera and the second camera based on the rich metadata.
11. The system of claim 1 , wherein the at least one controller comprises a single controller located in a control unit that receives the sensor data from the one or more sensors and communicates with the first camera and the second camera to send control commands to the first camera and the second camera and receive images from the first camera and the second camera.
12. The system of claim 1 , wherein the at least one controller comprises a first controller of the first camera, a second controller of the second camera, and a third controller of a control unit that receives the sensor data from the one or more sensors.
13. The system of claim 12 :
wherein the third controller detects the event at the property, controls the first camera to enter the tracking mode, controls the second camera to enter the tracking mode, and coordinates tracking operation of the first camera and the second camera,
wherein the first controller detects the first moving object imaged by the first camera in the tracking mode, tracks the first moving object, and determines the first metadata related to capture of images of the first moving object,
wherein the second controller detects the second moving object imaged by the second camera in the tracking mode, tracks the second moving object, and determines the second metadata related to capture of images of the second moving object, and
wherein the third controller coordinates tracking operation of the first camera and the second camera by receiving, from the first controller, the first metadata related to capture of images of the first moving object, receiving, from the second controller, the second metadata related to capture of images of the second moving object, analyzing the first metadata relative to the second metadata, and controlling at least one of the first camera or the second camera based on the analysis of the first metadata relative to the second metadata.
14. The system of claim 1 , wherein the at least one controller comprises a first controller of the first camera and a second controller of the second camera.
15. The system of claim 14 :
wherein the first controller and the second controller each detects the event at the property,
wherein the first controller controls the first camera to enter the tracking mode, detects the first moving object imaged by the first camera in the tracking mode, tracks the first moving object, and determines the first metadata related to capture of images of the first moving object,
wherein the second controller controls the second camera to enter the tracking mode, detects the second moving object imaged by the second camera in the tracking mode, tracks the second moving object, and determines the second metadata related to capture of images of the second moving object, and
wherein the first controller and the second controller coordinate tracking operation of the first camera and the second camera by exchanging metadata with one another.
16. The system of claim 1 , wherein the at least one controller is configured to perform operations comprising determining first power available to the first camera and determining second power available to the second camera.
17. A method comprising:
detecting an event at a property based on sensor data from one or more sensors that are installed at the property and that are configured to sense attributes of the property;
based on the detected event:
controlling a first camera to enter a tracking mode in which the first camera scans for a moving object by panning and tilting over a first area of the property imaged by the first camera, and
controlling a second camera to enter the tracking mode in which the second camera scans for a moving object by panning and tilting over a second area of the property imaged by the second camera;
detecting a first moving object imaged by the first camera in the tracking mode;
based on detection of the first moving object imaged by the first camera in the tracking mode:
tracking the first moving object by panning and tilting in a manner that follows movements of the first moving object throughout the first area of the property imaged by the first camera, and
determining first metadata related to capture of images of the first moving object tracked by the first camera;
detecting a second moving object imaged by the second camera in the tracking mode;
based on detection of the second moving object imaged by the second camera in the tracking mode:
tracking the second moving object by panning and tilting in a manner that follows movements of the second moving object throughout the second area of the property imaged by the second camera, and
determining second metadata related to capture of images of the second moving object tracked by the second camera;
coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata; and
determining first power available to the first camera and determining second power available to the second camera,
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata comprises coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first power available to the first camera, and the second power available to the second camera,
wherein determining first power available to the first camera comprises determining that the first camera is operating on battery power,
wherein determining second power available to the second camera comprises determining that the second camera is operating on a primary power source provided at the property, and
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first power available to the first camera, and the second power available to the second camera comprises determining that the first moving object and the second moving object are the same based on the first metadata and the second metadata, determining to track the first moving object using the first camera based on a first rating for quality of images of the first moving object captured by the first camera and a second rating for quality of images of the second moving object captured by the second camera, overriding the determination to track the first moving object using the first camera based on the determination that the first camera is operating on battery power and the second camera is operating on the primary power source provided at the property, and controlling the first camera to stop tracking and the second camera to continue tracking based on overriding the determination to track the first moving object using the first camera.
18. A system for monitoring a property, the system comprising:
one or more sensors that are installed at a property and that are configured to sense attributes of the property;
a first camera that is installed at the property, that is configured to pan and tilt, and that is configured to image a first area of the property;
a second camera that is installed at the property, that is configured to pan and tilt, and that is configured to image a second area of the property, the second area of the property being different than the first area; and
at least one controller configured to perform operations comprising:
detecting an event at the property based on sensor data from the one or more sensors that are installed at the property and that are configured to sense attributes of the property;
based on the detected event:
controlling the first camera to enter a tracking mode in which the first camera scans for a moving object by panning and tilting over the first area of the property imaged by the first camera, and
controlling the second camera to enter the tracking mode in which the second camera scans for a moving object by panning and tilting over the second area of the property imaged by the second camera;
detecting a first moving object imaged by the first camera in the tracking mode;
based on detection of the first moving object imaged by the first camera in the tracking mode:
tracking the first moving object by panning and tilting in a manner that follows movements of the first moving object throughout the first area of the property imaged by the first camera, and
determining first metadata related to capture of images of the first moving object tracked by the first camera;
detecting a second moving object imaged by the second camera in the tracking mode;
based on detection of the second moving object imaged by the second camera in the tracking mode:
tracking the second moving object by panning and tilting in a manner that follows movements of the second moving object throughout the second area of the property imaged by the second camera, and
determining second metadata related to capture of images of the second moving object tracked by the second camera; and
coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata,
wherein the at least one controller is configured to perform operations further comprising determining first power available to the first camera and determining second power available to the second camera,
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata comprises coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first power available to the first camera, and the second power available to the second camera,
wherein the first camera has a first rechargeable battery that is rechargeable based on pan and tilt movement of the first camera,
wherein the second camera has a second rechargeable battery that is rechargeable based on pan and tilt movement of the second camera,
wherein determining first power available to the first camera comprises determining a first level of the first rechargeable battery,
wherein determining second power available to the second camera comprises determining a second level of the second rechargeable battery, and
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first power available to the first camera, and the second power available to the second camera comprises coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first level of the first rechargeable battery, and the second level of the second rechargeable battery.
19. At least one non-transitory computer-readable storage medium having stored thereon instructions which, when executed by at least one processor, cause performance of operations comprising:
detecting an event at a property based on sensor data from one or more sensors that are installed at the property and that are configured to sense attributes of the property;
based on the detected event:
controlling a first camera to enter a tracking mode in which the first camera scans for a moving object by panning and tilting over a first area of the property imaged by the first camera, and
controlling a second camera to enter the tracking mode in which the second camera scans for a moving object by panning and tilting over a second area of the property imaged by the second camera;
detecting a first moving object imaged by the first camera in the tracking mode;
based on detection of the first moving object imaged by the first camera in the tracking mode:
tracking the first moving object by panning and tilting in a manner that follows movements of the first moving object throughout the first area of the property imaged by the first camera, and
determining first metadata related to capture of images of the first moving object tracked by the first camera;
detecting a second moving object imaged by the second camera in the tracking mode;
based on detection of the second moving object imaged by the second camera in the tracking mode:
tracking the second moving object by panning and tilting in a manner that follows movements of the second moving object throughout the second area of the property imaged by the second camera, and
determining second metadata related to capture of images of the second moving object tracked by the second camera;
coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata; and
determining first power available to the first camera and determining second power available to the second camera,
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata and the second metadata comprises coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first power available to the first camera, and the second power available to the second camera,
wherein determining first power available to the first camera comprises determining that the first camera is operating on battery power,
wherein determining second power available to the second camera comprises determining that the second camera is operating on a primary power source provided at the property, and
wherein coordinating tracking operation of the first camera and the second camera based on the first metadata, the second metadata, the first power available to the first camera, and the second power available to the second camera comprises determining that the first moving object and the second moving object are the same based on the first metadata and the second metadata, determining to track the first moving object using the first camera based on a first rating for quality of images of the first moving object captured by the first camera and a second rating for quality of images of the second moving object captured by the second camera, overriding the determination to track the first moving object using the first camera based on the determination that the first camera is operating on battery power and the second camera is operating on the primary power source provided at the property, and controlling the first camera to stop tracking and the second camera to continue tracking based on overriding the determination to track the first moving object using the first camera.