Hierarchical storage manager (HSM) for intelligent storage of large volumes of data
The present invention is a video surveillance, storage, and alerting system having the following components. One or more surveillance cameras capture video data having attribute data, the attribute data representing importance of the surveillance cameras. One or more video analytics devices process the video data from one or more of the surveillance cameras and detect primitive video events in the video data. A network management module monitors network status of the surveillance cameras, and the video analytics devices, and generates network events reflective of the network status of all subsystems. A correlation engine correlates two or more primitive video events from the video analytics devices weighted by the attribute data of the surveillance cameras used to capture the video data, and network events from the network management module weighted by attribute data of device corresponding to the network event. An alerting engine generates one or more alerts and performs one or more actions based on the correlation performed by the correlation engine.
1. An alerting system, comprising:
one or more sensors for capturing sensory data;
a hierarchy of two or more data storage devices for storing the sensory data from the one or more sensors;
one or more processors, operatively coupled to the one or more sensors; and
one or more memories, operatively coupled to the one or more processors, the one or more memories comprising program code which when executed causes the one or more processors to:
capture sensory data from the one or more sensors;
process the sensory data from the one or more sensors to detect primitive events in the sensory data;
correlate two or more primitive events to determine one or more correlated events; and
perform one or more actions based on the correlation performed in the correlating step.
2. The alerting system of claim 1 , wherein the one or more sensors are selected from the group consisting of surveillance camera, surveillance microphone, temperature probe, pressure probe, speedometer, chlorine meter, radon meter, dust particle meter, CO 2 meter, water meter, electrical meter, blood pressure meter, and heart rate meter.
3. The alerting system of claim 1 , further comprising program code to:
detect compound events composed of two or more primitive events.
4. The alerting system of claim 3 , further comprising program code to:
time correlate the primitive events and the compound events across time;
space correlate the primitive events and the compound events across space; and
evaluate one or more rules based on the correlation performed in the time correlating step and the space correlating step.
5. The alerting system of claim 4 , further comprising program code to:
generate one or more new rules based on the primitive events correlated in the correlating step and the actions performed in the action step.
6. The alerting system of claim 1 , further comprising program code to:
receive tip data from one or more external sources;
determine attribute data for the tip data, the attribute data representing the reliability of the source of the tip data; and
generate tip events based on the tip data and the attribute data.
7. The alerting system of claim 1 , further comprising program code to:
manage storage and cascade of the sensory data in the hierarchy of data storage devices based on attribute data corresponding to a source of the sensory data.
8. The alerting system of claim 1 , wherein the hierarchy of data storage devices includes at least a first-tier device and a second-tier device, the first-tier device having a higher data access performance and a lower storage capacity than the second-tier device.
9. The alerting system of claim 7 , further comprising program code to:
determine storage locations for segments of sensory data based on a set of rules based on the importance of the sensory data; and
update the set of rules for segments of sensory data based on historical access patterns.
10. An alerting system, comprising:
one or more sensors for capturing sensory data;
a hierarchy of two or more data storage devices for storing the sensory data from the one or more sensors;
one or more data processing units, adapted to process the sensory data from one or more of the sensors and to detect primitive events in the sensory data;
a correlation engine for correlating two or more primitive events from the data processing units to determine one or more correlated events; and
an alerting engine for performing one or more actions based on the correlation performed by the correlation engine.
11. The alerting system of claim 10 , wherein the one or more processors manages storage and cascade of the sensory data in the hierarchy of data storage devices based on attribute data corresponding to a source of the sensory data.
12. The alerting system of claim 10 ,
wherein the hierarchy of data storage devices includes at least a first-tier device and a second-tier device, the first-tier device having a higher data access performance and a lower storage capacity than the second-tier device.
13. The alerting system of claim 11 , wherein the one or more processors determines storage locations for segments of sensory data based on a set of rules based on the importance of the sensory data.
14. A method of alerting, comprising the steps of:
capturing sensory data from one or more sensors;
storing the sensory data from the one or more sensors in a hierarchy of two or more data storage devices;
processing the sensory data from the sensors to detect primitive events in the sensory data using a computer processor;
correlating two or more primitive events to determine one or more correlated events using the computer processor; and
performing one or more actions based on the correlation performed in the correlating step.
15. The alerting method of claim 14 , further comprising:
detecting compound events composed of two or more primitive events.
16. The alerting method of claim 14 , further comprising:
time correlating the primitive events and the compound events across time;
space correlating the primitive events and the compound events across space; and
evaluating one or more rules based on the correlation performed in the time correlating step and the space correlating step.
17. The alerting method of claim 14 , further comprising:
receiving tip data from one or more external sources;
determining attribute data for the tip data, the attribute data representing the reliability of the source of the tip data; and
generating tip events based on the tip data and the attribute data.
18. The alerting method of claim 14 , further comprising:
managing storage and cascade of the sensory data in the hierarchy of data storage devices based on attribute data corresponding to a source of the sensory data.
19. The alerting method of claim 14 ,
wherein the hierarchy of data storage devices includes at least a first-tier device and a second-tier device, the first-tier device having a higher data access performance and a lower storage capacity than the second-tier device.
20. The alerting method of claim 18 , further comprising:
determining storage locations for segments of sensory data based on a set of rules based on the importance of the sensory data.