System and method of data reduction for cellular M2M transmissions from energy management systems
A system and method for reducing the data transmitted from an energy management system is described. The system and method include a critical event evaluator receiving data from a plurality of data sources, where the critical event evaluator monitors the data for critical events requiring immediate transmission to a monitoring center. A schedule comb and a delta comb receive the data from the plurality of data sources, the schedule comb operable to reduce the data according to data schedule rules stored in a data definition database and the delta comb reduce the data by eliminating data values that have not changed since a previous transmission. The schedule comb and delta comb produce a reduced data set. A queue stores the reduced data set, which is transmitted when the queue reaches a trigger size or a critical event is found.
1. A system for transmitting data from an energy management system, the system for transmitting comprising:
a microcontroller communicatively coupled to a plurality of data sources and comprising;
a critical event evaluator receiving data from the plurality of data sources, the critical event evaluator monitoring the data for critical events requiring immediate transmission to a monitoring center;
a comb filter receiving the data from the plurality of data sources and producing a reduced data set according to a set of filtering rules;
a queue for storing the reduced data set from the comb filter; and
a packager operable to receive a trigger to send the reduced data set, the packager also operable to compress the reduced data for transmission, wherein the queue is configured to generate the trigger when the queue reaches a trigger size and also when the queue reaches a maximum post interval, and wherein the critical event evaluator generates the trigger if a critical event is found.
2. The system of claim 1 wherein the comb filter comprises a schedule comb and a delta comb receiving the data from the plurality of data sources, the schedule comb reducing the data according to data schedule rules stored in a data definition database and the delta comb reducing the data by eliminating data values that have not changed since a previous transmission, the schedule comb and delta comb producing a reduced data set.
3. The system of claim 1 wherein a critical event includes detection of a failure of equipment in the energy management system.
4. The system of claim 1 wherein the data sources are sensors and controllers in a heating, ventilation and air conditioning system monitored by the energy management system.
5. The system of claim 1 further comprising a data encoder operable to format the reduced data set into a formatted data set.
6. The system of claim 5 wherein data encoder uses a tag-length value encoding system to produce the formatted data set.
7. The system of claim 1 wherein the packager compresses the reduced data set using a Zlib compression technique.
8. A method for reducing transmitted data from an energy management system, the method comprising:
monitoring data from a plurality of data sources for critical events requiring immediate transmission to a monitoring center;
filtering the data from the plurality of data sources using a schedule comb and a delta comb, wherein the schedule comb reduces the data according to data schedule rules stored in a data definition database and the delta comb reduces the data by eliminating data values that have not changed since a previous transmission, the schedule comb and delta comb producing a reduced data set;
formatting the reduced data set into a formatted data set using a data encoder;
storing the formatted data set from the data encoder;
receiving a trigger to send the formatted data set, wherein the queue generates the trigger when the queue reaches a trigger size and wherein the critical event evaluator generates the trigger if a critical event is found;
compressing the formatted data for transmission; and
transmitting the compressed data to the monitoring center.
9. The method of claim 8 wherein the data sources are sensors and controllers in a heating, ventilation and air conditioning system monitored by the energy management system.
10. The method of claim 8 further comprising a data encoder operable to format the reduced data set into a formatted data set.
11. The method of claim 8 wherein data encoder uses a tag-length value encoding system to produce the formatted data set.
12. The method of claim 8 wherein the packager compresses the reduced data set using a Zlib compression technique.
13. The method of claim 8 wherein a critical event includes detection of a failure of equipment in the energy management system.
14. A system for transmitting data from an energy management system, the system for transmitting comprising:
a microcontroller communicatively coupled to a plurality of data sources and comprising;
a critical event evaluator receiving data from the plurality of data sources, the critical event evaluator monitoring the data for critical events requiring immediate transmission to a monitoring center;
a schedule comb and a delta comb receiving the data from the plurality of data sources, the schedule comb reducing the data according to data schedule rules stored in a data definition database and the delta comb reducing the data by eliminating data values that have not changed since a previous transmission, the schedule comb and delta comb producing a reduced data set;
a data encoder operable to format the reduced data set into a formatted data set;
a queue for storing the formatted data set from the data encoder; and
a packager operable to receive a trigger to send the formatted data set, the packager also operable to compress the formatted data for transmission, wherein the queue generates the trigger when the queue reaches a trigger size and wherein the critical event evaluator generates the trigger if a critical event is found.
15. The system of claim 14 wherein the data sources are sensors and controllers in a heating, ventilation and air conditioning system monitored by the energy management system.
16. The system of claim 14 further comprising a data encoder operable to format the reduced data set into a formatted data set.
17. The system of claim 14 wherein data encoder uses a tag-length value encoding system to produce the formatted data set.
18. The system of claim 14 wherein the packager compresses the reduced data set using a Zlib compression technique.
19. The system of claim 14 wherein a critical event includes detection of a failure of equipment in the energy management system.
20. The system of claim 14 further comprising a data definition database interacting with the schedule comb wherein data sources defined in the data definition database as members of a particular sampling schedule will maintain a time correlation and an alignment of associated data changes when such correlation and alignment exists at the source.