System and method of data reduction for cellular M2M transmissions from energy management systems

1. A system for transmitting data from an energy management system, the system for transmitting comprising:

a microcontroller communicatively coupled to a plurality of data sources and comprising;

a comb filter receiving the data from the plurality of data sources and producing a reduced data set according to a set of filtering rules;

a queue for storing the reduced data set from the comb filter; and

a packager operable to receive a trigger to send the reduced data set, the packager also operable to compress the reduced data for transmission, wherein the queue is configured to generate the trigger when the queue reaches a trigger size and also when the queue reaches a maximum post interval.

2. The system of claim 1 wherein the comb filter comprises a schedule comb receiving the data from the plurality of data sources, the schedule comb reducing the data according to data schedule rules stored in a data definition database.

3. The system of claim 1 wherein the comb filter comprises a delta comb receiving the data from the plurality of data sources, the delta comb reducing the data by eliminating data values that have not changed since a previous transmission.

4. The system of claim 1 wherein the comb filter comprises both a schedule comb and a delta comb, the schedule comb and delta comb producing a reduced data set.

5. The system of claim 1 further comprising a critical event evaluator receiving data from the plurality of data sources, the critical event evaluator monitoring the data for critical events requiring immediate transmission to a monitoring center, wherein the critical event evaluator generates the trigger if a critical event is found.

6. The system of claim 5 wherein a critical event includes detection of a failure of equipment in the energy management system.

7. The system of claim 1 wherein the packager compresses the reduced data set using a Zlib compression technique.

8. A method for reducing transmitted data from an energy management system, the method comprising:

filtering the data from the plurality of data sources using a schedule comb and a delta comb, wherein the schedule comb reduces the data according to data schedule rules stored in a data definition database and the delta comb reduces the data by eliminating data values that have not changed since a previous transmission, the schedule comb and delta comb producing a reduced data set;

formatting the reduced data set into a formatted data set using a data encoder;

storing the formatted data set from the data encoder;

receiving a trigger to send the formatted data set, wherein the queue generates the trigger when the queue reaches a trigger size;

compressing the formatted data for transmission; and

transmitting the compressed data to the monitoring center.

9. The method of claim 8 further comprising monitoring data from a plurality of data sources for critical events requiring immediate transmission to a monitoring center wherein the critical event evaluator generates the trigger if a critical event is found.

10. The method of claim 8 further comprising the data encoder operable to format the reduced data set into a formatted data set.

11. The method of claim 8 wherein the data encoder uses a tag-length value encoding system to produce the formatted data set.

12. The method of claim 8 wherein the packager compresses the reduced data set using a Zlib compression technique.

13. The method of claim 8 wherein a critical event includes detection of a failure of equipment in the energy management system.

14. A system for transmitting data from an energy management system, the system for transmitting comprising:

a microcontroller communicatively coupled to a plurality of data sources and comprising;

a critical event evaluator receiving data from the plurality of data sources, the critical event evaluator monitoring the data for critical events requiring immediate transmission to a monitoring center;

a schedule comb and a delta comb receiving the data from the plurality of data sources, the schedule comb reducing the data according to data schedule rules stored in a data definition database and the delta comb reducing the data by eliminating data values that have not changed since a previous transmission, the schedule comb and delta comb producing a reduced data set;

a data encoder operable to format the reduced data set into a formatted data set; and

a queue for storing the formatted data set from the data encoder.

15. The system of claim 14 further comprising a packager operable to receive a trigger to send the formatted data set, the packager also operable to compress the formatted data for transmission, wherein the queue generates the trigger when the queue reaches a trigger size and wherein the critical event evaluator generates the trigger if a critical event is found.

16. The system of claim 14 further comprising the data encoder operable to format the reduced data set into a formatted data set.

17. The system of claim 14 wherein the data encoder uses a tag-length value encoding system to produce the formatted data set.

18. The system of claim 15 wherein the packager compresses the reduced data set using a Zlib compression technique.

19. The system of claim 14 wherein a critical event includes detection of a failure of equipment in the energy management system.

20. The system of claim 14 further comprising a data definition database interacting with the schedule comb wherein data sources defined in the data definition database as members of a particular sampling schedule will maintain a time correlation and an alignment of associated data changes when such correlation and alignment exists at the source.