System and method for data compression over a communication network
View Patent ↗A method for data compression includes reading first data representing sensor data capture, compressing the data with a lossless algorithm, transmitting the compressed data as a reference frame, reading subsequent data, calculating a delta between the first data and the subsequent data, compressing the data delta, and determining if the compression ratio of the compressed data delta is within a predetermined tolerance threshold. If the compression ratio is within the threshold, transmitting the compressed data delta frame, and repeating the calculating, compressing, and determining steps for subsequent data; Else if the compression ratio is not within the threshold, compressing the current subsequent data and transmitting the result as an updated reference frame. Then repeating the calculating, compressing, and determining steps for subsequent data. A system and a non-transitory computer-readable medium for implementing the method are also disclosed.
1. A method for compressing data from at least one sensor unit in a street lighting assembly, the method comprising:
a coder/decoder (codec) reading a first data group from a memory, the first data group representing sensor data capture by a sensor among a plurality of sensors;
the codec compressing the first data group with a lossless compression algorithm;
transmitting the compressed first data group as a reference frame across an electronic communication network to a server;
reading a first subsequent data group from the memory;
calculating a data delta between the first data group and the first subsequent data group;
the codec compressing the data delta;
determining if a compression ratio of the compressed data delta is within a predetermined tolerance threshold,
if the compression ratio is within the predetermined tolerance threshold, transmitting the compressed data delta as a delta data frame across the electronic communication network to the server;
reading a second subsequent data group from the memory; and
repeating the calculating, compressing, and determining steps for the second subsequent data group.
2. The method of claim 1 , including:
if the compression ratio is not within the predetermined tolerance threshold, compressing the first subsequent data group;
transmitting the compressed first subsequent data group as an updated reference frame across the electronic communication network to the server;
reading a second subsequent data group from the memory; and
repeating the calculating, compressing, and determining steps for the second subsequent data group.
3. The method of claim 1 , including linking at least a portion of the plurality of sensors as nodes to form the electronic communication network.
4. The method of claim 1 , including formatted the data grouping as a single dimensional array.
5. The method of claim 1 , including formatting the data grouping as a multi-dimensional array, where each dimension represents a subsequent sensor data capture.
6. The method of claim 1 , including terminating the method when a data grouping is a last data group of a multi-dimensional array.
7. The method of claim 1 , including terminating the method after expiration of a predetermined time period.
8. The method of claim 1 , including transmitting a variable amount of data delta frames following transmitting the reference frame.
9. A street lighting assembly comprising:
a street light; and
at least one sensor unit having a sensor element, the sensor element configured to monitor a condition, activity, or status local to its location, said sensor connected to a server across an electronic communication network;
wherein the sensor unit includes a control processor in communication with one or more memory units in the sensor, the sensor element, a coder/decoder (codec), and a memory unit; wherein the codec is configured to read sensor data from the memory unit and compress the sensor data with a compression algorithm under control of the control processor;
the compression algorithm including:
calculating a data delta between a first data group and a first subsequent data group;
compressing the data delta;
determining if a compression ratio of the compressed data delta is within a predetermined tolerance threshold,
if the compression ratio is within the predetermined tolerance threshold, transmitting the compressed data delta as a delta data frame across the electronic communication network to the server;
reading additional subsequent data groups;
repeat the calculating, compressing, and determining steps for the additional subsequent data groups; and
if the compression ratio is not within the predetermined tolerance threshold, compressing the first subsequent data group, transmitting the compressed first subsequent data group as an updated reference frame across the electronic communication network to the server.
10. The street lighting assembly of claim 9 including the codec configured to transmit a variable amount of data delta frames following transmitting a reference frame.
11. An electronic communication network comprising a plurality of the street lighting assembly in accordance with claim 9 , the electronic communication network formed from a plurality of said sensor units linked as nodes of the electronic communication network.
12. The electronic communication network of claim 11 , further including a server, the server including a control processor, a codec configured to decompress data from the sensor, and a web application configured to execute instructions utilizing the decompressed data.