System and method for data compression with encryption
A system and method for data compression with encryption, that produces a conditioned data stream by replacing data blocks within an input data stream to bring the frequency of each data block closer to an ideal value, produces an error stream comprising the differences between the original data and the encrypted data, and compresses the conditioned data.
1. A system for data compression with encryption, comprising:
a computing device comprising a processor and a memory;
a stream analyzer comprising a first plurality of programming instructions stored in the memory which, when operating on the processor, causes the computing device to:
receive an input data stream;
analyze the frequency distribution of a plurality of data blocks within the input data stream to determine whether the input data stream meets a configured threshold for data conditioning;
if the input data stream fails to meet the configured threshold, send the input data stream to a stream conditioner; and
the stream conditioner comprising a second plurality of programming instructions stored in the memory which, when operating on the processor, causes the computing device to:
receive the input data stream from the stream analyzer;
produce a conditioned data stream and an error stream by, for each of a plurality of data blocks within the data stream:
analyzing the data block within the data stream to compare the data block's real frequency within the data stream against an ideal frequency;
if the difference between the data block's real frequency and ideal frequency exceeds a configured conditioning threshold, applying a conditioning rule to the data block;
applying a logical XOR operation to the data block;
appending the output of the logical XOR operation to the error stream;
send the conditioned data stream and the error stream as output.
2. The system of claim 1 , wherein the conditioning rule comprises the operations of:
determining whether the difference between the data block's real frequency and ideal frequency is positive or negative;
if the difference is negative, append the data block to a list of swap blocks; and
if the difference is positive, replace the data block with a randomly-selected swap block.
3. The system of claim 1 , further comprising a stream splitter comprising a third plurality of programming instructions stored in the memory which, when operating on the processor, causes the computing device to reproduce the input data stream by applying a logical XOR operation against the conditioned data stream using the error stream.
4. A method for data compression with encryption, comprising the steps of:
receiving an input data stream;
analyzing the frequency distribution of a plurality of data blocks within the input data stream to determine whether the input data stream meets a configured threshold for data conditioning;
if the input data stream fails to meet the configured threshold, sending the input data stream to a stream conditioner;
receive the input data stream from the stream analyzer;
produce a conditioned data stream and an error stream by, for each of a plurality of data blocks within the data stream:
analyzing the data block within the data stream to compare the data block's real frequency within the data stream against an ideal frequency;
if the difference between the data block's real frequency and ideal frequency exceeds a configured conditioning threshold, applying a conditioning rule to the data block;
applying a logical XOR operation to the data block;
appending the output of the logical XOR operation to the error stream;
sending the conditioned data stream and the error stream as output.
5. The method of claim 4 , wherein the conditioning rule comprises the steps of:
determining whether the difference between the data block's real frequency and ideal frequency is positive or negative;
if the difference is negative, append the data block to a list of swap blocks; and
if the difference is positive, replace the data block with a randomly-selected swap block.
6. The method of claim 4 , further comprising the step of restoring, using a stream splitter, the input data stream by applying a logical XOR operation against the conditioned data stream using the error stream.