Data compression systems and methods
Data compression using a combination of content independent data compression and content dependent data compression. In one aspect, a system for compressing data comprises: a processor, and a plurality of data compression encoders wherein at least one data encoder utilizes asymmetric data compression. The processor is configured to determine one or more parameters, attributes, or values of the data within at least a portion of a data block containing either video or audio data, to select one or more data compression encoders from the plurality of data compression encoders based upon the determined one or more parameters, attributes, or values of the data and a throughput of a communications channel, and to perform data compression with the selected one or more data compression encoders on at least the portion of the data block.
1. A system for compressing data comprising:
a memory configured to store one or more data blocks;
a counter module configured to determine a size of the one or more data blocks;
a recognition module configured to analyze data within the one or more data blocks to identify one or more parameters or attributes of the data; and
a plurality of data compression encoders including one or more lossless, dictionary-type encoders and a different encoder;
wherein the one or more lossless, dictionary-type encoders are configured to compress the one or more data blocks if the one or more parameters or attributes are recognized, and the different encoder is configured to compress the one or more data blocks if the one or more parameters or attributes are not recognized.
2. The system of claim 1 , wherein the recognition module is configured to recognize repeated blocks of data.
3. The system of claim 1 , wherein the one or more parameters or attributes directly or indirectly indicate whether the one or more data blocks are already resident in a dictionary-type encoder library.
4. The system of claim 1 , wherein the counter module determines whether the size of the one or more data blocks is greater than a predetermined threshold.
5. The system of claim 4 , wherein the one or more parameters or attributes directly or indirectly indicate whether the one or more data blocks, or a portion of the one or more data blocks, is already resident in a dictionary-type encoder library.
6. The system of claim 1 , further comprising an algorithm look-up table module.
7. The system of claim 1 , wherein the one or more data blocks are received from an external source.
8. The system of claim 1 , wherein the different encoder is a Lempel-Ziv encoder.
9. The system of claim 1 , wherein the different encoder is one of a Huffman encoder or an arithmetic encoder.
10. The system of claim 1 , wherein the different encoder is configured to perform data compression using null-suppression or data-compaction techniques.
11. The system of claim 1 , wherein one or more of the plurality of data compression encoders is configured to compress data in real-time or pseudo real-time.
12. The system of claim 1 , wherein the lossless, dictionary-type encoder is configured to perform data compression by eliminating repeated blocks of data or portions of repeated blocks of data.
13. The system of claim 1 , wherein the lossless, dictionary-type encoder performs data compression by eliminating an output or transmission of at least one redundant string of data.
14. The system of claim 1 , wherein the one or more recognized parameters or attributes of the data is one of a data structure, a data block format, or a data file substructure.
15. The system of claim 1 , wherein the recognition module is configured to perform a probabilistic recognition.
16. The system of claim 1 , wherein the recognition module is configured to perform a deterministic recognition.
17. The system of claim 1 , wherein the recognition module excludes identification based solely on a descriptor that is indicative of the one or more parameters or attributes of the data within the one or more data blocks.
18. A system for compressing data comprising:
a memory configured to store one or more data blocks;
a processor;
a recognition module, implemented on the processor, that is configured to analyze data within the one or more data blocks to identify one or more parameters or attributes of the data wherein the one or more parameters or attributes of the data is identified if it is already resident in a dictionary-type encoder library; and
a plurality of data compression encoders including one or more lossless, dictionary-type encoders and a different encoder;
wherein the one or more lossless, dictionary-type encoders are configured to compress the one or more data blocks if the one or more parameters or attributes are recognized, and the different encoder is configured to compress the one or more data blocks if the one or more parameters or attributes are not recognized.
19. The system of claim 18 , wherein the one or more data blocks is received by the one or more lossless, dictionary-type encoders in an uncompressed form, the one or more data blocks being included in a plurality of data blocks transmitted in sequence originating from an external source.
20. The system of claim 18 , wherein the one or more data blocks is received by the one or more lossless, dictionary-type encoders in an uncompressed form, the one or more data blocks being included in a plurality of data blocks in sequence originating from an internal source.
21. The system of claim 18 , wherein the different encoder is a Lempel-Ziv encoder.
22. The system of claim 18 , wherein the different encoder is one of a Huffman encoder or an arithmetic encoder.
23. The system of claim 18 , wherein the different encoder performs data compression using null-suppression or data-compaction techniques.
24. The system of claim 19 , wherein one or more of the plurality of data compression encoders is configured to compress data in real-time or pseudo real-time.
25. The system of claim 20 , wherein one or more of the plurality of data compression encoders is configured to compress data in real-time or pseudo real-time.
26. The system of claim 18 , wherein the one or more recognized parameters or attributes is one of a data structure, a data block format, or a data file substructure.
27. The system of claim 18 , wherein the recognition module is configured to perform a probabilistic recognition.
28. The system of claim 18 , wherein the recognition module is configured to perform a deterministic recognition.
29. The system of claim 18 , wherein two or more of the data compression encoders operate in parallel.
30. The system of claim 18 , wherein the recognition module excludes identification based solely on a descriptor that is indicative of the one or more parameters or attributes.