System and method for improving space efficiency by compressing multi-block aggregates
A method, computer program product, and computer system for identifying a plurality of blocks. At least one heuristic associated with at least a portion of the plurality of blocks may be determined. It may be determined whether to compress at least the portion of the plurality of blocks based upon, at least in part, the at least one heuristic. At least the portion of the plurality of blocks may be compressed based upon, at least in part, the at least one heuristic.
1. A computer-implemented method comprising:
identifying a plurality of blocks;
determining at least one heuristic associated with at least a portion of the plurality of blocks;
determining to group at least the portion of the plurality of blocks together for compressing at least the portion of the plurality of blocks based upon, at least in part, the at least one heuristic; and
compressing at least the portion of the plurality of blocks based upon, at least in part, the at least one heuristic,
wherein the at least one heuristic includes a distance metric associated with at least the portion of the plurality of blocks.
2. The computer-implemented method of claim 1 wherein the at least one heuristic includes a digital entropy value associated with at least the portion of the plurality of blocks.
3. The computer-implemented method of claim 2 wherein the digital entropy value determines whether to compress at least the portion of the plurality of blocks.
4. The computer-implemented method of claim 2 wherein at least the portion of the plurality of blocks with a similar digital entropy value are compressed together.
5. The computer-implemented method of claim 1 wherein a first level of compression is used to compress at least the portion of the plurality of blocks during background operations.
6. The computer-implemented method of claim 5 wherein a second level of compression is used to compress at least the portion of the plurality of blocks during non-background operations.
7. A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising:
identifying a plurality of blocks;
determining at least one heuristic associated with at least a portion of the plurality of blocks;
determining to group at least the portion of the plurality of blocks together for compressing at least the portion of the plurality of blocks based upon, at least in part, the at least one heuristic; and
compressing at least the portion of the plurality of blocks based upon, at least in part, the at least one heuristic,
wherein the at least one heuristic includes a distance metric associated with at least the portion of the plurality of blocks.
8. The computer program product of claim 7 wherein the at least one heuristic includes a digital entropy value associated with at least the portion of the plurality of blocks.
9. The computer program product of claim 8 wherein the digital entropy value determines whether to compress at least the portion of the plurality of blocks.
10. The computer program product of claim 8 wherein at least the portion of the plurality of blocks with a similar digital entropy value are compressed together.
11. The computer program product of claim 7 wherein a first level of compression is used to compress at least the portion of the plurality of blocks during background operations.
12. The computer program product of claim 11 wherein a second level of compression is used to compress at least the portion of the plurality of blocks during non-background operations.
13. A computing system including one or more processors and one or more memories configured to perform operations comprising:
identifying a plurality of blocks;
determining at least one heuristic associated with at least a portion of the plurality of blocks;
determining to group at least the portion of the plurality of blocks together for compressing at least the portion of the plurality of blocks based upon, at least in part, the at least one heuristic; and
compressing at least the portion of the plurality of blocks based upon, at least in part, the at least one heuristic,
wherein the at least one heuristic includes a distance metric associated with at least the portion of the plurality of blocks.
14. The computing system of claim 13 wherein the at least one heuristic includes a digital entropy value associated with at least the portion of the plurality of blocks.
15. The computing system of claim 14 wherein the digital entropy value determines whether to compress at least the portion of the plurality of blocks.
16. The computing system of claim 14 wherein at least the portion of the plurality of blocks with a similar digital entropy value are compressed together.
17. The computing system of claim 13 wherein a first level of compression is used to compress at least the portion of the plurality of blocks during background operations, and wherein a second level of compression is used to compress at least the portion of the plurality of blocks during non-background operations.