System and method for effective compression, representation and decompression of diverse tabulated data

1. A method for compression of data, comprising:

accessing tabulated data in at least two of a plurality of first file formats wherein the at least two of a plurality of first file formats are incompatible with one another;

extracting attributes from the tabulated data;

dividing the tabulated data into chunks;

processing the extracted attributes and chunks into correlated information;

selecting different compressors and dependency attributes for the attributes and chunks identified in the correlated information;

storing global data for compressors shared across chunks;

generating a file in a second file format that includes the correlated information, and further includes information indicative of the different compressors being used to compress the chunks and attributes, wherein the second file format is different from the first file formats; and

generating access control policy information for the correlated information, and integrating the access control policy information into the file of the second file format, wherein the access control policy information includes first information indicating a first level of access for a first portion of the correlated information and second information indicating a second level of access for a second portion of the correlated information, wherein the second level of access is different from a first level of access.

2. The method of claim 1 , wherein the correlated information includes at least one table including:

first information indicative of one or more of the attributes, and second information corresponding to chunks associated with the one or more attributes indicated in the first information.

3. The method of claim 2 , wherein the first information includes a two-dimensional array of cells and wherein each cell identifies one or more corresponding attributes included in the chunks corresponding to the two-dimensional array of cells.

4. The method of claim 3 , wherein the first information includes at least one one-dimensional table of dimension-specific attributes relating to the chunks.

5. The method of claim 1 , wherein code of or an executable of at least one of the different compressors is embedded in the file.

6. The method of claim 1 , wherein at least one of the different compressors encodes one or more attributes of the tabulated data as a sparse array.

7. The method of claim 1 , wherein the tabulated data is divided into chunks of different sizes.

8. The method of claim 1 , further comprising:

generating one or more attribute-specific indexes; and

incorporating the one or more attribute-specific indexes into the file of the second format, wherein the attribute-specific indexes enable identification of chunks containing a value or range of a specific attribute of the tabulated data.

9. The method of claim 1 , further comprising:

integrating the file in the second file format into an MPEG-G file.

10. The method of claim 1 , wherein code of or an executable of at least one of the different compressors is embedded in the file.

11. The method of claim 1 , wherein at least one of the different compressors encodes one or more attributes of the tabulated data as a sparse array.

12. An apparatus for compression of data, comprising:

a memory configured to store instructions; and

at least one processor configured to execute the instructions to perform operations including:

accessing tabulated data in at least two of a plurality of first file formats, wherein the at least two of a plurality of first file formats are incompatible with one another;

extracting attributes from the tabulated data;

dividing the tabulated data into chunks;

processing the extracted attributes and chunks into correlated information;

selecting different compressors and dependency attributes for the attributes and chunks identified in the correlated information;

storing global data for compressors shared across chunks; and

generating a file in a second file format that includes the correlated information and further including information indicative of the different compressors used for compressing the chunks and attributes, wherein the second file format is different from the first file formats; and

generating access control policy information for the correlated information, and integrate the access control policy information into the file of the second file format, wherein the access control policy information includes first information indicating a first level of access for a first portion of the correlated information and second information indicating a second level of access for a second portion of the correlated information, and wherein the second level of access is different from a first level of access.

13. The apparatus of claim 12 , wherein the correlated information includes at least one table including:

first information indicative of one or more of the attributes, and second information corresponding to chunks associated with the one or more attributes indicated in the first information.

14. The apparatus of claim 13 , wherein the first information includes a two-dimensional array of cells and wherein each cell identifies one or more corresponding attributes included in the chunks corresponding to the two-dimensional array of cells.

15. The apparatus of claim 14 , wherein the first information includes at least one one-dimensional table of dimension-specific attributes relating to the chunks.

16. The apparatus of claim 12 , wherein the tabulated data is divided into chunks of different sizes.

17. The apparatus of claim 12 , wherein the at least one processor is configured to execute the instructions to:

generate one or more attribute-specific indexes; and

incorporate the one or more attribute-specific indexes into the file of the second format, wherein the attribute-specific indexes enable identification of chunks containing a value or range of a specific attribute of the tabulated data.

18. The apparatus of claim 12 , wherein the at least one processor is configured to execute the instructions to integrate the file in the second file format into an MPEG-G file.