Granted Patent B2

US 8,799,229 · App. 13/725,430 · Granted Aug 5, 2014

Abstract

Claims (73)

1. A computer-implemented method for generating a searchable archive executed by one or more computing devices, the method comprising:

receiving, by at least one of the one or more computing devices, one or more data values;

determining, by at least one of the one or more computing devices, one or more domains associated with the one or more data values, wherein each of the one or more data values is associated with a corresponding domain in the one or more domains;

generating, by at least one of the one or more computing devices, a domain structure for the one or more domains, wherein the domain structure identifies which of the one or more data values correspond to each domain in the one or more domains;

generating, by at least one of the one or more computing devices, one or more token columns from the one or more data values, wherein each token column corresponds to a domain in the one or more domains, and each unique token in the token column corresponds to a unique data value in the corresponding domain;

creating, by at least one of the one or more computing devices, one or more compressed token column segments from the one or more token columns; and

generating, by at least one of the one or more computing devices, one or more compacted files from the one or more compressed token column segments.

2. The computer-implemented method of claim 1 , wherein creating one or more compressed token column segments comprises:

dividing the one or more token columns into one or more token column segments, wherein each of the one or more token column segments has associated token column segment metadata relating to the tokens stored in that token column segment; and

creating one or more compressed token column segments from the one or more token column segments.

3. The computer-implemented method of claim 2 , wherein the one or more compacted files include the token column segment metadata associated with the one or more token column segments.

4. The computer-implemented method of claim 1 , further comprising:

dividing, by at least one of the one or more computing devices, the domain structure into one or more domain structure segments;

determining, by at least one of the one or more computing devices, domain metadata from the domain structure segments; and

compressing, by at least one of the one or more computing devices, the one or more domain structure segments to generate one or more compressed domain structure segments;

wherein the one or more compacted files include the one or more compressed domain structure segments.

5. An apparatus for generating a searchable archive, the apparatus comprising:

one or more processors; and

one or more memories operatively coupled to at least one of the one or more processors and having instructions stored thereon that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to:

receive one or more data values;

determine one or more domains associated with the one or more data values, wherein each of the one or more data values is associated with a corresponding domain in the one or more domains;

generate a domain structure for the one or more domains, wherein the domain structure identifies which of the one or more data values correspond to each domain in the one or more domains;

generate one or more token columns from the one or more data values, wherein each token column corresponds to a domain in the one or more domains, and each unique token in the token column corresponds to a unique data value in the corresponding domain;

create one or more compressed token column segments from the one or more token columns; and

generate one or more compacted files from the one or more compressed token column segments.

6. The apparatus of claim 5 , wherein the instructions that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to create one or more compressed token column segments further cause at least one of the one or more processors to:

divide the one or more token columns into one or more token column segments, wherein each of the one or more token column segments has associated token column segment metadata relating to the tokens stored in that token column segment; and

create one or more compressed token column segments from the one or more token column segments.

7. The apparatus of claim 6 , wherein the one or more compacted files include the token column segment metadata associated with the one or more token column segments.

8. The apparatus of claim 5 , wherein at least one of the one or more memories has further instructions stored thereon that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to:

divide the domain structure into one or more domain structure segments;

determine domain metadata from the domain structure segments; and

compress the one or more domain structure segments to generate one or more compressed domain structure segments;

wherein the one or more compacted files include the one or more compressed domain structure segments.

9. At least one non-transitory computer-readable medium storing computer-readable instructions that, when executed by one or more computing devices, cause at least one of the one or more computing devices to:

receive one or more data values;

determine one or more domains associated with the one or more data values, wherein each of the one or more data values is associated with a corresponding domain in the one or more domains;

generate a domain structure for the one or more domains, wherein the domain structure identifies which of the one or more data values correspond to each domain in the one or more domains;

generate one or more token columns from the one or more data values, wherein each token column corresponds to a domain in the one or more domains, and each unique token in the token column corresponds to a unique data value in the corresponding domain;

create one or more compressed token column segments from the one or more token columns; and

generate one or more compacted files from the one or more compressed token column segments.

10. The at least one non-transitory computer-readable medium of claim 9 , wherein the instructions that, when executed by at least one of the one or more computing devices, cause at least one of the one or more computing devices to create one or more compressed token column segments further cause at least one of the one or more computing devices to:

divide the one or more token columns into one or more token column segments, wherein each of the one or more token column segments has associated token column segment metadata relating to the tokens stored in that token column segment; and

create one or more compressed token column segments from the one or more token column segments.

11. The at least one non-transitory computer-readable medium of claim 10 , wherein the one or more compacted files include the token column segment metadata associated with the one or more token column segments.

12. The at least one non-transitory computer-readable medium of claim 9 , further storing computer-readable instructions that, when executed by at least one of the one or more computing devices, cause at least one of the one or more computing devices to:

divide the domain structure into one or more domain structure segments;

determine domain metadata from the domain structure segments; and

compress the one or more domain structure segments to generate one or more compressed domain structure segments;

wherein the one or more compacted files include the one or more compressed domain structure segments.

13. A computer-implemented method of generating a searchable archive by one or more computing devices, comprising:

receiving, by at least one of the one or more computing devices, one or more data values;

determining, by at least one of the one or more computing devices, one or more domains associated with the one or more data values, wherein each of the one or more data values is associated with a domain in the one or more domains;

generating, by at least one of the one or more computing devices, a domain structure for the one or more domains, wherein the domain structure identifies which of the one or more data values correspond to each domain in the one or more domains; and

generating, by at least one of the one or more computing devices, one or more bit vectors corresponding to the one or more data values, wherein each of the one or more bit vectors corresponds to a unique data value in a domain and indicates one or more locations of that unique data value in a column of data values which are in the same domain as the unique data value.

14. The method of claim 13 , wherein the one or more bit vectors are grouped according to domain, such that each bit vector in the one or more bit vectors is associated with a domain in the one or more domains.

15. The method of claim 14 , wherein the bit vectors for each domain are organized according to the lexical order of the corresponding unique data values in that domain.

16. An apparatus for generating a searchable archive, the apparatus comprising:

one or more processors; and

one or more memories operatively coupled to at least one of the one or more processors and having instructions stored thereon that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to:

receive one or more data values;

determine one or more domains associated with the one or more data values, wherein each of the one or more data values is associated with a domain in the one or more domains;

generate a domain structure for the one or more domains, wherein the domain structure identifies which of the one or more data values correspond to each domain in the one or more domains; and

generate one or more bit vectors corresponding to the one or more data values, wherein each of the one or more bit vectors corresponds to a unique data value in a domain and indicates one or more locations of that unique data value in a column of data values which are in the same domain as the unique data value.

17. The apparatus of claim 16 , wherein the one or more bit vectors are grouped according to domain, such that each bit vector in the one or more bit vectors is associated with a domain in the one or more domains.

18. The apparatus of claim 17 , wherein the bit vectors for each domain are organized according to the lexical order of the corresponding unique data values in that domain.

19. At least one non-transitory computer-readable medium storing computer-readable instructions that, when executed by one or more computing devices, cause at least one of the one or more computing devices to:

receive one or more data values;

determine one or more domains associated with the one or more data values, wherein each of the one or more data values is associated with a domain in the one or more domains;

generate a domain structure for the one or more domains, wherein the domain structure identifies which of the one or more data values correspond to each domain in the one or more domains; and

generate one or more bit vectors corresponding to the one or more data values, wherein each of the one or more bit vectors corresponds to a unique data value in a domain and indicates one or more locations of that unique data value in a column of data values which are in the same domain as the unique data value.

20. The at least one non-transitory computer-readable medium of claim 19 , wherein the one or more bit vectors are grouped according to domain, such that each bit vector in the one or more bit vectors is associated with a domain in the one or more domains.

21. The at least one non-transitory computer-readable medium of claim 20 , wherein the bit vectors for each domain are organized according to the lexical order of the corresponding unique data values in that domain.

Assignments (11)