Graph-based compression of data records
In general, systems, methods and computer readable media for data record compression using graph-based techniques are provided herein.
1. An apparatus comprising a processor and memory storing computer-readable program code configured to, when executed by the processor, cause the apparatus to:
receive a query comprising search terms, wherein the search terms comprise a unique identifier;
retrieve a stored compressed consumer impression data records set comprising a byte array based on a directed link graph representation of the stored compressed consumer impression data records set; and
identify a consumer impression data records subset from the stored compressed consumer impression data records set based on the unique identifier.
2. The apparatus of claim 1 , wherein the computer-readable program code is further configured to, when executed by the processor, cause the apparatus to:
determine an offset location in the byte array based on the unique identifier associated with a consumer; and
unpack a byte array segment beginning at the offset location.
3. The apparatus of claim 2 , wherein the computer-readable program code is further configured to, when executed by the processor, cause the apparatus to identify the consumer impression data records subset associated with the consumer based on the byte array segment.
4. The apparatus of claim 3 , wherein the offset location is a first offset location, wherein the search terms comprise a component identifier, and wherein the computer-readable program code is further configured to, when executed by the processor, cause the apparatus to:
determine a second offset location in the byte array based on the component identifier, wherein the second offset location is within the byte array segment beginning at the first offset location; and
unpack the byte array segment beginning at the second offset location.
5. The apparatus of claim 1 , wherein the stored compressed consumer impression data records set comprises consumer impression data records describing consumer behavior instances associated with a consumer collected during a time window.
6. The apparatus of claim 5 , wherein the directed link graph representation of the stored compressed consumer impression data records set comprises graph nodes and graph edges, wherein the graph nodes respectively represent consumer behavior instances, and wherein each of the graph edges respectively represents a hyperlink between a pair of the graph nodes.
7. The apparatus of claim 5 , wherein the computer-readable program code is further configured to, when executed by the processor, cause the apparatus to:
identify the consumer impression data records subset associated with the consumer based on a key/value store wrapper comprising a key and a value, wherein the key is the unique identifier, and wherein the value is an offset within the byte array at which a list of compressed tables representing consumer behavior instances are stored.
8. A computer-implemented method comprising:
receiving a query comprising search terms, wherein the search terms comprise a unique identifier;
retrieving a stored compressed consumer impression data records set comprising a byte array based on a directed link graph representation of the stored compressed consumer impression data records set; and
identifying a consumer impression data records subset from the stored compressed consumer impression data records set based on the unique identifier.
9. The computer-implemented method of claim 8 further comprising:
determining an offset location in the byte array based on the unique identifier associated with a consumer; and
unpacking a byte array segment beginning at the offset location.
10. The computer-implemented method of claim 9 , wherein identifying the consumer impression data records subset associated with the consumer is based on the byte array segment.
11. The computer-implemented method of claim 10 , wherein the offset location is a first offset location, wherein the search terms comprise a component identifier, and wherein the computer-implemented method further comprises:
determining a second offset location in the byte array based on the component identifier, wherein the second offset location is within the byte array segment beginning at the first offset location; and
unpacking the byte array segment beginning at the second offset location.
12. The computer-implemented method of claim 8 , wherein the stored compressed consumer impression data records set comprises consumer impression data records describing consumer behavior instances associated with a consumer collected during a time window.
13. The computer-implemented method of claim 12 , wherein the directed link graph representation of the stored compressed consumer impression data records set comprises graph nodes and graph edges, wherein the graph nodes respectively represent consumer behavior instances, and wherein each of the graph edges respectively represents a hyperlink between a pair of the graph nodes.
14. The computer-implemented method of claim 12 further comprising:
identifying the consumer impression data records subset associated with the consumer based on a key/value store wrapper comprising a key and a value, wherein the key is the unique identifier, and wherein the value is an offset within the byte array at which a list of compressed tables representing consumer behavior instances are stored.
15. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising an executable portion configured to:
receive a query comprising search terms, wherein the search terms comprise a unique identifier;
retrieve a stored compressed consumer impression data records set comprising a byte array based on a directed link graph representation of the stored compressed consumer impression data records set; and
identify a consumer impression data records subset from the stored compressed consumer impression data records set based on the unique identifier.
16. The computer program product of claim 15 , wherein the computer-readable program code portions comprising the executable portion configured to:
determine an offset location in the byte array based on the unique identifier associated with a consumer; and
unpack a byte array segment beginning at the offset location.
17. The computer program product of claim 16 , wherein the computer-readable program code portions comprising the executable portion configured to identify the consumer impression data records subset associated with the consumer based on the byte array segment.
18. The computer program product of claim 17 , wherein the offset location is a first offset location, wherein the search terms comprise a component identifier, and wherein the computer-readable program code portions comprising the executable portion configured to:
determine a second offset location in the byte array based on the component identifier, wherein the second offset location is within the byte array segment beginning at the first offset location; and
unpack the byte array segment beginning at the second offset location.
19. The computer program product of claim 15 , wherein the stored compressed consumer impression data records set comprises consumer impression data records describing consumer behavior instances associated with a consumer collected during a time window.
20. The computer program product of claim 19 , wherein the directed link graph representation of the stored compressed consumer impression data records set comprises graph nodes and graph edges, wherein the graph nodes respectively represent consumer behavior instances, and wherein each of the graph edges respectively represents a hyperlink between a pair of the graph nodes.