Associative matrix observing methods, systems and computer program products using bit plane representations of selected segments
Associative matrix compression methods, systems, computer program products and data structures compress an association matrix that contains counts that indicate associations among pairs of attributes. Selective bit plane representations of those selected segments of the association matrix that have at least one count is performed, to allow compression. More specifically, a set of segments is generated, a respective one of which defines a subset, greater than one, of the pairs of attributes. Selective identifications of those segments that have at least one count are stored. The at least one count that is associated with a respective identified segment is also stored as at least one bit plane representation. The at least one bit plane representation identifies a value of the at least one associated count for a bit position of the count that corresponds to the associated bit plane.
1. A method, comprising:
observing an association among observed attributes into a compressed association matrix in a memory that contains a plurality of counts that indicate associations among a plurality of pairs of attributes, the compressed association matrix comprising identifications of segments of the association matrix that have at least one count that is associated therewith, and at least one bit plane representation of the at least one count that is associated with a respective identified segment, the at least one bit plane representation identifying a value of the at least one associated count for a bit position of the count that corresponds to the associated bit plane,
wherein observing the association comprises:
adding the association among the observed attributes to the at least one bit plane representation that corresponds to the observed attributes, if the observed attributes exist in the identification of segments of the association matrix that have at least one count that is associated therewith; and
creating at least one bit plane representation for the observed attributes, if the observed attributes do not exist in the identification of segments of the association matrix that have at least one count that is associated therewith.
2. A method according to claim 1 , further comprising converting an external context that corresponds to the observed attributes into an internal representation.
3. A method according to claim 2 , wherein converting the external context that corresponds to the observed attributes into an internal representation comprises:
obtaining the observed attributes from the context;
determining, for each of the observed attributes, whether a corresponding attribute key/value exists in the compressed association matrix; and
creating, for each of the observed attributes that do not have a corresponding attribute key/value, a new attribute key/value.
4. A method according to claim 3 , further comprising assigning a numerical representation for each new attribute key/value.
5. A method according to claim 4 , further comprising creating an internal attribute for each of the observed attributes by concatenating the corresponding attribute key and value numerical representations.
6. A method according to claim 1 , further comprising determining a matrix type;
if the matrix type is a small matrix type, creating new internal attributes corresponding to observed attributes that are not in the compressed association matrix and adding the association corresponding to the observed attributes one time; and
if the matrix type is a large matrix type, determining the association corresponding to the observed attributes from an internal context and adding the association to the compressed association matrix two times corresponding to two halves of the large matrix that are stored.
7. A system comprising a memory that includes computer instructions that are configured to perform the method of claim 1 .
8. A system comprising a memory that includes computer instructions that are configured to perform the method of claim 2 .
9. A system comprising a memory that includes computer instructions that are configured to perform the method of claim 6 .
10. A computer program product, the computer program product comprising a memory haying computer-readable program codes embodied in the memory, the computer readable program codes configured to perform the method of claim 1 .
11. A computer program product, the computer program product comprising a memory haying computer-readable program codes embodied in the memory, the computer readable program codes configured to perform the method of claim 2 .
12. A computer program product, the computer program product comprising a memory having computer-readable program codes embodied in the memory, the computer readable program codes configured to perform the method of claim 6 .