Generating a venn diagram using a columnar database management system
View Patent ↗Venn diagrams are computed for a given plurality of input sets. The process of computing the Venn diagrams is executed on columnar database systems for efficient execution. The computation of various subsets of the Venn diagrams is performed by determining subsets of various combinations of the input sets and computing set differences of the intersection sets. The process orders the execution of various steps of computing the subsets for the Venn diagram in an order that reduces the number of times an input set is loaded. Information describing various subsets of a Venn diagram is used to render the Venn diagram for display, for example, on a client device.
1. A computer-implemented method for generating information describing Venn diagrams, the method comprising:
receiving, from a client device over a network, a request to determine one or more subsets of a Venn diagram, the request identifying a plurality of input sets of data to be used as input for the Venn diagram;
retrieving the plurality of input sets of data indicated by the request from the client device, the plurality of input sets of data stored in a columnar format database accessible by the computer;
determining, by the computer, a plurality of intersection sets for all combinations of the plurality of input sets of data retrieved from the columnar format database, each intersection set of the plurality of intersections sets determined by the computer using a combination of input sets, the determining comprising:
loading a first combination of input sets,
determining a first intersection set from the first combination of input sets,
selecting a second intersection set based on a second combination of input sets, the second intersection set selected such that the input sets of the second combination include the input sets of the first combination,
loading input sets of the second combination that are not included in the first combination, and
determining the second intersection set;
determining, by the computer, the one or more subsets of the Venn diagram based on the plurality of intersection sets, the determining comprising computing a cardinality of each subset of the Venn diagram as a difference of a cardinality of a first intersection set and cardinality of previous computed subsets of the Venn diagram;
storing the one or more subsets of the Venn diagram on a non-transitory computer-readable medium; and
communicating the one or more subsets of the Venn diagram to the client device over the network for display on the client device.
2. The computer-implemented method of claim 1 , wherein determining a plurality of intersection sets comprises:
building a truth table representing combinations of input sets as binary values, wherein positions of bits in a binary value correspond to input sets and the value of a bit determines whether the input set corresponding to the position of the bit is included in the combination represented by the binary value.
3. The computer-implemented method of claim 2 , the method further comprising:
ranking the combinations of input sets based on number of ones in each binary value and using the ranking to select the second intersection set responsive to loading the input sets of the first combination.
4. The computer-implemented method of claim 1 , the method further comprising:
ranking the combinations of input sets based on the number of input sets in each combination and using the ranking to select the second intersection set responsive to loading the input sets of the first combination.
5. The computer-implemented method of claim 1 , wherein determining the one or more subsets of the Venn diagram based on the plurality of intersection sets further comprises:
determining a subset of the Venn diagram as a set difference of a first intersection set and one or more subsets of the Venn diagram that were previously computed.
6. The computer-implemented method of claim 1 , wherein determining the one or more subsets of the Venn diagram based on the plurality of intersection sets comprises:
ranking the combinations of sets based on the number of input sets in each combination; and
processing the combinations of sets in decreasing order of the number of input sets of each combination to determine subsets of the Venn diagram as set difference of intersection sets and previously computed subsets of Venn diagram.
7. The computer-implemented method of claim 1 , wherein the input sets are stored such that elements of a column are stored adjacent to each other on a secondary storage device.
8. A non-transitory computer readable storage medium storing instructions translatable by at least one computer processor for:
receiving, from a client device over a network, a request to determine one or more subsets of a Venn diagram, the request identifying a plurality of input sets of data to be used as input for the Venn diagram;
retrieving the plurality of input sets of data indicated by the request from the client device, the plurality of input sets of data stored in a columnar format database;
determining a plurality of intersection sets for all combinations of the plurality of input sets of data retrieved from the columnar format database, each intersection set of the plurality of intersection sets determined using a combination of input sets, the determining comprising:
loading a first combination of input sets,
determining a first intersection set from the first combination of input sets,
selecting a second intersection set based on a second combination of input sets, the second intersection set selected such that the input sets of the second combination include the input sets of the first combination,
loading input sets of the second combination that are not included in the first combination, and
determining the second intersection set;
determining the one or more subsets of the Venn diagram based on the plurality of intersection sets, the determining comprising computing a cardinality of each subset of the Venn diagram as a difference of a cardinality of a first intersection set and cardinality of previously computed subsets of the Venn diagram;
storing the one or more subsets of the Venn diagram; and
communicating the one or more subsets of the Venn diagram to the client device over the network for display on the client device.
9. The non-transitory computer readable storage medium of claim 8 , wherein determining a plurality of intersection sets comprises:
building a truth table representing combinations of input sets as binary values, wherein positions of bits in a binary value correspond to input sets and the value of a bit determines whether the input set corresponding to the position of the bit is included in the combination represented by the binary value.
10. The non-transitory computer readable storage medium of claim 9 , further comprising instructions for:
ranking the combinations of input sets based on number of ones in each binary value and using the ranking to select the second intersection set responsive to loading the input sets of the first combination.
11. The non-transitory computer readable storage medium of claim 8 , further comprising instructions for:
ranking the combinations of input sets based on the number of input sets in each combination and using the ranking to select the second intersection set responsive to loading the input sets of the first combination.
12. The non-transitory computer readable storage medium of claim 8 , wherein determining the one or more subsets of the Venn diagram based on the plurality of intersection sets further comprises:
determining a subset of the Venn diagram as a set difference of a first intersection set and one or more subsets of the Venn diagram that were previously computed.
13. The non-transitory computer readable storage medium of claim 8 , wherein determining the one or more subsets of the Venn diagram based on the plurality of intersection sets comprises:
ranking the combinations of sets based on the number of input sets in each combination; and
processing the combinations of sets in decreasing order of the number of input sets of each combination to determine subsets of the Venn diagram as set difference of intersection sets and previously computed subsets of the Venn diagram.
14. A computer-implemented system comprising:
at least one computer processor; and
a non-transitory computer-readable storage medium storing instructions translatable by the at least one computer processor for:
receiving, from a client device over a network, a request to determine one or more subsets of a Venn diagram, the request identifying a plurality of input sets of data to be used as input for the Venn diagram;
retrieving the plurality of input sets of data indicated by the request from the client device, the plurality of input sets of data stored in a columnar format;
determining a plurality of intersection sets for all combinations of the plurality of input sets of data retrieved from the columnar format database, each intersection set of the plurality of intersection sets determined using a combination of input sets, the determining comprising:
loading a first combination of input sets;
determining a first intersection set from the first combination of input sets,
selecting a second intersection set based on a second combination of input sets, the second intersection set selected such that the input sets of the second combination include the input sets of the first combination,
loading input sets of the second combination that are not included in the first combination, and
determining the second intersection set;
determining the one or more subsets of the Venn diagram based on the plurality of intersection sets, the determining comprising computing a cardinality of each subset of the Venn diagram as a difference of a cardinality of a first intersection set and cardinality of previously computed subsets of the Venn diagram;
storing the one or more subsets of the Venn diagram; and
communicating the one or more subsets of the Venn diagram to the client device over the network for display on the client device.
15. The computer-implemented system of claim 14 , wherein determining a plurality of intersection sets comprises:
building a truth table representing combinations of input sets as binary values, wherein positions of bits in a binary value correspond to input sets and the value of a bit determines whether the input set corresponding to the position of the bit is included in the combination represented by the binary value.
16. The computer-implemented system of claim 14 , further comprising instructions for:
ranking the combinations of input sets based on the number of input sets in each combination and using the ranking to select the second intersection set responsive to loading the input sets of the first combination.
17. The computer-implemented system of claim 14 , wherein determining the one or more subsets of the Venn diagram based on the plurality of intersection sets further comprises:
determining a subset of the Venn diagram as a set difference of a first intersection set and one or more subsets of the Venn diagram that were previously computed.
18. The computer-implemented system of claim 14 , wherein determining the one or more subsets of the Venn diagram based on the plurality of intersection sets comprises:
ranking the combinations of sets based on the number of input sets in each combination; and
processing the combinations of sets in decreasing order of the number of input sets of each combination to determine subsets of the Venn diagram as set difference of intersection sets and previously computed subsets of the Venn diagram.