Data integration and analysis
View Patent ↗Uncorrelated data from a variety of sources, such as consumer panels or retailer points of sale, are combined with maximal coverage of a universal data set for a population in a manner that permits useful inferences about behavioral propensities for the population at an individual or household level.
1. A computer program product embodied in a non-transitory computer readable medium that, when executing on one or more computing devices, performs the steps of:
receiving a universal data set comprising geographic data for a plurality of customers within a geographic area, the universal data set having an order and the universal data set aggregated at a household level;
importing consumer panel data according to the order of the universal data set, the consumer panel data including a number of customer-reported transactions for a first subset of the plurality of customers and the consumer panel data aggregated at an individual customer level;
importing retailer data according to the order of the universal data set, until a pre-determined threshold of a retailer for obtaining the retailer data from the retailer is achieved, the retailer data including customer data from the retailer for a second subset of the plurality of customers, wherein the second subset overlaps the first subset, and the retailer data aggregated at a retailer-provided level; and
combining the consumer panel data and the retailer data according to the order of the universal data set at a normalized level of aggregation, thereby providing a data set representative of the first subset of the plurality of customers and the second subset of the plurality of customers.
2. The computer program product of claim 1 , wherein the retailer data includes point of sale data.
3. The computer program product of claim 1 , wherein the retailer data includes shipping data.
4. The computer program product of claim 1 , wherein the retailer data includes media delivery data.
5. The computer program product of claim 1 , wherein the retailer data includes credit card data.
6. The computer program product of claim 1 , wherein the retailer data includes clickstream data.
7. The computer program product of claim 1 , further comprising code for performing the step of modeling a propensity for a specific behavior for the plurality of customers in the universal data set according to the data set representative of the first subset of the plurality of customers and the second subset of the plurality of customers.
8. The computer program product of claim 7 wherein the specific behavior includes at least one of:
buying a particular brand of goods or services,
purchasing a specified collection of goods or services, or a dollar amount worth of goods or services, and
consuming media from a particular media outlet.
9. The computer program product of claim 7 , wherein the specific behavior includes shopping at a particular store.
10. The computer program product of claim 8 , wherein the specific behavior includes buying goods or services at a discount.
11. A method comprising:
receiving at a computer a universal data set comprising geographic data for a plurality of customers within a geographic area, the universal data set having an order and the universal data set aggregated at a household level;
importing to a memory of the computer consumer panel data according to the order of the universal data set, the consumer panel data including a number of customer-reported transactions for a first subset of the plurality of customers and the consumer panel data aggregated at an individual customer level;
importing to the memory of the computer retailer data according to the order of the universal data set, until a pre-determined threshold of a retailer for obtaining the retailer data from the retailer is achieved, the retailer data including customer data from the retailer for a second subset of the plurality of customers, wherein the second subset overlaps the first subset, and the retailer data aggregated at a retailer-provided level; and
with the computer, combining the consumer panel data and the retailer data according to the order of the universal data set at a normalized level of aggregation, thereby providing data set representative of the first subset of the plurality of customers and the second subset of the plurality of customers.
12. The method of claim 11 , wherein the retailer data includes point of sale data.
13. The method of claim 11 , wherein the retailer data includes shipping data.
14. The method of claim 11 , wherein the retailer data includes media delivery data.
15. The method of claim 11 , wherein the retailer data includes credit card data.
16. The method of claim 11 , wherein the retailer data includes clickstream data.
17. The method of claim 11 , further comprising code for performing the step of modeling a propensity for a specific behavior for the plurality of customers in the universal data set according to the data set representative of the first subset of the plurality of customers and the second subset of the plurality of customers.
18. The method of claim 17 wherein the specific behavior includes at least one of:
buying a particular brand of goods or services,
purchasing a specified collection of goods or services, or a dollar amount worth of goods or services, and
consuming media from a particular media outlet.
19. The method of claim 17 , wherein the specific behavior includes shopping at a particular store.
20. The method of claim 18 , wherein the specific behavior includes buying goods or services at a discount.