Granted Patent B2

US 12,443,971 · App. 18/400,425 · Granted Oct 14, 2025

Inventors: Michael Sheppard (Holland, MI); Ludo Daemen (Duffel, BE); Edward Murphy (North Stonington, CT); Remy Spoentgen (Tampa, FL)

Assignee: The Nielsen Company (US), LLC

G06Q30/0244G06F17/15G06Q30/0245G06F17/18

Abstract

Claims (72)

1. An audience measurement computing system comprising:

at least one processor; and

memory having stored therein computer readable instructions that, upon execution by the at least one processor, cause the audience measurement computing system to at least:

obtain a dataset indicative of a set of individuals each associated with (i) respective covariates and (ii) respective outcomes;

identify, from amongst the obtained dataset, a first treatment dataset corresponding to first individuals who have been exposed to a first treatment of an advertisement, the first treatment dataset having first covariates;

identify, from amongst the obtained dataset, a second treatment dataset corresponding to second individuals who have been exposed to a second treatment of the advertisement, the second treatment dataset having second covariates;

identify, from amongst the obtained dataset, a control dataset corresponding to third individuals who have not been exposed to the advertisement, the control dataset having third covariates;

determine at least one covariate included in the first covariates, the second covariates, and the third covariates to balance between the first and second treatment datasets and the control dataset;

simultaneously compute, via maximum entropy, first weights for the first covariates, second weights for the second covariates, and third weights for the third covariates while constraining the first weights, the second weights, and the third weights such that a sum of the first weights applied respectively to the determined at least one covariate to balance across the first individuals equals a sum of the second weights applied respectively to the determined at least one covariate to balance across the second individuals and equals a sum of the third weights applied respectively to the determined at least one covariate to balance across the third individuals;

compute a first weighted response for the first treatment dataset based on the first weights and respective outcomes corresponding to the first weights;

compute a second weighted response for the second treatment dataset based on the second weights and respective outcomes corresponding to the second weights;

compute a third weighted response for the control dataset based on the third weights and respective outcomes corresponding to the third weights;

determining an effect of the first treatment of the advertisement based on a difference between the first weighted response and the third weighted response;

determine an effect of the second treatment of the advertisement based on a difference between the second weighted response and the third weighted response;

compare the determined effect of the second treatment of the advertisement with the determined effect of the first treatment of the advertisement; and

report an indication of the determined comparison between the determined effect of the second treatment of the advertisement and the determined effect of the first treatment of the advertisement.

2. The audience measurement computing system of claim 1 , wherein the computer readable instructions further cause, upon execution by the at least one processor, the audience measurement computing system to:

identify at least one additional covariate to balance that is included in both the first treatment dataset and the control dataset, wherein simultaneously computing the first weights, the second weights, and the third weights is further constrained by the at least one additional covariate to balance such that a sum of the first weights applied respectively to the at least one additional covariate to balance across the first individuals equals a sum of the second weights applied respectively to the at least one additional covariate to balance across the second individuals and also equals a sum of the third weights applied respectively to the at least one additional covariate to balance across the third individuals.

3. The audience measurement computing system of claim 1 , wherein the computer readable instructions further cause, upon execution by the at least one processor, the audience measurement computing system to report the indication by displaying the indication via a webpage.

4. The audience measurement computing system of claim 1 , wherein the effect of the first treatment of the advertisement is indicative of an average monetary change in purchases by the first individuals.

5. The audience measurement computing system of claim 1 , wherein the computer readable instructions further cause, upon execution by the at least one processor, the audience measurement computing system to:

responsive to simultaneously computing the first weights, the second weights, and the third weights, bypass multivariate reweighting to thereby improve performance of the audience measurement computing system by computing the first weighted response and the second weighted response based on the first weights and second weights, respectively, previously simultaneously computed via maximum entropy within a single processing clock cycle.

6. The audience measurement computing system of claim 1 , wherein simultaneously computing the first weights, the second weights, and the third weights, via maximum entropy, includes computing the first weights, the second weights, and the third weights within a single processing clock cycle.

7. The audience measurement computing system of claim 1 , wherein:

the first covariates are indicative of first ages and first genders of the first individuals;

the second covariates are indicative of second ages and second genders of the second individuals; and

the third covariates are indicative of third ages and third genders of the third individuals.

8. A non-transitory computer readable medium comprising instructions that, when executed by at least one processor of a computing system, cause the computing system to at least:

obtain a dataset indicative of a set of individuals each associated with (i) respective covariates and (ii) respective outcomes;

identify, from amongst the obtained dataset, a first treatment dataset corresponding to first individuals who have been exposed to a first treatment of an advertisement, the first treatment dataset having first covariates;

identify, from amongst the obtained dataset, a second treatment dataset corresponding to second individuals who have been exposed to a second treatment of the advertisement, the second treatment dataset having second covariates

identify, from amongst the obtained dataset, a control dataset corresponding to third individuals who have not been exposed to the advertisement, the control dataset having third covariates;

determine at least one covariate included in the first covariates, the second covariates, and the third covariates to balance between the first and second treatment datasets and the control dataset;

simultaneously compute, via maximum entropy, first weights for the first covariates, second weights for the second covariates, and third weights for the third covariates while constraining the first weights, the second weights, and the third weights such that a sum of the first weights applied respectively to the determined at least one covariate to balance across the first individuals equals a sum of the second weights applied respectively to the determined at least one covariate to balance across the second individuals and also equals a sum of the third weights applied respectively to the determined at least one covariate to balance across the third individuals;

compute a first weighted response for the first treatment dataset based on the first weights and respective outcomes corresponding to the first weights;

compute a second weighted response for the second treatment dataset based on the second weights and respective outcomes corresponding to the second weights;

compute a third weighted response for the control dataset based on the third weights and respective outcomes corresponding to the third weights;

determine an effect of the first treatment of the advertisement based on a difference between the first weighted response and the third weighted response;

determine an effect of the second treatment of the advertisement based on a difference between the first weighted response and the third weighted response;

compare the determined effect of the second treatment of the advertisement with the determined effect of the first treatment of the advertisement; and

report an indication of the determined comparison between the determined effect of the second treatment of the advertisement and the determined effect of the first treatment of the advertisement.

9. The non-transitory computer readable medium of claim 8 , wherein the instructions further cause, when executed by the at least one processor, the computing system to:

identify at least one additional covariate to balance that is included in-both the first treatment dataset, the second treatment dataset, and the control dataset, wherein simultaneously computing the first weights, the second weights, and the third weights is further constrained by the at least one additional covariate to balance such that a sum of the first weights applied respectively to the at least one additional covariate to balance across the first individuals equals a sum of the second weights applied respectively to the at least one additional covariate to balance across the second individuals and also equals a sum of the third weights applied respectively to the at least one additional covariate to balance across the third individuals.

10. The non-transitory computer readable medium of claim 8 , wherein the instructions further cause, when executed by the at least one processor, the computing system to report the indication by displaying the indication via a webpage.

11. The non-transitory computer readable medium of claim 8 , wherein the first weighted response shares a common scale with the second weighted response.

12. The non-transitory computer readable medium of claim 8 , wherein simultaneously computing the first weights, the second weights, and the third weights, via maximum entropy, includes computing the first weights, the second weights, and the third weights within a single processing clock cycle.

13. The non-transitory computer readable medium of claim 8 , wherein:

the first covariates are indicative of first ages and first genders of the first individuals;

the second covariates are indicative of second ages and second genders of the second individuals; and

the third covariates are indicative of third ages and third genders of the third individuals.

14. A method comprising:

obtaining a dataset indicative of a set of individuals each associated with (i) respective covariates and (ii) respective outcomes;

identifying, from amongst the obtained dataset, a first treatment dataset corresponding to first individuals who have been exposed to a first treatment of an advertisement, the first treatment dataset having first covariates;

identifying, from amongst the obtained dataset, a second treatment dataset corresponding to second individuals who have been exposed to a second treatment of the advertisement, the second treatment dataset having second covariates;

identifying, from amongst the obtained dataset, a control dataset corresponding to third individuals who have not been exposed to the advertisement, the control dataset having third covariates;

determining at least one covariate included in the first covariates, the second covariates, and the third covariates to balance between the first and second treatment datasets and the control dataset;

simultaneously computing, by executing an instruction with at least one processor, via maximum entropy, first weights for the first covariates, second weights for the second covariates, and third weights for the third covariates while constraining the first weights, the second weights, and the third weights such that a sum of the first weights applied respectively to the determined at least one covariate to balance across the first individuals equals a sum of the second weights applied respectively to the determined at least one covariate to balance across the second individuals and equals a sum of the third weights applied respectively to the determined at least one covariate to balance across the third individuals;

computing a first weighted response for the first treatment dataset based on the first weights and respective outcomes corresponding to the first weights;

computing a second weighted response for the second treatment dataset based on the second weights and respective outcomes corresponding to the second weights;

computing a third weighted response for the control dataset based on the third weights and respective outcomes corresponding to the third weights;

determining an effect of the first treatment of the advertisement based on a difference between the first weighted response and the third weighted response;

determining an effect of the second treatment of the advertisement based on a difference between the second weighted response and the third weighted response;

comparing the determined effect of the second treatment of the advertisement with the determined effect of the first treatment of the advertisement; and

reporting an indication of the determined comparison between the determined effect of the second treatment of the advertisement and the determined effect of the first treatment of the advertisement.

15. The method of claim 14 , further including identifying at least one additional covariate to balance that is included in both the first treatment dataset and the control dataset, wherein simultaneously computing the first weights, the second weights, and the third weights is further constrained by the at least one additional covariate to balance such that a sum of the first weights applied respectively to the at least one additional covariate to balance across the first individuals equals a sum of the second weights applied respectively to the at least one additional covariate to balance across the second individuals and also equals a sum of the third weights applied respectively to the at least one additional covariate to balance across the third individuals.

16. The method of claim 14 , wherein reporting the indication includes displaying the indication via a webpage.

17. The method of claim 14 , wherein the first weighted response shares a common scale with the second weighted response.

18. The method of claim 14 , wherein simultaneously computing the first weights, the second weights, and the third weights, via maximum entropy, includes computing the first weights, the second weights, and the third weights within a single processing clock cycle.

19. The method of claim 14 , wherein:

the first covariates are indicative of first ages and first genders of the first individuals;

the second covariates are indicative of second ages and second genders of the second individuals; and

the third covariates are indicative of third ages and third genders of the third individuals.

Assignments (1)

Continuity (7)

References Cited (34)