EVALUATING MEDIA CONTENT USING MONTE CARLO ATTRIBUTION

1 . A method, comprising:

receiving exposure data for a set of households, the exposure data comprising supplemental content associated with media content;

determining an exposed set of households from the set of households, the exposed set of households corresponding to households of the set of households that have been exposed to the supplemental content, the exposures occurring within a first set of conversion windows;

determining an unexposed set of households from the set of households, the unexposed set of household corresponding to households of the set of households that have not been exposed to the supplemental content;

determining a second set of conversion windows for the unexposed households, the second set of conversion windows being based at least partially on the first set of conversion windows; and

determining a conversion rate for the unexposed households within the second set of conversion windows, the conversion rate associated with interactions related to the supplemental content within the second set of conversion windows.

2 . The method of claim 1 , further comprising:

comparing a number of the exposed set of households to a threshold;

obtaining a third set of conversion windows corresponding to a second exposed set of households when the number of exposed set of households is below the threshold; and

determining a second conversion rate for the unexposed households within the third set of conversion windows.

3 . The method of claim 1 , further comprising:

determining an exposed conversion rate for the exposed set of households;

comparing the exposed conversion rate for the exposed set of households to the conversion rate for the unexposed households; and

determining a lift associated with the supplemental content based at least in part on a difference between the exposed conversion rate for the exposed set of households and the conversion rate for the unexposed households.

4 . The method of claim 1 , further comprising:

determining a second unexposed set of households from the set of households, the second unexposed set of households corresponding to households of the set that have not been exposed to the supplemental content;

forming a control group from the second unexposed set of households, the control group corresponding to households having a likelihood above an exposure threshold for exposure to the supplemental content; and

determining a conversion rate for the control group within a control conversion window.

5 . The method of claim 4 , further comprising:

determining an exposed conversion rate for the exposed set of households;

comparing the exposed conversion rate for the exposed set of households to the conversion rate for the unexposed households; and

determining a lift associated with the supplemental content based at least in part on a difference between the exposed conversion rate for the exposed set of households, the conversion rate for the control group, and the conversion rate for the unexposed households.

6 . The method of claim 1 , wherein the second set of conversion windows is equal to the first set of conversion windows.

7 . A computing device, comprising:

a microprocessor; and

memory including instructions that, when executed by the microprocessor, cause the computing device to:

obtain viewership data corresponding to content consumed by a plurality of households, the content including supplemental content;

determine a group of exposed households from the plurality of households, the exposed households having a minimum interaction with the supplemental content;

determine a set of conversion windows comprising a respective conversion window for each exposed household of the group of exposed households, the respective conversion window defining a period of time associating the minimum interaction with the supplemental control to the exposure;

determine a group of unexposed households from the plurality of households;

set at least one conversion window of the set of conversion windows as an unexposed conversion window for an unexposed household of the group of unexposed households; and

determine an unexposed conversion rate for the unexposed household within the unexposed conversion window.

8 . The computing device of claim 7 , wherein the memory includes instructions that, when executed by the microprocessor, further cause the computing device to:

determine a second unexposed conversion rate for the unexposed household within a second unexposed conversion window, different from the unexposed conversion window; and

determine an average unexposed conversion rate.

9 . The computing device of claim 7 , wherein the memory includes instructions that, when executed by the microprocessor, further cause the computing device to:

determine a second group of unexposed households from the plurality of households, the second group of unexposed households having at least one demographic property representative of an increased likelihood of exposure to the supplemental content;

set a second conversion window for the second group of unexposed households; and

determine a second unexposed conversion rate for the second group of unexposed households.

10 . The computing device of claim 9 , wherein the memory includes instructions that, when executed by the microprocessor, further cause the computing device to:

determine an exposed conversion rate for the exposed households within the conversion window;

determine a lift associated with the supplemental content, the lift corresponding to a difference between the exposed conversion rate, the second unexposed conversion rate and unexposed conversion rate.

11 . The computing device of claim 7 , wherein the memory includes instructions that, when executed by the microprocessor, further cause the computing device to:

determine a conversion distribution over at least a portion of the exposed households, the conversion distribution corresponding to the exposed conversion rate over a plurality of different conversion windows.

12 . The computing device of claim 7 , wherein the memory includes instructions that, when executed by the microprocessor, further cause the computing device to:

obtain a browsing history for each household of the group of unexposed households, wherein the conversion rate for the unexposed households is calculated based at least in part on the browsing history.

13 . A method, comprising:

obtaining viewership data corresponding to content consumed by a plurality of households, the content including supplemental content;

determining a group of exposed households from the plurality of households, the exposed households having a minimum interaction with the supplemental content;

determining a set of conversion windows comprising a respective conversion window for each exposed household of the group of exposed households, the respective conversion window defining a period of time associating the minimum interaction with the supplemental control to the exposure;

determining a group of unexposed households from the plurality of households;

setting at least one conversion window of the set of conversion windows as an unexposed conversion window for an unexposed household of the group of unexposed households; and

determining an unexposed conversion rate for the unexposed household within the unexposed conversion window.

14 . The method of claim 13 , further comprising:

determining a second unexposed conversion rate for the unexposed household within a second unexposed conversion window, different from the unexposed conversion window; and

determine an average unexposed conversion rate based at least in part on the unexposed conversion rate and the second unexposed conversion rate.

15 . The method of claim 13 , further comprising:

determining an average exposed conversion rate as a function of days after exposure for at least one household of the exposed households;

determining an average unexposed conversion rate as a function of days after exposure for at least one household of the unexposed households;

comparing the average exposed conversion rate to the average unexposed conversion rate; and

recalculating the average exposed conversion rate and the average unexposed conversion rate when the conversion rate is lower at an end of a campaign than at a beginning of the campaign.

16 . The method of claim 13 , further comprising:

determining a second group of unexposed households from the plurality of households, the second group of unexposed households having at least one demographic property representative of an increased likelihood of exposure to the supplemental content;

setting a second conversion window for the second group of unexposed households;

determining a second unexposed conversion rate for the second group of unexposed household;

comparing the second unexposed conversion rate to the unexposed conversion rate; and

determining a level of success of a campaign based at least in part on the comparison between the second unexposed conversion rate and the unexposed conversion rate.

17 . The method of claim 13 , further comprising:

determining a conversion distribution over at least a portion of the exposed households, the conversion distribution corresponding to the exposed conversion rate over a plurality of different conversion windows.

18 . The method of claim 13 , further comprising:

determining a targeting lift based at least in part on a difference between the exposed conversion rate and the unexposed conversion rate.

19 . The method of claim 18 , further comprising:

adjusting a campaign based at least in part on the targeting lift, wherein a campaign length is increased when the targeting lift is above a threshold.

20 . The method of claim 13 , further comprising:

obtaining a browsing history for each household of the group of unexposed households, wherein the conversion rate for the unexposed households is calculated based at least in part on the browsing history.