Multi-market calibration of convenience panel data to reduce behavioral biases
Example methods, apparatus, systems and articles of manufacture to implement calibration of convenience panel data to reduce behavioral bias are disclosed. Disclosed example apparatus include a distribution estimator to determine a first behavioral distribution for first convenience panel data associated with a first market and a measurement period, determine a second behavioral distribution for second convenience panel data associated with a second market and the measurement period, and determine a third behavioral distribution for probabilistic panel data associated with the second market and the measurement period. Disclosed example apparatus also include a distribution calibrator to calibrate the first behavioral distribution determined for the first convenience panel data associated with the first market based on (i) the second behavioral distribution determined for the second convenience panel data associated with the second market and (ii) the third behavioral distribution determined for the probabilistic panel data associated with the second market.
1. An apparatus comprising:
at least one memory;
instructions in the apparatus; and
processor circuitry to execute the instructions to:
communicate, via a network, with a first monitoring system that monitors online media served in a first market to obtain first convenience panel data associated with the first market and a first measurement period;
determine a first behavioral distribution for the first convenience panel data associated with the first market and the first measurement period;
communicate, via the network, with a second monitoring system that monitors online media served in a second market to obtain second convenience panel data associated with a second market and the first measurement period;
communicate, via the network, with a plurality of meters that monitor compute devices in the second market to obtain probabilistic panel data associated with the second market and the first measurement period;
determine a second behavioral distribution for the second convenience panel data associated with the second market and the first measurement period, the second market different from the first market;
determine a third behavioral distribution for the probabilistic panel data associated with the second market and the first measurement period;
calibrate the first behavioral distribution determined for the first convenience panel data associated with the first market based on (i) the second behavioral distribution determined for the second convenience panel data associated with the second market and (ii) the third behavioral distribution determined for the probabilistic panel data associated with the second market; and
output the calibrated first behavioral distribution to a downstream measurement process performed by an audience measurement system to determine an audience estimate for the online media served in the first market.
2. The apparatus of claim 1 , wherein the processor circuitry is to:
weight the first convenience panel data associated with the first market to determine weighted first convenience panel data associated with the first market, the processor circuitry to weight the first convenience panel data based on at least one of demographic weighting controls or location weighting controls obtained for the first market; and
determine the first behavioral distribution based on the weighted first convenience panel data associated with the first market.
3. The apparatus of claim 2 , wherein the processor circuitry is to:
weight the second convenience panel data associated with the second market to determine weighted second convenience panel data associated with the second market, the processor circuitry to weight the second convenience panel data based on the demographic weighting controls obtained for the first market; and
to determine the second behavioral distribution based on the weighted second convenience panel data associated with the second market.
4. The apparatus of claim 3 , wherein the processor circuitry is to:
weight the probabilistic panel data associated with the second market to determine weighted probabilistic panel data associated with the second market, the processor circuitry to weight the probabilistic panel data based on the demographic weighting controls obtained for the first market; and
determine the third behavioral distribution based on the weighted probabilistic panel data associated with the second market.
5. The apparatus of claim 1 , wherein the processor circuitry is to calibrate a value of a first category of the first behavioral distribution based on a corresponding value of the first category of the first behavioral distribution and a corresponding value of the first category of the third behavioral distribution to determine a first calibrated value of the first category of the first behavioral distribution.
6. The apparatus of claim 5 , wherein the processor circuitry is to calibrate the value of the first category of the first behavioral distribution by scaling the value of the first category of the first behavioral distribution by a ratio of (i) the corresponding value of the first category of the first behavioral distribution to (ii) the corresponding value of the first category of the third behavioral distribution.
7. The apparatus of claim 5 , wherein the processor circuitry is to calibrate the first calibrated value of the first category of the first behavioral distribution to determine a second calibrated value of the first category of the first behavioral distribution.
8. The apparatus of claim 1 , wherein the processor circuitry is to calibrate the first convenience panel data associated with the first market based on the calibrated first behavioral distribution.
9. A non-transitory computer readable medium comprising computer readable instructions that, when executed, cause a processor to at least:
communicate, via a network, with a first monitoring system that monitors online media served in a first market to obtain first convenience panel data associated with the first market and a first measurement period;
determine a first behavioral distribution for the first convenience panel data associated with the first market and the first measurement period;
communicate, via the network, with a second monitoring system that monitors online media served in a second market to obtain second convenience panel data associated with a second market and the first measurement period;
communicate, via the network, with a plurality of meters that monitor compute devices in the second market to obtain probabilistic panel data associated with the second market and the first measurement period;
determine a second behavioral distribution for the second convenience panel data associated with the second market and the first measurement period, the second market different from the first market;
determine a third behavioral distribution for the probabilistic panel data associated with the second market and the first measurement period;
calibrate the first behavioral distribution determined for the first convenience panel data associated with the first market based on (i) the second behavioral distribution determined for the second convenience panel data associated with the second market and (ii) the third behavioral distribution determined for the probabilistic panel data associated with the second market; and
output the calibrated first behavioral distribution to a downstream measurement process performed by an audience measurement system to determine an audience estimate for the online media served in the first market.
10. The non-transitory computer readable medium of claim 9 , wherein the instructions, when executed, cause the processor to:
weight the first convenience panel data associated with the first market to determine weighted first convenience panel data associated with the first market, the first convenience panel data to be weighted based on at least one of demographic weighting controls or location weighting controls obtained for the first market; and
determine the first behavioral distribution based on the weighted first convenience panel data associated with the first market.
11. The non-transitory computer readable medium of claim 10 , wherein the instructions, when executed, cause the processor to:
weight the second convenience panel data associated with the second market to determine weighted second convenience panel data associated with the second market, the second convenience panel data to be weighted based on the demographic weighting controls obtained for the first market; and
determine the second behavioral distribution based on the weighted second convenience panel data associated with the second market.
12. The non-transitory computer readable medium of claim 11 , wherein the instructions, when executed, cause the processor to:
weight the probabilistic panel data associated with the second market to determine weighted probabilistic panel data associated with the second market, the probabilistic panel data to be weighted based on the demographic weighting controls obtained for the first market; and
determine the third behavioral distribution based on the weighted probabilistic panel data associated with the second market.
13. The non-transitory computer readable medium of claim 9 , wherein the instructions, when executed, cause the processor to:
calibrate a value of a first category of the first behavioral distribution based on a corresponding value of the first category of the first behavioral distribution and a corresponding value of the first category of the third behavioral distribution to determine a first calibrated value of the first category of the first behavioral distribution; and
further calibrate the first calibrated value of the first category of the first behavioral distribution to determine a second calibrated value of the first category of the first behavioral distribution.
14. The non-transitory computer readable medium of claim 13 , wherein the instructions, when executed, cause the processor to calibrate the value of the first category of the first behavioral distribution by scaling the value of the first category of the first behavioral distribution by a ratio of (i) the corresponding value of the first category of the first behavioral distribution to (ii) the corresponding value of the first category of the third behavioral distribution.
15. A method comprising:
communicating, via a network, with a first monitoring system that monitors online media served in a first market to obtain first convenience panel data associated with the first market and a first measurement period;
determining, by executing an instruction with a processor, a first behavioral distribution for the first convenience panel data associated with the first market and the first measurement period;
communicating, via the network, with a second monitoring system that monitors online media served in a second market to obtain second convenience panel data associated with a second market and the first measurement period;
communicating, via the network, with a plurality of meters that monitor compute devices in the second market to obtain probabilistic panel data associated with the second market and the first measurement period;
determining, by executing an instruction with the processor, a second behavioral distribution for the second convenience panel data associated with the second market and the first measurement period, the second market different from the first market;
determining, by executing an instruction with the processor, a third behavioral distribution for the probabilistic panel data associated with the second market and the first measurement period;
calibrating, by executing an instruction with the processor, the first behavioral distribution determined for the first convenience panel data associated with the first market based on (i) the second behavioral distribution determined for the second convenience panel data associated with the second market and (ii) the third behavioral distribution determined for the probabilistic panel data associated with the second market; and
outputting the calibrated first behavioral distribution to a downstream measurement process performed by an audience measurement system to determine an audience estimate for the online media served in the first market.
16. The method of claim 15 , wherein the determining of the first behavioral distribution includes:
weighting the first convenience panel data associated with the first market to determine weighted first convenience panel data associated with the first market, the first convenience panel data being weighted based on at least one of demographic weighting controls or location weighting controls obtained for the first market; and
determining the first behavioral distribution based on the weighted first convenience panel data associated with the first market.
17. The method of claim 16 , wherein the determining of the second behavioral distribution includes:
weighting the second convenience panel data associated with the second market to determine weighted second convenience panel data associated with the second market, the second convenience panel data being weighted based on the demographic weighting controls obtained for the first market; and
determining the second behavioral distribution based on the weighted second convenience panel data associated with the second market.
18. The method of claim 17 , wherein the determining of the third behavioral distribution includes:
weighting the probabilistic panel data associated with the second market to determine weighted probabilistic panel data associated with the second market, the probabilistic panel data being weighted based on the demographic weighting controls obtained for the first market; and
determining the third behavioral distribution based on the weighted probabilistic panel data associated with the second market.
19. The method of claim 15 , wherein the calibrating of the first behavioral distribution includes:
calibrating a value of a first category of the first behavioral distribution based on a corresponding value of the first category of the first behavioral distribution and a corresponding value of the first category of the third behavioral distribution to determine a first calibrated value of the first category of the first behavioral distribution; and
further calibrating the first calibrated value of the first category of the first behavioral distribution to determine a second calibrated value of the first category of the first behavioral distribution.
20. The method of claim 19 , wherein the calibrating of the value of the first category of the first behavioral distribution includes scaling the value of the first category of the first behavioral distribution by a ratio of (i) the corresponding value of the first category of the first behavioral distribution to (ii) the corresponding value of the first category of the third behavioral distribution.