IP Library Granted Patent US 10,045,082
Granted Patent B2
US 10,045,082 · App. 14/967,355 · Granted Aug 7, 2018

Methods and apparatus to correct errors in audience measurements for media accessed using over-the-top devices

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,045,082
App. No.
14/967,355
Granted
Aug 7, 2018
Kind
B2
Abstract

Methods and apparatus to correct errors in measuring audiences of over-the-top media are disclosed. In some examples, the methods and apparatus identify a first set of data from a first data source, the first set of data different from a second set of data from a second data source. In some examples, the methods and apparatus generate a third set of data based on the second set of data from the second data source. In some examples, the methods and apparatus generate a model based on a difference between the first set of data and the third set of data. In some examples, the methods and apparatus apply the model to the first set of data. In some examples, the methods and apparatus assign viewership to an impression associated with the first set of data by imputing viewership associated with the second set of data to the first set of data.

Claims (88)

1. A method comprising:

identifying, by executing an instruction via a processor, a first set of impression data received from a computer at a first data source, the first set of impression data having matched demographic data from users registered with both an over-the-top (OTT) device and a database proprietor, the first set of impression data different from a second set of data from a second data source, the computer producing a misattribution error in the first set of impression data, the misattribution error based on a demographic data error in the first set of impression data, the demographic data error based on a difference between reported demographic data in the first set of impression data and actual demographic data corresponding to the first set of impression data;

generating, by executing an instruction via the processor, a third set of data based on the second set of data from the second data source;

generating, by executing an instruction via the processor, an independent binary model based on a difference between the first set of impression data and the third set of data;

correcting the demographic data error in the first set of impression data by applying, by executing an instruction via the processor, the independent binary model to the first set of impression data to generate corrected demographic data; and

correcting the misattribution error produced by the computer by assigning, by executing an instruction via the processor, viewership to an impression associated with the first set of impression data using the corrected demographic data.

2. The method as defined in claim 1 , wherein the generating of the third set of data includes:

identifying a demographic bucket;

determining whether the demographic bucket exists in a household based on the independent binary model; and

determining the number of members in the household associated with the demographic bucket based on a demographic distribution associated with the second set of data.

3. The method as defined in claim 2 , wherein the independent binary model is a machine learning algorithm generated based on at least one of a household size, an age, a gender, a person status, an income, an education, or an ethnicity.

4. The method as defined in claim 3 , wherein the machine learning algorithm is at least one of a classification and regression tree, a log it function, a conditional inference tree, a random forest, a neural network, or a bootstrap aggregate decision tree.

5. The method as defined in claim 1 , wherein the first set of impression data from the first data source has a fourth set of data missing, further including linearly scaling the first set of impression data to accommodate for the missing fourth set of data.

6. A method comprising:

identifying, by executing an instruction via a processor, a first set of impression data received from a computer at a first data source, the first set of impression data different from a second set of data from a second data source, the computer producing a misattribution error in the first set of impression data, the misattribution error based on a demographic data error in the first set of impression data, the demographic data error based on a difference between reported demographic data in the first set of impression data and actual demographic data corresponding to the first set of impression data;

generating, via the processor, a third set of data based on the second set of data from the second data source;

generating, via the processor, an independent binary model based on a difference between the first set of impression data and the third set of data; and

correcting the demographic data error in the first set of impression data by applying, via the processor, the independent binary model to the first set of impression data to generate corrected demographic data; and

correcting the misattribution error produced by the computer by assigning, via the processor, viewership to an impression associated with the first set of impression data using the corrected demographic data, the assigning of the viewership to the impression includes:

identifying viewing history associated with the second set of data;

determining a first time associated with a first demographic viewing a media presentation in a first household associated with the second set of data;

determining a second time associated with the first demographic and a second demographic viewing the media presentation in the household;

determining a first probability that the first demographic viewed the media presentation by dividing the first time by the second time;

identifying a first person in the first household associated with the second set of data having a second probability similar to the first probability; and

imputing a viewing history of the first person to a second person in a second household associated with the first set of impression data.

7. The method as defined in claim 6 , wherein the identifying of the first person in the first household associated with the second set of data having the second probability similar to the first probability includes:

identifying a third person in the first household associated with the second set of data;

ranking the first and third person based on a first highest probability;

identifying a fourth person in the second household associated with the first set of impression data;

ranking the second and fourth person based on a second highest probability; and

identifying the first person has the second probability similar to the first probability when the first person has the first highest probability and the second person has the second highest probability.

8. An apparatus comprising:

a demographic corrector to:

identify a first set of impression data received from a computer at a first data source, the first set of impression data having matched demographic data from users registered with both an over-the-top (OTT) device and a database proprietor, the first set of impression data different from a second set of data from a second data source, the computer producing a misattribution error in the first set of impression data, the misattribution error based on a demographic data error in the first set of impression data, the demographic data error based on a difference between reported demographic data in the first set of impression data and actual demographic data corresponding to the first set of impression data;

generate a third set of data based on the second set of data from the second data source;

generate an independent binary model based on a difference between the first set of impression data and the third set of data; and

correct the demographic data error in the first set of impression data by applying the independent binary model to the first set of impression data to generate corrected demographic data; and

a viewership assigner to correct the misattribution error produced by the computer by assigning viewership to an impression associated with the first set of impression data using the corrected demographic data, in which at least one of the demographic corrector or the viewership assigner is a logic circuit.

9. The apparatus as defined in claim 8 , wherein to generate the third set of data, the demographic corrector is to:

identify a demographic bucket;

determine whether the demographic bucket exists in a household based on the independent binary model; and

determine the number of members in the household associated with the demographic bucket based on a demographic distribution associated with the second set of data.

10. The apparatus as defined in claim 9 , wherein the independent binary model is a machine learning algorithm generated based on at least one of a household size, an age, a gender, a person status, an income, an education, or an ethnicity.

11. The apparatus as defined in claim 10 , wherein the machine learning algorithm is at least one of a classification and regression tree, a log it function, a conditional inference tree, a random forest, a neural network, or a bootstrap aggregate decision tree.

12. The apparatus as defined in claim 8 , wherein the first set of impression data from the first data source has a fourth set of data missing from the first set of impression data, further including a demographic predictor to linearly scale the first set of impression data to accommodate for the missing fourth set of data.

13. An apparatus comprising:

a demographic corrector to:

identify a first set of impression data received from a computer at a first data source, the first set of impression data different from a second set of data from a second data source, the computer producing a misattribution error in the first set of impression data, the misattribution error based on a demographic data error in the first set of impression data, the demographic data error based on a difference between reported demographic data in the first set of impression data and actual demographic data corresponding to the first set of impression data;

generate a third set of data based on the second set of data from the second data source;

generate a model based on a difference between the first set of impression data and the third set of data; and

correct the demographic data error in the first set of impression data by applying the model to the first set of impression data to generate corrected demographic data; and

a viewership assigner to correct the misattribution error produced by the computer by assigning viewership to an impression associated with the first set of impression data using the corrected demographic data, the viewership assigner is to assign viewership to the impression by:

identifying viewing history associated with the second set of data;

determining a first time associated with a first demographic viewing a media presentation in a first household associated with the second set of data;

determining a second time associated with the first demographic and a second demographic viewing the media presentation in the household;

determining a first probability that the first demographic viewed the media presentation by dividing the first time by the second time;

identifying a first person in the first household associated with the second set of data having a second probability similar to the first probability; and

imputing a viewing history of the first person to a second person in a second household associated with the first set of impression data, at least one of the demographic corrector or the viewership assigner is a logic circuit.

14. The apparatus as defined in claim 13 , wherein to identify the first person in the first household associated with the second set of data having the second probability similar to the first probability, the viewership assigner is to:

identify a third person in the first household associated with the second set of data;

rank the first and third person based on a first highest probability;

identify a fourth person in the second household associated with the first set of impression data;

rank the second and fourth person based on a second highest probability; and

identify the first person has the second probability similar to the first probability when the first person has the first highest probability and the second person has the second highest probability.

15. A tangible computer readable storage medium comprising instructions that, when executed, cause a machine to at least:

identify a first set of impression data received from a computer at a first data source, the first set of impression data having matched demographic data from users registered with both an over-the-top (OTT) device and a database proprietor, the first set of impression data different from a second set of data from a second data source, the computer producing a misattribution error in the first set of impression data, the misattribution error based on a demographic data error in the first set of impression data, the demographic data error based on a difference between reported demographic data in the first set of impression data and actual demographic data corresponding to the first set of impression data;

generate a third set of data based on the second set of data from the second data source;

generate an independent binary model based on a difference between the first set of impression data and the third set of data;

correct the demographic data error in the first set of impression data by applying the independent binary model to the first set of impression data to generate corrected demographic data; and

correct the misattribution error produced by the computer by assigning viewership to an impression associated with the first set of impression data using the corrected demographic data.

16. The tangible computer readable storage medium as defined in claim 15 , wherein the instructions, when executed, further cause the machine to: identify a demographic bucket; determine whether the demographic bucket exists in a household based on the independent binary model; and determine the number of members in the household associated with the demographic bucket based on a demographic distribution associated with the second set of data.

17. The tangible computer readable storage medium as defined in claim 16 , wherein the independent binary model is a machine learning algorithm generated based on at least one of a household size, an age, a gender, a person status, an income, an education, or an ethnicity.

18. The tangible computer readable storage medium as defined in claim 15 , wherein the first set of impression data from the first data source has a fourth set of data missing from the first set of impression data, the instructions, when executed, to further cause the machine to linearly scale the first set of impression data to accommodate for the missing fourth set of data.

19. A tangible computer readable storage medium comprising instructions that, when executed, cause a machine to at least:

identify a first set of impression data received from a computer at a first data source, the first set of impression data different from a second set of data from a second data source, the computer producing a misattribution error in the first set of impression data, the misattribution error based on a demographic data error in the first set of impression data, the demographic data error based on a difference between reported demographic data in the first set of impression data and actual demographic data corresponding to the first set of impression data;

generate a third set of data based on the second set of data from the second data source;

generate an independent binary model based on a difference between the first set of impression data and the third set of data;

correct the demographic data error in the first set of impression data by applying the independent binary model to the first set of impression data to generate corrected demographic data;

correct the misattribution error produced by the computer by assigning viewership to an impression associated with the first set of impression data using the corrected demographic data;

identify viewing history associated with the second set of data;

determine a first time associated with a first demographic viewing a media presentation in a first household associated with the second set of data;

determine a second time associated with the first demographic and a second demographic viewing the media presentation in the household;

determine a first probability that the first demographic viewed the media presentation by dividing the first time by the second time;

identify a first person in the first household associated with the second set of data having a second probability similar to the first probability; and

impute a viewing history of the first person to a second person in a second household associated with the first set of impression data.

20. The tangible computer readable storage medium as defined in claim 19 , wherein the instructions, when executed, further cause the machine to: identify a third person in the first household associated with the second set of data;

rank the first and third person based on a first highest probability; identify a fourth person in the second household associated with the first set of impression data; rank the second and fourth person based on a second highest probability; and

identify the first person has the second probability similar to the first probability when the first person has the first highest probability and the second person has the second highest probability.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 29, 2016
From: RAO, KUMAR NAGARAJA; YILDIZ, KAMER TOKER; HASKELL, JENNIFER; ION, CRISTINA; ZHANG, MIMI
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 040450/0682 →