IP Library Granted Patent US 11,140,449
Granted Patent B2
US 11,140,449 · App. 16/805,361 · Granted Oct 5, 2021

Methods and apparatus to determine synthetic respondent level data

Inventors: Jonathan Sullivan (Hurricane, UT); Michael D. Morgan (Bartlett, IL); Balachander Shankar (Tampa, FL); Edward Murphy (North Stonington, CT); Michael Sheppard (Holland, MI); Frank Downing (Orchard Park, NY)
Assignee: The Nielsen Company (US), LLC
H04N21/4667G06Q30/02G06Q30/0201G06Q30/0202G06Q30/0206H04N21/239H04N21/25883H04N21/25891H04N21/44222H04N21/6156H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,140,449
App. No.
16/805,361
Granted
Oct 5, 2021
Kind
B2
Abstract

Methods, apparatus, systems, and articles of manufacture are disclosed to generate synthetic respondent level data. An example apparatus includes: a comparator to compare a target rating to a computed rating to determine a comparison result, the computed rating determined based on a seed panel, the seed panel including monitored panelists associated with return path data; a seed panelist data adjuster to adjust the seed panel based on the comparison result to reduce an error between the target rating and the computed rating; and a household data adjuster to add tuning without viewing data to households of the adjusted seed panel, the tuning without viewing data for a first one of the households to represent monitored data corresponding to a media presentation device of the first one of the households being on while a media output device in communication with the media presentation device is off.

Claims (78)

1. An apparatus comprising:

a comparator to compare a target rating to a computed rating to determine a comparison result, the computed rating determined based on a seed panel, the seed panel including monitored panelists associated with return path data;

a seed panelist data adjuster to adjust the seed panel based on the comparison result to reduce an error between the target rating and the computed rating; and

a household data adjuster to add tuning without viewing data to households of the adjusted seed panel, the tuning without viewing data for a first one of the households to represent monitored data corresponding to a media presentation device of the first one of the households being on while a media output device in communication with the media presentation device is off.

2. The apparatus of claim 1 , wherein the household data adjuster is to generate the tuning without viewing data by, when the tuning without viewing data is below a threshold:

selecting a first household of a first panelist in the adjusted seed panel that (i) affects a relative error between when viewing of the first household is modified and when the viewing of the first household is not modified and (ii) affects the relative error less than a second household, and the first household included in synthetic respondent level-data; and

removing the first household from the synthetic respondent level-data to increase the tuning without viewing data.

3. The apparatus of claim 1 , wherein the seed panel data adjuster is to adjust the seed panel by:

selecting a panelist from seed panelists in the seed panel that affects the error between the target rating and the computed rating; and

adjusting a weight for the selected panelist.

4. The apparatus of claim 1 , wherein:

the target rating is determined based on the return path data and corresponds to a first percentage of persons of a first demographic exposed to first media at a first time; and

the computed rating corresponds to a second percentage of seed panelists exposed to the first media at the first time.

5. The apparatus of claim 1 , further including a data assigner to select the monitored panelists to be in the seed panel based on demographics associated with a population associated with the return path data.

6. The apparatus of claim 5 , wherein the data assigner is to select a first group of the monitored panelists to be seed panelists based on a comparison of the monitored panelists and the population associated with the return path data, and further including a weighter to weight the seed panelists based on a universe estimate of media users, the universe estimate including the monitored panelists and the population.

7. The apparatus of claim 1 , further including a seed panelist replicator to at least one of replicate or down-sample seed panelists.

8. The apparatus of claim 1 , wherein the seed panel data adjuster is to adjust the seed panel based on a viewership error corresponding to the seed panel, the viewership error based on a constraint corresponding to the target rating.

9. The apparatus of claim 8 , wherein the seed panelist data adjuster is to adjust the seed panel based on the viewership error corresponding to the seed panel by:

when the viewership error does not satisfy a first threshold:

selecting a first panelist from seed panelists in the seed panel that (i) affects relative error between when viewing of the first panelist is modified and when the viewing of the first panelist is not modified and (ii) affects the relative error less than a second panelist; and

removing the first panelist from an audience corresponding to the target rating; and

when the viewership error does not satisfy a second threshold different than the first threshold:

selecting a third panelist from the seed panelists in the seed panel that (i) affects the relative error between when viewing of the second panelist is modified and when viewing of the second panelist is not modified and (ii) affects the relative error less than a fourth panelist; and

adding the first panelist from the audience corresponding to the target rating.

10. An apparatus comprising:

memory including computer readable instructions; and

a processor to execute the instructions to at least:

compare a target rating to a computed rating to determine a comparison result, the computed rating determined based on a seed panel, the seed panel including monitored panelists associated with return path data;

adjust the seed panel based on the comparison result to reduce an error between the target rating and the computed rating; and

add tuning without viewing data to households of the adjusted seed panel, the tuning without viewing data for a first one of the households to represent monitored data corresponding to a media presentation device of the first one of the households being on while a media output device in communication with the media presentation device is off.

11. The apparatus of claim 10 , wherein the processor to generate the tuning without viewing data by, when the tuning without viewing data is below a threshold:

selecting a first household of a first panelist in the adjusted seed panel that (i) affects a relative error between when viewing of the first household is modified and when the viewing of the first household is not modified and (ii) affects the relative error less than a second household, and the first household included in synthetic respondent level-data; and

removing the first household from the synthetic respondent level-data to increase the tuning without viewing data.

12. The apparatus of claim 10 , wherein the processor is to adjust the seed panel by:

selecting a panelist from seed panelists in the seed panel that affects the error between the target rating and the computed rating; and

adjusting a weight for the selected panelist.

13. The apparatus of claim 10 , wherein:

the target rating is determined based on the return path data and corresponds to a first percentage of persons of a first demographic exposed to first media at a first time; and

the computed rating corresponds to a second percentage of seed panelists exposed to the first media at the first time.

14. An apparatus comprising:

means for comparing a target rating to a computed rating to determine a comparison result, the computed rating determined based on a seed panel, the seed panel including monitored panelists associated with return path data;

means for adjusting the seed panel based on the comparison result to reduce an error between the target rating and the computed rating; and

means for adding tuning without viewing data to households of the adjusted seed panel, the tuning without viewing data for a first one of the households to represent monitored data corresponding to a media presentation device of the first one of the households being on while a media output device in communication with the media presentation device is off.

15. The apparatus of claim 14 , wherein the adding means is to generate the tuning without viewing data by, when the tuning without viewing data is below a threshold:

selecting a first household of a first panelist in the adjusted seed panel that (i) affects a relative error between when viewing of the first household is modified and when the viewing of the first household is not modified and (ii) affects the relative error less than a second household, and the first household included in synthetic respondent level-data; and

removing the first household from the synthetic respondent level-data to increase the tuning without viewing data.

16. The apparatus of claim 14 , wherein the means for adjusting is to adjust the seed panel by:

selecting a panelist from seed panelists in the seed panel that affects the error between the target rating and the computed rating; and

adjusting a weight for the selected panelist.

17. The apparatus of claim 14 , wherein:

the target rating is determined based on the return path data and corresponds to a first percentage of persons of a first demographic exposed to first media at a first time; and

the computed rating corresponds to a second percentage of seed panelists exposed to the first media at the first time.

18. A tangible computer readable storage medium comprising instructions which, when executed cause one or more processors to at least:

compare a target rating to a computed rating to determine a comparison result, the computed rating determined based on a seed panel, the seed panel including monitored panelists associated with return path data;

adjust the seed panel based on the comparison result to reduce an error between the target rating and the computed rating; and

add tuning without viewing data to households of the adjusted seed panel, the tuning without viewing data for a first one of the households to represent monitored data corresponding to a media presentation device of the first one of the households being on while a media output device in communication with the media presentation device is off.

19. The computer readable storage medium of claim 18 , wherein the instructions cause the one or more processors to generate the tuning without viewing data by, when the tuning without viewing data is below a threshold:

selecting a first household of a first panelist in the adjusted seed panel that (i) affects a relative error between when viewing of the first household is modified and when the viewing of the first household is not modified and (ii) affects the relative error less than a second household, and the first household included in synthetic respondent level-data; and

removing the first household from the synthetic respondent level-data to increase the tuning without viewing data.

20. The computer readable storage medium of claim 18 , wherein the instructions cause the one or more processors to adjust the seed panel by:

selecting a panelist from seed panelists in the seed panel that affects the error between the target rating and the computed rating; and

adjusting a weight for the selected panelist.

21. The computer readable storage medium of claim 18 , wherein:

the target rating is determined based on the return path data and corresponds to a first percentage of persons of a first demographic exposed to first media at a first time; and

the computed rating corresponds to a second percentage of seed panelists exposed to the first media at the first time.

22. The computer readable storage medium of claim 18 , wherein the instructions cause the one or more processors to select the monitored panelists to be in the seed panel based on demographics associated with a population associated with the return path data.

23. The computer readable storage medium of claim 22 , wherein the instructions cause the one or more processors to:

select a first group of the monitored panelists to be seed panelists based on a comparison of the monitored panelists and the population associated with the return path data; and

weight the seed panelists based on a universe estimate of media users, the universe estimate including the monitored panelists and the population.

24. The computer readable storage medium of claim 18 , wherein the instructions cause the one or more processors to at least one of replicate or down-sample seed panelists.

25. The computer readable storage medium of claim 18 , wherein the instructions cause the one or more processors to adjust the seed panel based on a viewership error corresponding to the seed panel, the viewership error based on a constraint corresponding to the target rating.

26. The computer readable storage medium of claim 25 , wherein the instructions cause the one or more processors to adjust the seed panel based on the viewership error corresponding to the seed panel by:

when the viewership error does not satisfy a first threshold:

selecting a first panelist from seed panelists in the seed panel that (i) affects relative error between when viewing of the first panelist is modified and when the viewing of the first panelist is not modified and (ii) affects the relative error less than a second panelist; and

removing the first panelist from an audience corresponding to the target rating; and

when the viewership error does not satisfy a second threshold different than the first threshold:

selecting a third panelist from the seed panelists in the seed panel that (i) affects the relative error between when viewing of the second panelist is modified and when viewing of the second panelist is not modified and (ii) affects the relative error less than a fourth panelist; and

adding the first panelist from the audience corresponding to the target rating.

Assignments (8)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2020
From: SULLIVAN, JONATHAN; MORGAN, MICHAEL D.; SHANKAR, BALACHANDER; MURPHY, EDWARD; SHEPPARD, MICHAEL; DOWNING, FRANK
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 052025/0297 →
Continuity (2)
Continuation 15445557 · Feb 28, 2017
Related Publication 20200204863A1 · Jun 25, 2020
Cited By (2)
US 12,271,925 US 12,499,468