IP Library › Granted Patent US 12,206,942
Granted Patent B2
US 12,206,942 · App. 18/320,958 · Granted Jan 21, 2025

Methods and apparatus to estimate population reach from different marginal rating unions

Inventors: Michael Sheppard (Holland, MI); Jonathan Sullivan (Hurricane, UT); Edward Murphy (North Stonington, CT); Michael Morgan (Bartlett, IL); Ludo Daemen (Duffel, BE)
Assignee: The Nielsen Company (US), LLC
H04N21/44224G06Q30/0201H04N21/44222H04N21/252H04N21/25883H04N21/4665
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,206,942
App. No.
18/320,958
Granted
Jan 21, 2025
Kind
B2
Abstract

Example methods, apparatus, systems, and articles of manufacture are disclosed to estimate population reach for different unions based on marginal ratings. An example apparatus includes memory and processor circuitry to determine a population reach estimate of a union of time intervals for which media ratings data is available, the population reach estimate based on a pseudo universe estimate of a population audience corresponding to the union of the time intervals; determine a pseudo universe estimate of a recorded audience corresponding to the union of the time intervals; determine the pseudo universe estimate of the population audience based on the pseudo universe estimate of the recorded audience; and in response to a decision to update the pseudo universe estimate of the population audience to reduce an error of the population reach estimate output the population reach estimate of the union when the error of the population reach estimate satisfies a threshold.

Claims (55)

1. An audience measurement computing system comprising:

at least one processor; and

memory having stored therein instructions that, when executed by the at least one processor, cause the audience measurement computing system to perform a set of operations comprising:

accessing media exposure data for each of multiple distinct unions of marginal ratings data, wherein accessing the media exposure data comprises receiving meter data from a group of meter devices via a network, wherein meter devices of the group of meter devices meter exposure to media at respective media presentation locations;

determining, for each of the multiple distinct unions, a pseudo universe estimate of a recorded audience corresponding to the union based on the media exposure data for the union;

determining, for each of the multiple distinct unions, an initial pseudo universe estimate of a population audience based on the pseudo universe estimate of the recorded audience;

determining, for each of the multiple distinct unions, an initial population reach estimate based on the initial pseudo universe estimate of the population audience corresponding to the union;

making a determination that the initial population reach estimate for a given one of the multiple distinct unions is inconsistent with the initial population reach estimates of one or more others of the multiple distinct unions that are related to the given one; and

in response to making the determination that the initial population reach estimate for the given one of the multiple distinct unions is inconsistent, determining, for each of the multiple distinct unions, an updated pseudo universe estimate of the population audience based on the initial population reach estimate and the media exposure data for the union; and

determining, for each of the multiple distinct unions, an updated population reach estimate based on the updated pseudo universe estimate of the population audience corresponding to the union.

2. The audience measurement computing system of claim 1 , wherein the one or more others of the multiple distinct unions that are related to the given one as children of the given one.

3. The audience measurement computing system of claim 2 , wherein the operations further include making the determination that the initial population reach estimate of the given one of the multiple distinct unions is inconsistent by:

determining a lower bound based on a maximum value of the initial population reach estimates of the children of the given one; and

evaluating that the initial population reach estimate of the given one is below the lower bound.

4. The audience measurement computing system of claim 2 , wherein the operations further include making the determination that the initial population reach estimate of the given one of the multiple distinct unions is inconsistent by:

determining an upper bound based on a sum of the initial population reach estimates of the children of the given one; and

evaluating that the initial population reach estimate of the given one is above the lower bound.

5. The audience measurement computing system of claim 1 , wherein the operations further include making a subsequent determination that the updated population reach estimate for the given one of the multiple distinct unions is not inconsistent with the updated population reach estimates of the one or more others of the multiple distinct unions that are related to the given one.

6. The audience measurement computing system of claim 5 , wherein the operations further include outputting the updated population reach estimates for the multiple distinct unions based on making the subsequent determination.

7. The audience measurement computing system of claim 1 , wherein the operations further include iteratively adjusting the population reach estimates of the multiple distinct unions based on successively determined errors of the iteratively adjusted population reach estimates until the population reach estimates converge to values for which the successively determined errors satisfy error thresholds.

8. A method implemented by a computing system having at least one processor, the method comprising:

accessing media exposure data for each of multiple distinct unions of marginal ratings data, wherein accessing the media exposure data comprises receiving meter data from a group of meter devices via a network, wherein meter devices of the group of meter devices meter exposure to media at respective media presentation locations;

determining, for each of the multiple distinct unions, a pseudo universe estimate of a recorded audience corresponding to the union based on the media exposure data for the union;

determining, for each of the multiple distinct unions, an initial pseudo universe estimate of a population audience based on the pseudo universe estimate of the recorded audience;

determining, for each of the multiple distinct unions, an initial population reach estimate based on the initial pseudo universe estimate of the population audience corresponding to the union;

making a determination that the initial population reach estimate for a given one of the multiple distinct unions is inconsistent with the initial population reach estimates of one or more others of the multiple distinct unions that are related to the given one; and

in response to making the determination that the initial population reach estimate for the given one of the multiple distinct unions is inconsistent, determining, for each of the multiple distinct unions, an updated pseudo universe estimate of the population audience based on the initial population reach estimate and the media exposure data for the union; and

determining, for each of the multiple distinct unions, an updated population reach estimate based on the updated pseudo universe estimate of the population audience corresponding to the union.

9. The method of claim 8 , wherein the one or more others of the multiple distinct unions that are related to the given one as children of the given one.

10. The method of claim 9 , wherein making the determination that the initial population reach estimate of the given one of the multiple distinct unions is inconsistent includes:

determining a lower bound based on a maximum value of the initial population reach estimates of the children of the given one; and

evaluating that the initial population reach estimate of the given one is below the lower bound.

11. The method of claim 9 , wherein making the determination that the initial population reach estimate of the given one of the multiple distinct unions is inconsistent includes:

determining an upper bound based on a sum of the initial population reach estimates of the children of the given one; and

evaluating that the initial population reach estimate of the given one is above the lower bound.

12. The method of claim 8 , further including making a subsequent determination that the updated population reach estimate for the given one of the multiple distinct unions is not inconsistent with the updated population reach estimates of the one or more others of the multiple distinct unions that are related to the given one.

13. The method of claim 12 , further including outputting the updated population reach estimates for the multiple distinct unions based on making the subsequent determination.

14. A non-transitory computer readable medium having stored therein instructions that, when executed by at least one processor of a computing system, cause performance of:

accessing media exposure data for each of multiple distinct unions of marginal ratings data, wherein accessing the media exposure data comprises receiving meter data from a group of meter devices via a network, wherein meter devices of the group of meter devices meter exposure to media at respective media presentation locations;

determining, for each of the multiple distinct unions, a pseudo universe estimate of a recorded audience corresponding to the union based on the media exposure data for the union;

determining, for each of the multiple distinct unions, an initial pseudo universe estimate of a population audience based on the pseudo universe estimate of the recorded audience;

determining, for each of the multiple distinct unions, an initial population reach estimate based on the initial pseudo universe estimate of the population audience corresponding to the union;

making a determination that the initial population reach estimate for a given one of the multiple distinct unions is inconsistent with the initial population reach estimates of one or more others of the multiple distinct unions that are related to the given one; and

in response to making the determination that the initial population reach estimate for the given one of the multiple distinct unions is inconsistent, determining, for each of the multiple distinct unions, an updated pseudo universe estimate of the population audience based on the initial population reach estimate and the media exposure data for the union; and

determining, for each of the multiple distinct unions, an updated population reach estimate based on the updated pseudo universe estimate of the population audience corresponding to the union.

15. The non-transitory computer readable medium of claim 14 , wherein the one or more others of the multiple distinct unions that are related to the given one as children of the given one.

16. The non-transitory computer readable medium of claim 15 , wherein making the determination that the initial population reach estimate of the given one of the multiple distinct unions is inconsistent includes:

determining a lower bound based on a maximum value of the initial population reach estimates of the children of the given one; and

evaluating that the initial population reach estimate of the given one is below the lower bound.

17. The non-transitory computer readable medium of claim 15 , wherein making the determination that the initial population reach estimate of the given one of the multiple distinct unions is inconsistent includes:

determining an upper bound based on a sum of the initial population reach estimates of the children of the given one; and

evaluating that the initial population reach estimate of the given one is above the lower bound.

18. The non-transitory computer readable medium of claim 14 , wherein the instructions further cause, when executed by the at least one processor, performance of making a subsequent determination that the updated population reach estimate for the given one of the multiple distinct unions is not inconsistent with the updated population reach estimates of the one or more others of the multiple distinct unions that are related to the given one.

19. The non-transitory computer readable medium of claim 18 , further including outputting the updated population reach estimates for the multiple distinct unions based on making the subsequent determination.

20. The non-transitory computer readable medium of claim 14 , wherein the instructions further cause, when executed by the at least one processor, performance of iteratively adjusting the population reach estimates of the multiple distinct unions based on successively determined errors of the iteratively adjusted population reach estimates until the population reach estimates converge to values for which the successively determined errors satisfy error thresholds.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2023
From: SHEPPARD, MICHAEL; SULLIVAN, JONATHAN; MURPHY, EDWARD; MORGAN, MICHAEL D.; DAEMEN, LUDO
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 063853/0734 →
Continuity (4)
Continuation 17734792 · May 2, 2022
Continuation 16893129 · Jun 4, 2020
Continuation 15445530 · Feb 28, 2017
Related Publication 20240031648A1 · Jan 25, 2024
References Cited (42)
US 8214518B1 · Bertz · 2012 [cited by applicant]
US 8327396B2 · Ramaswamy · 2012 [cited by examiner]
US 8370489B2 · Mazumdar · 2013 [cited by examiner]
US 10045082B2 · Nagaraja Rao et al. · 2018 [cited by applicant]
US 10380633B2 · Morovati et al. · 2019 [cited by applicant]
US 10382818B2 · Sheppard et al. · 2019 [cited by applicant]
US 10958956B2 · Ricci · 2021 [cited by applicant]
US 11012746B2 · Nagaraja Rao · 2021 [cited by examiner]
US 11039190B1 · Dailey et al. · 2021 [cited by applicant]
US 11481802B2 · Sheppard et al. · 2022 [cited by applicant]
US 20110015992A1 · Liffiton et al. · 2011 [cited by applicant]
US 20120254922A1 · Rangarajan et al. · 2012 [cited by applicant]
US 20160027037A1 · Cai · 2016 [cited by examiner]
US 20160232538A1 · Papakostas et al. · 2016 [cited by applicant]
US 20170034593A1 · Ray · 2017 [cited by examiner]
US 20170053306A1 · Sissenich et al. · 2017 [cited by applicant]
US 20180315060A1 · Sheppard et al. · 2018 [cited by applicant]
US 20200145720A1 · Krauss et al. · 2020 [cited by applicant]
US 20210084370A1 · Doe · 2021 [cited by applicant]
US 20210248629A1 · Sullivan et al. · 2021 [cited by applicant]
US 20210303552A1 · Pandey et al. · 2021 [cited by applicant]
US 20220036390A1 · Sheppard et al. · 2022 [cited by applicant]
US 20220264179A1 · Sheppard et al. · 2022 [cited by applicant]
US 20230042879A1 · Sheppard et al. · 2023 [cited by applicant]
US 20230070980A1 · Sullivan et al. · 2023 [cited by applicant]
US 20230111617A1 · Sheppard et al. · 2023 [cited by applicant]
WO 2020190650A1 · 2020 [cited by applicant]
Araujo et al. Characterizing videos, audience and advertising in Youtube channels for kids, arXiv:1707.00971v1 [cs.CY], Jul. 4, 2017, 11 pages. [cited by applicant]
Buzzard, The Definition of the Audience in the History of Television Audience Research, University Microfilms International, 1985, 483 pages. [cited by applicant]
Esch et al., Appendix 8 Numerical Methods for Solving Nonlinear Equations, Asset and Risk Management: Risk Oriented Finance, published 2005 by John Wiley & Sons Ltd., 7 pages. [cited by applicant]
International Searching Authority, International Search Report & Written issued Opinion, in connection with application No. PCT/US2021/026010, on Jul. 26, 2021, 8 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 17/892,659, on Oct. 18, 2023, 26 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued Oct. 8, 2021 in connection with U.S. Appl. No. 17/008,263, 19 pages. [cited by applicant]
United States Patent and Trademark Office, “Restriction Requirement,” issued in connection with U.S. Appl. No. 17/892,659, on Mar. 22, 2024, 6 pages. [cited by applicant]
United States Patent and Trademark Office, Advisory Action, issued in connection with U.S. Appl. No. 17/408,208, on Mar. 3, 2023, 2 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action, issued in connection with U.S. Appl. No. 17/408,208, on Apr. 20, 2022, 26 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action, issued in connection with U.S. Appl. No. 17/408,164, dated Dec. 8, 2023, 17 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action, issued in connection with U.S. Appl. No. 16/843,650, mailed on Apr. 10, 2023, 40 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action, issued in connection with U.S. Appl. No. 16/676,158, on Mar. 18, 2022, 29 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action, issued in connection with U.S. Appl. No. 17/099,510, on Mar. 29, 2022, 6 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action, issued in connection with U.S. Appl. No. 17/408,208, dated May 10, 2023, 9 Pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action, issued in connection with U.S. Appl. No. 17/408,164, dated Mar. 29, 2023, 14 pages. [cited by applicant]