IP Library Granted Patent US 12,229,790
Granted Patent B2
US 12,229,790 · App. 18/051,294 · Granted Feb 18, 2025

Estimation and use of nested merge ratios for audience measurement

Inventors: Michael Sheppard (Holland, MI); Marissa Joseph (Monroe Township, NJ); Susan Kim (Mercer Island, WA); Beate Sissenich (New York, NY)
Assignee: The Nielsen Company (US), LLC
G06Q30/0202G06Q30/0201G06Q30/0203
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,790
App. No.
18/051,294
Granted
Feb 18, 2025
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture (e.g., physical storage media) to estimate and use nested merge ratios (e.g., nested Fréchet ratios) for audience measurement are disclosed herein. Example apparatus disclosed herein are to identify a first merged media event for which a first census audience value is to be determined, the first merged media event based on a union including a second merged media event. Disclosed example apparatus are also to determine whether the first merged media event satisfies a mutual exclusivity condition. Disclosed example apparatus are further to, in response to the first merged media event satisfying the mutual exclusivity condition, estimate the first census audience value for the first merged media event based on at least a merge ratio and a second census audience value previously estimated for the second merged media event.

Claims (51)

1. An audience measurement system comprising a processor and a memory, the audience measurement system configured to perform a set of operations comprising:

receiving, from a plurality of meters via a network, metering data for a plurality of media events;

storing the metering data in a datastore managed by an audience measurement entity;

obtaining, from one or more service providers, return path data for the plurality of media events;

identifying a first merged media event for which a first deduplicated reach value is to be determined, the first merged media event based on a union including a second merged media event;

determining whether the first merged media event satisfies a mutual exclusivity condition;

in response to the first merged media event satisfying the mutual exclusivity condition, estimating the first deduplicated reach value for the first merged media event based on at least a merge ratio and a second deduplicated reach value previously estimated for the second merged media event, wherein the estimating is carried out in a manner that satisfies logical constraints on the first deduplicated reach value, and wherein the logical constraints are derived from a union inequality; and

outputting the first deduplicated reach value.

2. The audience measurement system of claim 1 , wherein the merge ratio is based on a first panel audience value obtained for the first merged media event and a plurality of panel audience values obtained for media events included in the union, the plurality of panel audience values including a second panel audience value obtained for the second merged media event.

3. The audience measurement system of claim 2 , wherein the merge ratio is further based on a universe estimate obtained for a panel associated with the first panel audience value and the plurality of panel audience values.

4. The audience measurement system of claim 3 , wherein the set of operations further comprises:

determining a lower bound and an upper bound for the first panel audience value based on the plurality of panel audience values and the universe estimate; and

determining the merge ratio based on the first panel audience value, the lower bound and the upper bound.

5. The audience measurement system of claim 4 , wherein the set of operations further comprises dividing a first difference between the first panel audience value and the lower bound by a second difference between the upper bound and the lower bound to determine the merge ratio.

6. The audience measurement system of claim 1 , wherein the union further includes a third individual media event, and the set of operations further comprises estimating the first deduplicated reach value for the first merged media event based on at least the merge ratio, the second deduplicated reach value previously estimated for the second merged media event, a third deduplicated reach value obtained for the third individual media event, and a universe estimate obtained for a population associated with the third deduplicated reach value.

7. The audience measurement system of claim 6 , wherein the set of operations further comprises:

determining a lower bound and an upper bound for the first deduplicated reach value based on the second deduplicated reach value previously estimated for the second merged media event, the third deduplicated reach value obtained for the third individual media event, and the universe estimate; and

adding the lower bound to a product of the merge ratio and a difference between the upper bound and the lower bound to estimate the first deduplicated reach value.

8. The audience measurement system of claim 1 , wherein the set of operations further comprises outputting at least one of an instruction or a signal in response to the first merged media event not satisfying the mutual exclusivity condition, the at least one of the instruction or the signal to cause the audience measurement system to at least one of halt or skip audience measurement processing associated with the first merged media event.

9. A non-transitory computer readable medium comprising computer readable instructions that, when executed, cause one or more processors to at least:

receive, from a plurality of meters via a network, metering data for a plurality of media events;

store the metering data in a datastore managed by an audience measurement entity;

obtain, from one or more service providers, return path data for the plurality of media events;

identify a first merged media event for which a first deduplicated reach is to be determined, the first merged media event based on a union including a second merged media event;

determine whether the first merged media event satisfies a mutual exclusivity condition;

in response to the first merged media event satisfying the mutual exclusivity condition, estimate the first deduplicated reach value for the first merged media event based on at least a merge ratio and a second deduplicated reach value previously estimated for the second merged media event, wherein the estimating is carried out in a manner that satisfies logical constraints on the first deduplicated reach value, and wherein the logical constraints are derived from a union inequality; and

output the first deduplicated reach value.

10. The non-transitory computer readable medium of claim 9 , wherein the merge ratio is based on a first panel audience value obtained for the first merged media event and a plurality of panel audience values obtained for media events included in the union, the plurality of panel audience values including a second panel audience value obtained for the second merged media event.

11. The non-transitory computer readable medium of claim 10 , wherein the merge ratio is further based on a universe estimate obtained for a panel associated with the first panel audience value and the plurality of panel audience values.

12. The non-transitory computer readable medium of claim 11 , wherein the instructions are to cause the one or more processors to:

determine a lower bound and an upper bound for the first panel audience value based on the plurality of panel audience values and the universe estimate; and

determine the merge ratio based on the first panel audience value, the lower bound and the upper bound.

13. The non-transitory computer readable medium of claim 12 , wherein the instructions are to cause the one or more processors to divide a first difference between the first panel audience value and the lower bound by a second difference between the upper bound and the lower bound to determine the merge ratio.

14. The non-transitory computer readable medium of claim 9 , wherein the union further includes a third individual media event, and the instructions are to cause the one or more processors to estimate the first deduplicated reach value for the first merged media event based on at least the merge ratio, the second deduplicated reach value previously estimated for the second merged media event, a third deduplicated reach value obtained for the third individual media event, and a universe estimate obtained for a population associated with the third deduplicated reach value.

15. The non-transitory computer readable medium of claim 14 , wherein the instructions are to cause the one or more processors to:

determine a lower bound and an upper bound for the first deduplicated reach value based on the second deduplicated reach value previously estimated for the second merged media event, the third deduplicated reach value obtained for the third individual media event, and the universe estimate; and

add the lower bound to a product of the merge ratio and a difference between the upper bound and the lower bound to estimate the first deduplicated reach value.

16. The non-transitory computer readable medium of claim 9 , wherein the instructions include first instructions that are to cause the one or more processors to output at least one of a second instruction or a signal to an audience measurement system in response to the first merged media event not satisfying the mutual exclusivity condition, the at least one of the second instruction or the signal to cause the audience measurement system to at least one of halt or skip audience measurement processing associated with the first merged media event.

17. A method comprising:

receiving, from a plurality of meters via a network, metering data for a plurality of media events;

storing the metering data in a datastore managed by an audience measurement entity;

obtaining, from one or more service providers, return path data for the plurality of media events;

identifying a first merged media event for which a first deduplicated reach value is to be determined, the first merged media event based on a union including a second merged media event;

determining, by executing an instruction with at least one processor, whether the first merged media event satisfies a mutual exclusivity condition; and

in response to the first merged media event satisfying the mutual exclusivity condition, estimating, by executing an instruction with the at least one processor, the first deduplicated reach value for the first merged media event based on at least a merge ratio and a second deduplicated reach value previously estimated for the second merged media event, wherein the estimating is carried out in a manner that satisfies logical constraints on the first deduplicated reach value, and wherein the logical constraints are derived from a union inequality; and

outputting the first deduplicated reach value.

18. The method of claim 17 , wherein the merge ratio is based on a first panel audience value obtained for the first merged media event and a plurality of panel audience values obtained for media events included in the union, the plurality of panel audience values including a second panel audience value obtained for the second merged media event.

19. The method of claim 18 , wherein the merge ratio is further based on a universe estimate obtained for a panel associated with the first panel audience value and the plurality of panel audience values.

20. The method of claim 19 , further including:

determining a lower bound and an upper bound for the first panel audience value based on the plurality of panel audience values and the universe estimate; and

determining the merge ratio based on the first panel audience value, the lower bound and the upper bound.

Assignments (4)
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2023
From: JOSEPH, MARISSA; KIM, SUSAN; SHEPPARD, MICHAEL; SISSENICH, BEATE
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 062701/0052 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
Continuity (2)
Provisional Application 63292991 · Dec 22, 2021
Related Publication 20230199240A1 · Jun 22, 2023
References Cited (16)
US 8423406B2 · Briggs · 2013 [cited by examiner]
US 9852163B2 · Srivastava · 2017 [cited by examiner]
US 20130145022A1 · Srivastava · 2013 [cited by examiner]
US 20150046579A1 · Perez · 2015 [cited by examiner]
US 20160117397A1 · Bansal · 2016 [cited by examiner]
US 20170034593A1 · Ray · 2017 [cited by examiner]
US 20170053306A1 · Sissenich · 2017 [cited by examiner]
US 20170127110A1 · Chaar · 2017 [cited by examiner]
US 20170155956A1 · Nagaraja Rao · 2017 [cited by examiner]
US 20180137541A1 · Yelton · 2018 [cited by examiner]
US 20190149869A1 · Ray · 2019 [cited by examiner]
US 20220058666A1 · Sheppard et al. · 2022 [cited by applicant]
United States Patent and Trademark Office, Final Office Action, issued in connection with U.S. Appl. No. 17/408,158, dated Nov. 22, 2023, 12 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action, issued in connection with U.S. Appl. No. 17/408,158, dated Jun. 22, 2023, 28 pages. [cited by applicant]
Theodore Hailperin, “Best possible inequalities for the probability of a logical function of events,” The American Mathematical Monthly, vol. 72, No. 4 (Apr. 1965), pp. 343-359, 18 pages, retrieved from 137.149.200.5 on… [cited by applicant]
Wikipedia, “Fréchet inequalities,” retrieved from <https://en.wikipedia.org/w/index.php?title=Fréchet_inequalities&oldid=1100454928> on Oct. 27, 2022, 6 pages. [cited by applicant]