IP Library Granted Patent US 11,348,126
Granted Patent B2
US 11,348,126 · App. 16/230,680 · Granted May 31, 2022

Methods and apparatus for campaign mapping for total audience measurement

Inventors: Jonathan Sullivan (Hurricane, UT); Logan Thomas (Sunnyvale, CA); Neung Soo Ha (Bethesda, MD); Luis Enrique Ordoñez (Mexico City, MX); Roger Guevara (Mexico City, MX)
Assignee: The Nielsen Company (US), LLC
G06Q30/0201G06F16/1748G06F16/48G06N20/00H04N21/25883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,348,126
App. No.
16/230,680
Granted
May 31, 2022
Kind
B2
Abstract

Example methods and apparatus disclosed herein include campaign mapping for total audience measurement. An example apparatus includes a machine learning engine to predict sets of estimated duplication factors that represent duplicated media exposure across different possible combinations of media platforms for respective ones of a plurality of reference media campaigns, apply an input set of total exposure metrics associated with respective individual ones of the media platforms for a query media campaign to predict a first set of estimated duplication factors for the different possible combinations of media platforms for the query media campaign; identify a first one of the set of reference media campaigns to represent the query media campaign; and estimate a second set of estimated duplication factors for the query media campaign based on the set of estimated duplication factors for the first one of the set of reference media campaigns and the input set of total exposure metrics for the query media campaign.

Claims (52)

1. An apparatus comprising:

memory; and

a machine learning engine to:

predict sets of estimated duplication factors that represent duplicated media exposure across different possible combinations of media platforms for respective ones of a plurality of reference media campaigns, the sets of estimated duplication factors corresponding to estimated measures of overlap of media exposure across the different possible combinations of the media platforms for the respective ones of the reference media campaigns, the machine learning engine trained to predict the sets of estimated duplication factors for the respective ones of the reference media campaigns from sets of total exposure metrics obtained for the respective ones of the reference media campaigns, the sets of total exposure metrics to represent media exposure associated with individual ones of the media platforms for the respective ones of the reference media campaigns, the machine learning engine trained based on the sets of total exposure metrics and sets of actual duplication factors obtained for the respective ones of the reference media campaigns, the sets of actual duplication factors different than the sets of estimated duplication factors, the sets of actual duplication factors corresponding to actual measures of overlap of media exposure across the different possible combinations of the media platforms for the respective ones of the reference media campaigns;

process an input set of total exposure metrics associated with respective individual ones of the media platforms for a query media campaign to predict a first set of estimated duplication factors that represent duplicated media exposure across the different possible combinations of media platforms for the query media campaign, the first set of estimated duplication factors corresponding to estimated measures of overlap of media exposure across the different possible combinations of the media platforms for the query media campaign;

identify a first reference media campaign of the reference media campaigns to represent the query media campaign based on comparisons of the first set of estimated duplication factors predicted for the query media campaign with respective ones of the sets of estimated duplication factors for the respective ones of the reference media campaigns; and

estimate a second set of estimated duplication factors for the query media campaign based on the set of estimated duplication factors for the first reference media campaign and the input set of total exposure metrics for the query media campaign, the second set of estimated duplication factors corresponding to estimated measures of overlap of media exposure across the different possible combinations of the media platforms for the query media campaign.

2. The apparatus of claim 1 , further including a duplication factor calculator to:

transform the sets of total exposure metrics and the sets of actual duplication factors to create a first reference media estimated duplication factor for a first combination of media platforms, the first reference media estimated duplication factor associated with a feature combination for the first combination of media platforms; and

transform the sets of total exposure metrics and the sets of actual duplication factors to create a second reference media estimated duplication factor for a second combination of media platforms, the second reference media estimated duplication factor associated with the feature combination.

3. The apparatus of claim 2 , wherein the feature combination represents at least one of demographics, a media campaign time step, a media platform reach, or a digital duplicated reach, the digital duplicated reach determined based on a combination of desktop reach, mobile reach, and digital reach.

4. The apparatus of claim 2 , further including a media platform engine to:

generate a first decision tree model based on the first reference media estimated duplication factor;

generate a second decision tree model based on the second reference media estimated duplication factor; and

train the first decision tree model and the second decision tree model using K-fold cross validation.

5. The apparatus of claim 2 , further including an embedder engine to transform the query media campaign based on the feature combination associated with the first reference media estimated duplication factor and the second reference media estimated duplication factor to create a query media estimated duplication factor.

6. The apparatus of claim 5 , further including a dimension engine to map the query media estimated duplication factor to the first reference media estimated duplication factor and the second reference media estimated duplication factor utilizing a KD tree, and identify the first reference media campaign based on a Euclidean distance to the query media campaign.

7. The apparatus of claim 6 , further including a max entropy engine to linearly interpolate the first reference media campaign to match a duration of the query media campaign, and combine the input set of total exposure metrics for the query media campaign and deduplication rates for the linearly interpolated reference media campaign to determine a deduplicated audience for the query media campaign.

8. A non-transitory computer readable medium comprising instructions that, when executed, cause a processor of a machine learning engine to at least:

train the machine learning engine to predict sets of estimated duplication factors that represent duplicated media exposure across different possible combinations of media platforms for respective ones of a plurality of reference media campaigns, the sets of estimated duplication factors corresponding to estimated measures of overlap of media exposure across the different possible combinations of the media platforms for the respective ones of the reference media campaigns, the machine learning engine trained to predict the sets of estimated duplication factors for the respective ones of the reference media campaigns from sets of total exposure metrics obtained for the respective ones of the reference media campaigns, the sets of total exposure metrics to represent media exposure associated with individual ones of the media platforms for the respective ones of the reference media campaigns, the machine learning engine trained based on the sets of total exposure metrics and sets of actual duplication factors obtained for the respective ones of the reference media campaigns, the sets of actual duplication factors different than the sets of estimated duplication factors, the sets of actual duplication factors corresponding to actual measures of overlap of media exposure across the different possible combinations of the media platforms for the respective ones of the reference media campaigns;

process an input set of total exposure metrics associated with respective individual ones of the media platforms for a query media campaign to predict a first set of estimated duplication factors that represent duplicated media exposure across the different possible combinations of media platforms for the query media campaign, the first set of estimated duplication factors corresponding to estimated measures of overlap of media exposure across the different possible combinations of the media platforms for the query media campaign;

identify a first reference media campaign of the reference media campaigns to represent the query media campaign based on comparisons of the first set of estimated duplication factors predicted for the query media campaign with respective ones of the sets of estimated duplication factors for the respective ones of the reference media campaigns; and

estimate a second set of estimated duplication factors for the query media campaign based on the set of estimated duplication factors for the first reference media campaign and the input set of total exposure metrics for the query media campaign, the second set of estimated duplication factors corresponding to estimated measures of overlap of media exposure across the different possible combinations of the media platforms for the query media campaign.

9. The non-transitory computer readable medium of claim 8 , wherein the instructions further cause the processor of the machine learning engine to:

transform the sets of total exposure metrics and the sets of actual duplication factors to create a first reference media estimated duplication factor for a first combination of media platforms, the first reference media estimated duplication factor associated with a feature combination for the first combination of media platforms; and

transform the sets of total exposure metrics and the sets of actual duplication factors to create a second reference media estimated duplication factor for a second combination of media platforms, the second reference media estimated duplication factor associated with the feature combination.

10. The non-transitory computer readable medium of claim 9 , wherein the feature combination represents at least one of demographics, a media campaign time step, a media platform reach, or a digital duplicated reach, the digital duplicated reach determined based on a combination of desktop reach, mobile reach, and digital reach.

11. The non-transitory computer readable medium of claim 9 , wherein the instructions further cause the processor of the machine learning engine to:

generate a first decision tree model based on the first reference media estimated duplication factor;

generate a second decision tree model based on the second reference media estimated duplication factor; and

train the first decision tree model and the second decision tree model using K-fold cross validation.

12. The non-transitory computer readable medium of claim 9 , wherein the instructions further cause the processor of the machine learning engine to transform the query media campaign based on the feature combination associated with the first reference media estimated duplication factor and the second reference media estimated duplication factor to create a query media estimated duplication factor.

13. The non-transitory computer readable medium of claim 12 , wherein the instructions further cause the processor of the machine learning engine to map the query media estimated duplication factor to the first reference media estimated duplication factor and the second reference media estimated duplication factor utilizing a KD tree, and identify the first reference media campaign based on a Euclidean distance to the query media campaign.

14. The non-transitory computer readable medium of claim 13 , wherein the instructions further cause the processor of the machine learning engine to linearly interpolate the first reference media campaign to match a duration of the query media campaign, and combine the input set of total exposure metrics for the query media campaign and deduplication rates for the linearly interpolated reference media campaign to determine a deduplicated audience for the query media campaign.

15. A method comprising:

training, by executing an instruction with a processor, a machine learning engine to predict sets of estimated duplication factors that represent duplicated media exposure across different possible combinations of media platforms for respective ones of a plurality of reference media campaigns, the sets of estimated duplication factors corresponding to estimated measures of overlap of media exposure across the different possible combinations of the media platforms for the respective ones of the reference media campaigns, the machine learning engine trained to predict the sets of estimated duplication factors for the respective ones of the reference media campaigns from sets of total exposure metrics obtained for the respective ones of the reference media campaigns, the sets of total exposure metrics to represent media exposure associated with individual ones of the media platforms for the respective ones of the reference media campaigns, the machine learning engine trained based on the sets of total exposure metrics and sets of actual duplication factors obtained for the respective ones of the reference media campaigns, the sets of actual duplication factors different than the sets of estimated duplication factors, the sets of actual duplication factors corresponding to actual measures of overlap of media exposure across the different possible combinations of the media platforms for the respective ones of the reference media campaigns;

processing, with the machine learning engine, an input set of total exposure metrics associated with respective individual ones of the media platforms for a query media campaign to predict a first set of estimated duplication factors that represent duplicated media exposure across the different possible combinations of media platforms for the query media campaign, the first set of estimated duplication factors corresponding to estimated measures of overlap of media exposure across the different possible combinations of the media platforms for the query media campaign;

identifying, with the machine learning engine, a first reference media campaign of the reference media campaigns to represent the query media campaign based on comparisons of the first set of estimated duplication factors predicted for the query media campaign with respective ones of the sets of estimated duplication factors for the respective ones of the reference media campaigns; and

estimating, with the machine learning engine, a second set of estimated duplication factors for the query media campaign based on the set of estimated duplication factors for the first reference media campaign and the input set of total exposure metrics for the query media campaign, the second set of estimated duplication factors corresponding to estimated measures of overlap of media exposure across the different possible combinations of the media platforms for the query media campaign.

16. The method of claim 15 , wherein the training of the machine learning engine includes:

transforming the sets of total exposure metrics and the sets of actual duplication factors to create a first reference media estimated duplication factor for a first combination of media platforms, the first reference media estimated duplication factor associated with a feature combination for the first combination of media platforms; and

transforming the sets of total exposure metrics and the sets of actual duplication factors to create a second reference media estimated duplication factor for a second combination of media platforms, the second reference media estimated duplication factor associated with the feature combination.

17. The method of claim 16 , further including:

generating a first decision tree model based on the first reference media estimated duplication factor;

generating a second decision tree model based on the second reference media estimated duplication factor; and

training the first decision tree model and the second decision tree model using K-fold cross validation.

18. The method of claim 16 , further including:

transforming the query media campaign based on the feature combination associated with the first reference media estimated duplication factor and the second reference media estimated duplication factor to create a query media estimated duplication factor.

19. The method of claim 18 , further including mapping the query media estimated duplication factor to the first reference media estimated duplication factor and the second reference media estimated duplication factor utilizing a KD tree, and identify the first reference media campaign based on a Euclidean distance to the query media campaign.

20. The method of claim 19 , wherein the estimating of the second set of estimated duplication factors for the query media campaign includes linearly interpolating the first reference media campaign to match a duration of the query media campaign, and further including combining the input set of total exposure metrics for the query media campaign and deduplication rates for the linearly interpolated reference media campaign to determine a deduplicated audience for the query media campaign.

21. The method of claim 16 , wherein the feature combination represents at least one of demographics, a media campaign time step, a media platform reach, or a digital duplicated reach, the digital duplicated reach determined based on a combination of desktop reach, mobile reach, and digital reach.

22. The apparatus of claim 1 , wherein the reference media campaigns correspond to campaigns for which the overlap of the media exposure across the different possible combinations of the media platforms is known, and the query media campaign corresponds to a campaign for which the overlap of the media exposure across the different possible combinations of the media platforms is unknown.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2021
From: SULLIVAN, JONATHAN; THOMAS, LOGAN; HA, NEUNG SOO; ORDOÑEZ, LUIS ENRIQUE; GUEVARA, ROGER
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 058318/0567 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
Continuity (2)
Provisional Application 62617505 · Jan 15, 2018
Related Publication 20190220873A1 · Jul 18, 2019
Cited By (2)
US 12,301,902 US 12,316,811