IP Library Granted Patent US 11,727,292
Granted Patent B2
US 11,727,292 · App. 16/698,167 · Granted Aug 15, 2023

Media device on/off detection using return path data

Inventors: Michael Grotelueschen (Chicago, IL); Michael Evan Anderson (Chicago, IL); Fatemehossadat Miri (Chicago, IL); Demetrios Fassois (Chicago, IL); Tushar Chandra (Chicago, IL); David J. Kurzynski (South Elgin, IL)
Assignee: THE NIELSEN COMPANY (US), LLC
G06N7/01G06F16/2228G06F16/285G06N5/01G06N20/20G06Q30/0201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,292
App. No.
16/698,167
Granted
Aug 15, 2023
Kind
B2
Abstract

Example methods disclosed herein include accessing common homes data for a group of common homes, the common homes data including return path data and panel meter data. Disclosed example methods also include accessing common homes data for a group of common homes, the common homes data including first return path data and corresponding panel meter data associated with respective ones of the common homes, grouping the common homes data into view segments, classifying the view segments based on whether the return path data in respective ones of the view segments has matching panel meter data to determine labeled view segments, generating features from the labeled view segments, training a machine learning algorithm based on the features, and applying second return path data to the trained machine learning algorithm to determine whether a media device associated with the second return path data is on or off.

Claims (49)

1. A method to perform media device on/off detection using return path data, the method comprising:

accessing common homes data for a group of common homes, the common homes data including first return path data and corresponding panel meter data associated with respective ones of the common homes;

grouping the common homes data into view segments;

classifying the view segments based on whether the return path data in respective ones of the view segments has matching panel meter data to determine labeled view segments;

generating a first set of features from the labeled view segments;

training a machine learning algorithm based on the first set of features, the machine learning algorithm associated with an on/off model;

applying second return path data to the machine learning algorithm trained based on the first set of features to output an on/off determination of whether a media device associated with the second return path data is on or off;

generating a second set of features from the labeled view segments;

training the machine learning algorithm based on the second set of features; and

applying the second return path data to the machine learning algorithm trained based on the second set of features to output an updated on/off determination of whether the media device associated with the second return path data is on or off.

2. The method of claim 1 , wherein the training includes setting a classification probability threshold, the classification probability threshold used by the machine learning algorithm to predict whether a media device would have matching panel meter data, thereby classifying a media associated with the return path data as on.

3. The method of claim 2 , further including adjusting the classification probability threshold based on whether the machine learning algorithm correctly identifies a media device as on or off during the training.

4. The method of claim 1 , wherein the panel meter data is data retrieved by an audience measurement entity from the group of common homes, the panel meter data including media device viewing data.

5. The method of claim 1 , wherein the machine learning algorithm is a random forest classification algorithm.

6. The method of claim 1 , wherein respective ones of the view segments have at least a 15 minute duration.

7. The method of claim 1 , wherein the features generated from the labeled view segments include a view segment index or a view segment duration, the view segment index corresponding to where in a tuning event the view segment occurs.

8. An apparatus to perform media device on/off detection using return path data, comprising:

machine readable instructions; and

processor circuitry to execute the machine readable instructions to:

access common homes data for a group of common homes, the common homes data including first return path data and corresponding panel meter data associated with respective ones of the common homes;

group the common homes data into view segments;

classify the view segments based on whether the return path data in respective ones of the view segments has matching panel meter data to determine labeled view segments;

generate a first set of features from the labeled view segments;

train a machine learning algorithm based on the first set of features;

apply second return path data to the machine learning algorithm trained based on the first set of features to output an on/off determination of whether a media device associated with the second return path data is on or off;

generate a second set of features from the labeled view segments;

train the machine learning algorithm based on the second set of features, the machine learning algorithm associated with an on/off model; and

apply the second return path data to the machine learning algorithm trained based on the second set of features to output an updated on/off determination of whether the media device associated with the second return path data is on or off.

9. The apparatus of claim 8 , wherein the processor circuitry is to set a classification probability threshold, the classification probability threshold used by the machine learning algorithm to predict whether a media device would have matching panel meter data, thereby classifying a media associated with the return path data as on.

10. The apparatus of claim 9 , wherein the processor circuitry is to adjust the classification probability threshold based on whether the machine learning algorithm correctly identifies a media device as on or off during the training.

11. The apparatus of claim 8 , wherein the panel meter data is data retrieved by an audience measurement entity from the common homes, the panel meter data including media device viewing data.

12. The apparatus of claim 8 , wherein the machine learning algorithm is a random forest classification algorithm.

13. The apparatus of claim 8 , wherein the view segments each have at least a 15 minute duration.

14. The apparatus of claim 8 , wherein features generated from the labeled view segments include a view segment index or a view segment duration, the view segment index corresponding to where in a tuning event the view segment occurs.

15. A non-transitory computer readable storage medium comprising computer readable instructions that, when executed, cause one or more processors to, at least:

access common homes data for a group of common homes, the common homes data including first return path data and corresponding panel meter data associated with respective ones of the common homes;

group the common homes data into view segments;

classify the view segments based on whether the return path data in respective ones of the view segments has matching panel meter data to determine labeled view segments;

generate a first set of features from the labeled view segments;

train a machine learning algorithm based on the first set of features;

apply second return path data to the machine learning algorithm trained based on the first set of features to output an on/off determination of whether a media device associated with the second return path data is on or off;

generate a second set of features from the labeled view segments;

train the machine learning algorithm based on the second set of features, the machine learning algorithm associated with an on/off model; and

apply the second return path data to the machine learning algorithm trained based on the second set of features to output an updated on/off determination of whether the media device associated with the second return path data is on or off.

16. The storage medium of claim 15 , wherein the instructions, when executed, further cause the one or more processors to identify a classification probability threshold used by the machine learning algorithm to predict whether a media device would have matching panel meter data, thereby classifying a media associated with the return path data as on.

17. The storage medium of claim 16 , wherein the instructions, when executed, further cause the one or more processors to adjust the classification probability threshold based on whether the algorithm correctly identifies a media device as on or off during the training.

18. The storage medium of claim 15 , wherein the machine learning algorithm is a random forest classification algorithm.

19. The storage medium of claim 15 , wherein the instructions, when executed, further cause the one or more processors to set each of the view segments to at least a 15 minute duration.

20. The storage medium of claim 15 , wherein the instructions, when executed, further cause the one or more processors to generate features from the labeled view segments such that the features include a view segment index or a view segment duration, the view segment index corresponding to where in a tuning event the view segment occurs.

Assignments (9)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2021
From: GROTELUESCHEN, MICHAEL; ANDERSON, MICHAEL; MIRI, FATEMEHOSSADAT; FASSOIS, DEMETRIOS; CHANDRA, TUSHAR; KURZYNSKI, DAVID
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 055135/0975 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2020
From: GROTELUESCHEN, MICHAEL; ANDERSON, MICHAEL; MIRI, FATEMEHOSSADAT; FASSOIS, DEMETRIOS; CHANDRA, TUSHAR; KURZYNSKI, DAVID
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 052375/0923 →