IP Library Granted Patent US 11,062,233
Granted Patent B2
US 11,062,233 · App. 16/231,171 · Granted Jul 13, 2021

Methods and apparatus to analyze performance of watermark encoding devices

Inventors: John T. Livoti (Clearwater, FL); Susan Cimino (Odessa, FL); Stanley Wellington Woodruff (Palm Harbor, FL); Rajakumar Madhanganesh (Tampa, FL); Alok Garg (Tampa, FL)
Assignee: THE NIELSEN COMPANY (US), LLC
G06N20/00G06F11/0748G06F11/0754G06F11/0766
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,062,233
App. No.
16/231,171
Granted
Jul 13, 2021
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture are disclosed that provide an apparatus to monitor watermark encoder operation, the apparatus comprising: a data collector to collect one or more types of heartbeat data from a watermark encoder, the heartbeat data including time varying data, the one or more types of the heartbeat data defined by a software development kit (SDK); a machine learning engine to process the heartbeat data to predict whether the watermark encoder is associated with respective ones of a plurality of failure modes; and an alert generator to, in response to the machine learning engine predicting the watermark encoder is associated with a first one of the failure modes: generate an alert indicating the at least one of the one or more components to be remedied according to the first one of the failure modes; and transmit the alert to a watermark encoder management agent.

Claims (41)

1. An apparatus to monitor watermark encoder operation, the apparatus comprising:

a data collector to collect, via a network, one or more types of heartbeat data from a watermark encoder, the heartbeat data including time varying data and fixed data, the time varying data characterizing an operational status of one or more components of the watermark encoder, the fixed data corresponding to characteristics of the watermark encoder that do not vary over time, the one or more types of the heartbeat data defined by a software development kit (SDK);

a machine learning engine to process the heartbeat data to predict whether the watermark encoder is associated with respective ones of a plurality of failure modes; and

an alert generator to, in response to (A) the machine learning engine predicting the watermark encoder is associated with a first one of the failure modes, the first one of the failure modes associated with the operational status of at least one of the one or more components and in response to (B) at least one of the fixed data or the time varying data satisfying a threshold value based on at least one of (1) historical data associated with an operation of at least one of the watermark encoder or another watermark encoder of a model type corresponding to the watermark encoder or (2) reference data obtained from an original equipment manufacturer specifying operational characteristics of the model of the watermark encoder:

generate an alert indicating at least one of (a) a type of the first one of the failure modes and (b) the at least one of the one or more components to be remedied according to the first one of the failure modes; and

transmit the alert to a watermark encoder management agent.

2. The apparatus of claim 1 , wherein the watermark encoder is associated with an audience measurement entity.

3. The apparatus of claim 1 , wherein the machine learning engine is to generate a set of probabilities associated with the one or more components of the watermark encoder, the set of probabilities based on the heartbeat data collected by the data collector and one or more trained parameters of the machine learning engine.

4. The apparatus of claim 3 , wherein the set of probabilities associated with the one or more components includes a first probability representing a likelihood that a first one of the one or more components is operating outside of a manufacturer defined specification for the first one of the one or more components.

5. The apparatus of claim 3 , wherein the threshold value is a first threshold value and the alert generator is to, in response to at least one of the set of probabilities satisfying a second threshold value based on the one or more trained parameters of the machine learning engine, generate the alert indicating at least one of (a) the type of the first one of the failure modes and (b) the at least one of the one or more components to be remedied according to the first one of the failure modes.

6. The apparatus of claim 1 , further including:

a failure mode comparator to compare the time varying data to at least one of the historical data or the reference data; and

a report generator to track the time varying data over time.

7. The apparatus of claim 1 , wherein the historical data includes one or more of: Pareto chart data, past heartbeat data, or past failure modes.

8. A non-transitory computer readable storage device comprising instructions that, when executed, cause a machine to at least:

collect, via a network, one or more types of heartbeat data from a watermark encoder, the heartbeat data including time varying data and fixed data, the time varying data characterizing an operational status of one or more components of the watermark encoder, the fixed data corresponding to characteristics of the watermark encoder that do not vary over time, the one or more types of the heartbeat data defined by a software development kit (SDK);

process the heartbeat data to predict whether the watermark encoder is associated with respective ones of a plurality of failure modes; and

in response to (A) predicting the watermark encoder is associated with a first one of the failure modes, the first one of the failure modes associated with the operational status of at least one of the one or more components and in response to (B) at least one of the fixed data or the time varying data satisfying a threshold value based on at least one of (1) historical data associated with an operation of at least one of the watermark encoder or another watermark encoder of a model type corresponding to the watermark encoder or (2) reference data obtained from an original equipment manufacturer specifying operational characteristics of the model of the watermark encoder:

generate an alert indicating at least one of (a) a type of the first one of the failure modes and (b) the at least one of the one or more components to be remedied according to the first one of the failure modes; and

transmit the alert to a watermark encoder management agent.

9. The non-transitory computer readable storage device of claim 8 , wherein the watermark encoder is associated with an audience measurement entity.

10. The non-transitory computer readable storage device of claim 8 , wherein the instructions, when executed, cause the machine to generate a set of probabilities associated with the one or more components of the watermark encoder, the set of probabilities based on collected heartbeat data and one or more trained parameters of a machine learning model.

11. The non-transitory computer readable storage device of claim 10 , wherein the set of probabilities associated with the one or more components includes a first probability representing a likelihood that a first one of the one or more components is operating outside of a manufacturer defined specification for the first one of the one or more components.

12. The non-transitory computer readable storage device of claim 10 , wherein the threshold value is a first threshold value and the instructions, when executed, cause the machine to, in response to at least one of the set of probabilities satisfying a second threshold value based on the one or more trained parameters of the machine learning model, generate the alert indicating at least one of (a) the type of the first one of the failure modes and (b) the at least one of the one or more components to be remedied according to the first one of the failure modes.

13. The non-transitory computer readable storage device of claim 8 , wherein the instructions, when executed, cause the machine to:

compare the time varying data to at least one of the historical data or the reference data; and

track the time varying data over time.

14. The non-transitory computer readable storage device of claim 8 , wherein the historical data includes one or more of: Pareto chart data, past heartbeat data, or past failure modes.

15. A method comprising:

collecting, via a network, one or more types of heartbeat data from a watermark encoder, the heartbeat data including time varying data and fixed data, the time varying data characterizing an operational status of one or more components of the watermark encoder, the fixed data corresponding to characteristics of the watermark encoder that do not vary over time, the one or more types of the heartbeat data defined by a software development kit (SDK);

processing the heartbeat data to predict whether the watermark encoder is associated with respective ones of a plurality of failure modes; and

in response to (A) predicting the watermark encoder is associated with a first one of the failure modes, the first one of the failure modes associated with the operational status of at least one of the one or more components and in response to (B) at least one of the fixed data or the time varying data satisfying a threshold value based on at least one of (1) historical data associated with an operation of at least one of the watermark encoder or another watermark encoder of a model type corresponding to the watermark encoder or (2) reference data obtained from an original equipment manufacturer specifying operational characteristics of the model of the watermark encoder:

generating an alert indicating at least one of (a) a type of the first one of the failure modes and (b) the at least one of the one or more components to be remedied according to the first one of the failure modes; and

transmitting the alert to a watermark encoder management agent.

16. The method of claim 15 , wherein the watermark encoder is associated with an audience measurement entity.

17. The method of claim 15 , further including generating a set of probabilities associated with the one or more components of the watermark encoder, the set of probabilities based on collected heartbeat data and one or more trained parameters of a machine learning model.

18. The method of claim 17 , wherein the set of probabilities associated with the one or more components includes a first probability representing a likelihood that a first one of the one or more components is operating outside of a manufacturer defined specification for the first one of the one or more components.

19. The method of claim 17 , wherein the threshold value is a first threshold value and further including, in response to at least one of the set of probabilities satisfying a second threshold value based on the one or more trained parameters of the machine learning model, generating the alert indicating at least one of (a) the type of the first one of the failure modes and (b) the at least one of the one or more components to be remedied according to the first one of the failure modes.

20. The method of claim 15 , further including:

comparing the time varying data to at least one of the historical data or the reference data; and

tracking the time varying data over time.

Assignments (8)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2020
From: CIMINO, SUSAN; LIVOTI, JOHN T.; MADHANGANESH, RAJAKUMAR; WOODRUFF, STANLEY WELLINGTON; GARG, ALOK
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 052134/0371 →
Continuity (1)
Related Publication 20200201735A1 · Jun 25, 2020