IP Library Granted Patent US 11,234,029
Granted Patent B2
US 11,234,029 · App. 15/679,862 · Granted Jan 25, 2022

Methods and apparatus to generate reference signatures from streaming media

Inventors: Adam Schenker (Tampa, FL); Nigel Smith (Richardson, TX); Shailendra Paranjape (Tampa, FL); Vinay Chauhan (Sunnyvale, CA)
Assignee: The Nielsen Company (US), LLC
H04N21/2402H04N21/2401H04N21/26603H04N21/439H04N21/44222H04N21/6582
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,234,029
App. No.
15/679,862
Granted
Jan 25, 2022
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture are disclosed to generate reference signatures from streaming media through the collection of metadata, generation of audio signatures, and association of the metadata with the generated audio signatures. The disclosure consists of a media monitor that collects metadata and generates audio signatures at a household and a central processing facility that generates reference signatures therefrom.

Claims (58)

1. A media monitor apparatus comprising:

a memory;

a processor configured to execute instructions to implement:

an event metadata extractor to extract event metadata indicating a plurality of media playback events from a web page via a document object model based on event metadata of-interest, the web page accessed at a media device, the media device to present media via the web page;

a media metadata extractor to collect media metadata including identifying information from the web page via the document object model based on media metadata of interest and the plurality of media playback events;

an audio signature generator to generate an audio signature from audio associated with media presented by the media device; and

a timestamper to:

initiate a first timer to indicate a first time period to log timestamps;

during the first time period, associate a first timestamp with the audio signature, a second timestamp with the media metadata, and a plurality of third timestamps with the event metadata;

in response to the first timer expiring, initiate a second timer, the second timer set to indicate a second time period to delay transmitting a log file; and

a log file reporter to, in response to the second timer expiring, transmit the audio signature, the media metadata, the event metadata, and the first, second, and the plurality of third timestamps in a log file to a validator;

the validator to validate the audio signature based on the event metadata and the plurality of third timestamps and, in response to validating the audio signature, create a reference signature based on the audio signature and the media metadata.

2. The media monitor apparatus of claim 1 , wherein the media metadata extractor is to extract the media metadata from a web page via an HTTP header.

3. The media monitor apparatus of claim 1 , wherein the media metadata includes at least one of a title, an episode name, a season name, a media source, a media provider, a media length, a play duration, a browser type, an audio language, a trailer title, a subtitle, a uniform resource locator (URL), date and time, a process name and ID, or a current time.

4. The media monitor apparatus of claim 1 , wherein the plurality of media playback events include at least one of a play event, a paused event, an end condition, a seek feature, an aborted condition, an emptied condition, or an unloaded condition.

5. The media monitor apparatus of claim 1 , wherein to transmit the audio signature, the media metadata, the event metadata, and the first and second timestamps, the log file reporter is to include the audio signature, the media metadata, the event metadata, and the first and second timestamps as elements of the log file and to transmit the log file via a network to a central facility.

6. A non-transitory computer readable storage medium comprising instructions which, when executed, cause a machine to at least:

extract event metadata indicating a plurality of media playback events from a web page via a document object model based on event metadata of interest, the web page accessed at a media device, the media device to present media via the web page;

collect media metadata including identifying information from the web page via the document object model based on media metadata of interest and the plurality of media playback events;

generate an audio signature from audio associated with media presented by the media device;

initiate a first timer to indicate a first time period to log timestamps;

during the first time period, associate a first timestamp with the audio signature, a second timestamp with the media metadata, and a plurality of third timestamps with the event metadata;

in response to the first timer expiring, initiate a second timer, the second timer set to indicate a second time period to delay transmitting a log file;

in response to the second timer expiring, transmit the audio signature, the media metadata, the event metadata, and the first, second, and the plurality of third timestamps in a log file; and

validate the audio signature based on the event metadata and the plurality of third timestamps and, in response to validating the audio signature, create a reference signature based on the audio signature and the media metadata.

7. The non-transitory computer readable storage medium of claim 6 , further including extracting the media metadata from a web page via an HTTP header.

8. The non-transitory computer readable storage medium of claim 6 , wherein the media metadata includes at least one of a title, an episode name, a season name, a media source, a media provider, a media length, a play duration, a browser type, an audio language, a trailer title, a subtitle, a uniform resource locator (URL), date and time, a process name and ID, or a current time.

9. The non-transitory computer readable storage medium of claim 6 , wherein the plurality of media playback events include at least one of a play event, a paused event, an end condition, a seek feature, an aborted condition, an emptied condition, or an unloaded condition.

10. The non-transitory computer readable storage medium of claim 6 , wherein to transmit the audio signature, the media metadata, the event metadata, and the first and second timestamps, the non-transitory computer readable storage medium is to include the audio signature, the media metadata, the event metadata, and the first and second timestamps as elements of the log file and to transmit the log file via a network to a central facility.

11. A method comprising:

extracting event metadata indicating a plurality of media playback events from a web page via a document object model based on event metadata of interest, the web page accessed at a media device, the media device to present media via the web page;

collecting media metadata including identifying information from the web page via the document object model based on media metadata of interest and the plurality of media playback events;

generating an audio signature from audio associated with media presented by the media device;

initiating a first timer to indicate a first time period to log timestamps;

during the first time period, associating a first timestamp with the audio signature, a second timestamp with the media metadata, and a plurality of third timestamps with the event metadata;

in response to the first timer expiring, initiating a second timer, the second timer set to indicate a second time period to delay transmitting a log file;

in response to the second timer expiring, transmitting the audio signature, the media metadata, the event metadata, and the first, second, and the plurality of third timestamps in a log file; and

validating the audio signature based on the event metadata and the plurality of third timestamps and, in response to validating the audio signature, create a reference signature based on the audio signature and the media metadata.

12. The method of claim 11 , further including extracting the media metadata from a web page via an HTTP header.

13. The method of claim 11 , wherein the media metadata includes at least one of a title, an episode name, a season name, a media source, a media provider, a media length, a play duration, a browser type, an audio language, a trailer title, a subtitle, a uniform resource locator (URL), date and time, a process name and ID, or a current time.

14. The method of claim 11 , wherein the plurality of media playback events include at least one of a play event, a paused event, an end condition, a seek feature, an aborted condition, an emptied condition, or an unloaded condition.

15. The method of claim 11 , wherein to transmit the audio signature, the media metadata, the event metadata, and the first and second timestamps, the method includes adding the audio signature, the media metadata, the event metadata, and the first and second timestamps to the log file and transmitting the log file via a network to a central facility.

16. An apparatus comprising:

at least one memory;

instructions in the apparatus; and

processor circuitry to execute the instructions to at least:

extract event metadata indicating a plurality of media playback events from a web page via a document object model based on event metadata of interest, the web page accessed at a media device, the media device to present media via the web page;

collect media metadata including identifying information from the web page via the document object model based on media metadata of interest and the plurality of media playback events;

generate an audio signature from audio associated with media presented by the media device;

initiate a first timer to indicate a first time period to log timestamps;

during the first time period, associate a first timestamp with the audio signature, a second timestamp with the media metadata, and a plurality of third timestamps with the event metadata;

in response to the first timer expiring, initiate a second timer, the second timer set to indicate a second time period to delay transmitting a log file;

in response to the second timer expiring, transmit the audio signature, the media metadata, the event metadata, and the first, second, and the plurality of third timestamps in a log file; and

validate the audio signature based on the event metadata and the plurality of third timestamps and, in response to validating the audio signature, create a reference signature based on the audio signature and the media metadata.

17. The apparatus of claim 16 , wherein the processor circuitry is to extract the media metadata from a web page via an HTTP header.

18. The apparatus of claim 16 , wherein the processor circuitry is to collect media metadata, the media metadata including at least one of a title, an episode name, a season name, a media source, a media provider, a media length, a play duration, a browser type, an audio language, a trailer title, a subtitle, a uniform resource locator (URL), date and time, a process name and ID, or a current time.

19. The apparatus of claim 16 , wherein the processor circuitry is to extract event metadata indicating a plurality of media playback events, the plurality of media playback events including at least one of a play event, a paused event, an end condition, a seek feature, an aborted condition, an emptied condition, or an unloaded condition.

20. The apparatus of claim 16 , wherein the processor circuitry is to transmit the audio signature, the media metadata, the event metadata, and the first and second timestamps, the log file reporter is to include the audio signature, the media metadata, the event metadata, and the first and second timestamps as elements of the log file and to transmit the log file via a network to a central facility.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2018
From: SCHENKER, ADAM; SMITH, NIGEL; PARANJAPE, SHAILENDRA; CHAUHAN, VINAY
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 044587/0277 →
Continuity (1)
Related Publication 20190058907A1 · Feb 21, 2019