IP Library Granted Patent US 9,813,781
Granted Patent B2
US 9,813,781 · App. 15/081,738 · Granted Nov 7, 2017

Media content matching and indexing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,813,781
App. No.
15/081,738
Granted
Nov 7, 2017
Kind
B2
Abstract

A method, system, or device determine when media content is to be displayed. The method can include receiving media content on a broadcast channel from a content feed. The method can also include receiving an identifier for upcoming media content from an automatic content recognition (ACR) system in response to a trigger event. The method can include receiving overlay content from an overlay content server. The method can include storing the overlay content at a memory device. The method can include determining a time that the media content is to be displayed using the identifier.

Claims (53)

1. A device comprising:

a processing device to execute a content manager, the processing device comprising:

a first network connection to an television having a first automatic content recognition (ACR) system, wherein the television is to receive live media content from a content source device over a second network connection between the content source device and the television;

a third network connection to a content feed;

a second automatic content recognition (ACR) system to:

receive a copy of the live media content from the content feed via the third network connection;

fingerprint the copy of the live media content to obtain a first fingerprint;

match the first fingerprint with a second fingerprint stored at a reference database to identify overlay content associated with the second fingerprint;

receive a third fingerprint from the first ACR system;

match the first fingerprint with the third fingerprint to identify a broadcast channel for the live media content, wherein the processing device is to match of the first fingerprint with the second fingerprint and match the first fingerprint with the third fingerprint at least partially concurrently; and

send a fourth fingerprint to the television, wherein the fourth fingerprint is an identifier of an anchor point for the broadcast channel, wherein the anchor point is a point in time where the live media content is displayed plus a latency window, and wherein the anchor point indicates of a point in time to superimpose the overlay content onto the live media content.

2. The device of claim 1 , wherein the processing device is further perform the store of the first fingerprint and the match of the first fingerprint with the second fingerprint in parallel.

3. The device of claim 1 , wherein the live media content is live broadcast content from the content feed of a content provider.

4. The device of claim 1 , wherein the first network connection is a wireless local area network (WLAN) connection.

5. The device of claim 4 , wherein the television is a smart television, the smart television comprising:

a second processing device operable to:

connect access online interactive media or on-demand streaming media using radio frequency (RF) circuitry;

execute an operating system (OS); and

execute one or more applications; and

the RF circuitry comprising an antenna configured to transmit data on the first network connection.

6. The device of claim 1 , wherein the second fingerprint is a reference fingerprint of media content that was previously fingerprinted.

7. A device comprising:

computer-readable storage medium storing instructions;

at least one processing device to execute the instructions to:

receive live media content from a content feed;

fingerprint the live media content to obtain a first fingerprint;

send the first fingerprint to an automatic content recognition (ACR) system to identify a broadcast channel of the live media content;

receive, from the ACR system, a second fingerprint for a portion of the live media content for the broadcast channel;

determine the portion of the live media content to be displayed on the device using the second fingerprint;

identify first overlay content to superimpose onto the live media content, wherein the processing device is to identify the first overlay content and determine the portion of the live media content to be displayed at least partially concurrently; and

send a notification to an electronic device indicating an anchor point to superimpose the first overlay content onto the live media content, wherein the anchor point is a point in time where the live media content is displayed plus a latency window.

8. The device of claim 7 , wherein the second fingerprint is a fingerprint in a series of fingerprints for the portion of the live media content to be displayed on the electronic device at the anchor point.

9. The device of claim 7 , wherein the processing device is further to:

identify a second overlay content to superimpose onto the live media content, wherein the second overlay content matches a greater number of overlay parameters than the first overlay content; and

send the notification to a mobile device to request that the mobile device superimpose the second overlay content onto the live media content at the anchor point.

10. The device of claim 9 , wherein the second overlay content to display on the mobile device is a coupon, a website link, or content associated with the first overlay content.

11. The device of claim 7 , wherein the instructions further comprise requesting a third fingerprint for media content when the live media content to be displayed changes to new media content.

12. A non-transitory machine-readable storage medium having instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

receiving live media content on a broadcast channel from a content feed;

receiving an identifier for upcoming live media content from an automatic content recognition (ACR) system in response to a trigger event;

receiving overlay content from an overlay content server; and

determining a time to superimpose overlay content onto the live media content using the identifier, wherein the time that the overlay content is to be superimposed is a point in time where the live media content is displayed plus a latency window.

13. The non-transitory machine-readable storage medium of claim 12 , wherein the operations further comprise superimposing the overlay content onto the live media content at the time the media content is to be displayed plus the latency window.

14. The non-transitory machine-readable storage medium of claim 12 , wherein the trigger event indicates upcoming live media content to be displayed on an electronic device after a period of time has expired.

15. The non-transitory machine-readable storage medium of claim 12 , wherein the trigger event comprises:

a change in the broadcast channel on an electronic device for the live media content; or

a tagged fingerprint matching a fingerprint for the live media content.

16. The non-transitory machine-readable storage medium of claim 12 , wherein the operations of determining when to superimpose overlay content onto the live media content further comprises:

receiving schedule data associated with a fingerprint for the live media content; and

determining that the live media content is to be displayed at a future point in time using the schedule data.

17. The non-transitory machine-readable storage medium of claim 12 , wherein the upcoming live media content is media content a television is scheduled to display.

18. The non-transitory machine-readable storage medium of claim 17 , wherein the operations further comprise buffering the overlay content at a memory device until the television displays the overlay content.

19. The device of claim 1 , wherein the live media content is media content that is not prerecorded.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048355/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2016
From: ASHBACHER, ANDREW
To: SORENSON MEDIA, INC.
Reel/Frame 038124/0152 →