IP Library Granted Patent US 10,827,234
Granted Patent B2
US 10,827,234 · App. 16/217,980 · Granted Nov 3, 2020

Media content matching and indexing

Inventor: Andrew Ashbacher (Draper, UT)
Assignee: The Nielsen Company (US), LLC
H04N21/84G06F16/783G06F40/134H04N21/2187H04N21/234H04N21/262H04N21/44004H04N21/44008H04N21/4622H04N21/4882H04N21/64707H04N21/6582H04N21/812H04N21/8166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,827,234
App. No.
16/217,980
Granted
Nov 3, 2020
Kind
B2
Abstract

A method, system, or device determine when media content is to be displayed. The method can include receiving media content on a broadcast channel from a content feed. The method can also include receiving an identifier for upcoming media content from an automatic content recognition (ACR) system in response to a trigger event. The method can include receiving overlay content from an overlay content server. The method can include storing the overlay content at a memory device. The method can include determining a time that the media content is to be displayed using the identifier.

Claims (52)

1. An automatic content recognition (ACR) system comprising:

data processing hardware; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving live media content from a content feed of a broadcaster; and

receiving a fingerprint identifier of a stored fingerprint satisfying a query fingerprint of the live media content, the fingerprint identifier identifying:

a broadcast channel associated with the stored fingerprint; and

an anchor time point for the broadcast channel corresponding to a time where:

the live media content is displayed plus a latency time period; and

overlay content is to be superimposed onto the live media content; and

causing superimposing of the overlay content over the live media content at the anchor time point.

2. The ACR system of claim 1 , wherein the operations further comprise receiving an ACR event.

3. The ACR system of claim 2 , wherein the ACR event comprises at least one of the following:

an indication of advertisements within the content feed;

an indication of selected or flagged content within the content feed; or

an indication of a channel change.

4. The ACR system of claim 1 , wherein the operations further comprise:

receiving more than one ACR event, each ACR event comprising event data and a data format;

normalizing the data format of each received ACR event into a common data format; and

storing the normalized data format of each received ACR event.

5. The ACR system of claim 4 , wherein the operations further comprise filtering the event data.

6. The ACR system of claim 5 , wherein the operations further comprise generating a report, the report comprising at least one ACR event or at least one received fingerprint identifier.

7. The ACR system of claim 1 , wherein the operations further comprise sending a notification to a mobile device to request that the mobile device display the overlay content onto the live media content at the anchor point.

8. The ACR system of claim 1 , wherein the overlay content comprises a coupon, a website link, or additional content.

9. The ACR system of claim 1 , wherein the operations further comprise:

determining whether the live media content changed after generating the query fingerprint; and

when the live media content changed after generating the query fingerprint, generating a new query fingerprint corresponding to the changed live media content for sending to a server.

10. The ACR system of claim 1 , wherein the operations further comprise buffering the overlay content in the memory hardware.

11. A method comprising:

receiving, at data processing hardware, live media content from a content feed of a broadcaster; and

receiving, at the data processing hardware, a fingerprint identifier of a stored fingerprint satisfying a query fingerprint of the live media content, the fingerprint identifier identifying:

a broadcast channel associated with the stored fingerprint; and

an anchor time point for the broadcast channel corresponding to a time where:

the live media content is displayed plus a latency time period; and

overlay content is to be superimposed onto the live media content; and

causing superimposing of the overlay content over the live media content at the anchor time point.

12. The method of claim 11 , further comprising receiving, at the data processing hardware, an ACR event.

13. The method of claim 12 , wherein the ACR event comprises at least one of the following:

an indication of advertisements within the content feed;

an indication of selected or flagged content within the content feed; or

an indication of a channel change.

14. The method of claim 11 , further comprising:

receiving, at the data processing hardware, more than one ACR event, each ACR event comprising event data and a data format;

normalizing, by the data processing hardware, the data format of each received ACR event into a common data format; and

storing, by the data processing hardware, the normalized data format of each received ACR event.

15. The method of claim 14 , further comprising filtering, by the data processing hardware, the event data.

16. The method of claim 15 , further comprising generating, by the data processing hardware, a report, the report comprising at least one ACR event or at least one received fingerprint identifier.

17. The method of claim 11 , further comprising sending, by the data processing hardware, a notification to a mobile device to request that the mobile device display the overlay content onto the live media content at the anchor point.

18. The method of claim 11 , wherein the overlay content comprises a coupon, a website link, or additional content.

19. The method of claim 11 , further comprising:

determining, by the data processing hardware, whether the live media content changed after generating the query fingerprint; and

when the live media content changed after generating the query fingerprint, generating, by the data processing hardware, a new query fingerprint corresponding to the changed live media content for sending to a server.

20. The method of claim 11 , further comprising buffering, by the data processing hardware, the overlay content in the memory hardware.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2020
From: ASHBACHER, ANDREW
To: SORENSON MEDIA, INC.
Reel/Frame 054129/0975 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048355/0949 →