IP Library Granted Patent US 10,506,291
Granted Patent B2
US 10,506,291 · App. 15/375,698 · Granted Dec 10, 2019

Method and system for presenting additional content at a media system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,506,291
App. No.
15/375,698
Granted
Dec 10, 2019
Kind
B2
Abstract

A media system, receives a received sequence of media content, for presentation at the media system and generates a comparison fingerprint of the received sequence of media content. The comparison fingerprint is for comparison with a plurality of reference fingerprints so as to identify the received sequence of media content. The media system sends a request for identification of additional content to a server system. The request is based at least in part on the comparison fingerprint. The media system receives a response to the request, including information enabling additional content to be selected for display at the media system based at least in part on the identification of the received sequence of media content, and presents a displayed sequence of media content that includes at least a portion of the received sequence of media content and at least a portion of the additional content.

Claims (56)

1. A method comprising:

receiving, by a server and from a client device, a request for replacement media content, wherein the request includes a first comparison fingerprint;

determining, by the server, that a plurality of reference fingerprints from a database match the first comparison fingerprint, wherein the plurality of reference fingerprints are associated with respective items of reference content;

receiving, by the server and from the client device, a second comparison fingerprint;

based on a quantity of the plurality of reference fingerprints that match the first comparison fingerprint being greater than one, comparing, by the server, the second comparison fingerprint to a second plurality of reference fingerprints, wherein the second plurality of reference fingerprints are generated from the respective items of reference content;

identifying, by the server and based on the comparing, a sequence of media content corresponding to the first comparison fingerprint and the second comparison fingerprint, wherein identifying the sequence of media content comprises identifying a reference time within the sequence of media content;

selecting, by the server, a sequence of additional media content for display in place of a portion of the sequence of media content in accordance with predefined criteria; and

providing, by the server to the client device, a response to the request for replacement media content, wherein the response includes information enabling the sequence of additional media content to be displayed in place of the portion of the sequence of media content at the client device at a subsequent time that is defined relative to the reference time.

2. The method of claim 1 , wherein identifying, based on the comparing, the sequence of media content comprises:

determining that the second comparison fingerprint matches a single one of the second plurality of reference fingerprints rather than multiple reference fingerprints of the second plurality of reference fingerprints; and

determining that the single reference fingerprint is associated with the sequence of media content.

3. The method of claim 1 , wherein:

the determining that the plurality of fingerprints from the database match the first comparison fingerprint is based on a determination that the comparison fingerprint represents a frame that has at least a predetermined percentage of pixels that are neither white nor black.

4. The method of claim 1 , further comprising:

based on results of the comparing of the second comparison fingerprint to the second plurality of reference fingerprints:

incrementing a match count for each reference fingerprint of the second plurality of reference fingerprints that matches the second reference fingerprint; and

resetting a match count for each reference fingerprint of the second plurality of reference fingerprints that does not match the second reference fingerprint.

5. The method of claim 1 , wherein the predefined criteria is based at least in part on the reference time within the sequence of media content.

6. The method of claim 1 , wherein the predefined criteria is based at least in part on content selection parameters provided by a third party.

7. The method of claim 6 , wherein the content selection parameters identify a targeted advertisement to be inserted as a substitute for a generic advertisement.

8. The method of claim 1 , wherein the information comprises the sequence of additional media content.

9. The method of claim 1 , wherein the information comprises an identifier of the sequence of additional media content that enables the client device to obtain the sequence of additional media content.

10. A system, comprising:

a network interface to a network;

a database;

one or more processors; and

a memory storing instructions executable by the one or more processors to perform operations comprising:

receiving, from a client device and via the network interface, a request for replacement media content, wherein the request includes a first comparison fingerprint,

determining that a plurality of reference fingerprints from the database match the first comparison fingerprint, wherein the plurality of reference fingerprints are associated with respective items of reference content,

receiving, via the network interface, a second comparison fingerprint,

based on a quantity of the plurality of reference fingerprints that match the first comparison fingerprint being greater than one, comparing the second comparison fingerprint to a second plurality of reference fingerprints, wherein the second plurality of reference fingerprints are generated from the respective items of reference content,

identifying, based on the comparing, a sequence of media content corresponding to the first comparison fingerprint and the second comparison fingerprint, wherein identifying the sequence of media content comprises identifying a reference time within the sequence of media content,

selecting a sequence of additional media content for display in place of a portion of the sequence of media content in accordance with predefined criteria, and

providing, via the network interface, a response to the request for replacement media content, wherein the response includes information enabling the sequence of additional media content to be displayed in place of the portion of the sequence of media content at the client device at a subsequent time that is defined relative to the reference time.

11. The system of claim 10 , wherein identifying, based on the comparing, the sequence of media content comprises:

determining that the second comparison fingerprint matches a single one of the second plurality of reference fingerprints rather than multiple reference fingerprints of the second plurality of reference fingerprints, and

determining that the single reference fingerprint is associated with the sequence of media content.

12. The system of claim 10 , wherein:

the determining that the plurality of fingerprints from the database match the first comparison fingerprint is based on a determination that the comparison fingerprint represents a frame that has at least a predetermined percentage of pixels that are neither white nor black.

13. The system of claim 10 , wherein the operations further comprise:

based on results of the comparing of the second comparison fingerprint to the second plurality of reference fingerprints:

incrementing a match count for each reference fingerprint of the second plurality of reference fingerprints that matches the second reference fingerprint; and

resetting a match count for each reference fingerprint of the second plurality of reference fingerprints that does not match the second reference fingerprint.

14. A non-transitory machine-readable medium having instructions embodied thereon, which when executed by a content replacement system with one or more processors, cause the content replacement system to perform operations comprising:

receiving, from a client device, a request for replacement media content, wherein the request includes a first comparison fingerprint;

determining that a plurality of reference fingerprints from a database match the first comparison fingerprint;

receiving, from the client device, a second comparison fingerprint;

based on a quantity of the plurality of reference fingerprints that match the first comparison fingerprint being greater than one, comparing the second comparison fingerprint to a second plurality of reference fingerprints, wherein the second plurality of reference fingerprints are generated from the respective items of reference content;

identifying, based on the comparing, a sequence of media content corresponding to the first comparison fingerprint and the second comparison fingerprint, wherein identifying the sequence of media content comprises identifying a reference time within the sequence of media content;

selecting a sequence of additional media content for display in place of a portion of the sequence of media content in accordance with predefined criteria; and

providing, to the client device, a response to the request for replacement media content, wherein the response includes information enabling the sequence of additional media content to be displayed in place of the portion of the sequence of media content at the client device at a subsequent time that is defined relative to the reference time.

15. The non-transitory machine-readable medium of claim 14 , wherein identifying, based on the comparing, the sequence of media content comprises:

determining that the second comparison fingerprint matches a single one of the second plurality of reference fingerprints rather than multiple reference fingerprints of the second plurality of reference fingerprints; and

determining that the single reference fingerprint is associated with the sequence of media content.

16. The non-transitory machine-readable medium of claim 14 , wherein:

the determining that the plurality of fingerprints from the database match the first comparison fingerprint is based on a determination that the comparison fingerprint represents a frame that has at least a predetermined percentage of pixels that are neither white nor black.

Assignments (13)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
RELEASE (REEL 042262 / FRAME 0601) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC
Reel/Frame 061748/0001 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Apr 13, 2017
From: GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE DIGITAL VENTURES, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042262/0601 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2016
From: GORDON, DONALD F.
To: BULLDOG UNITED LLC.
Reel/Frame 040709/0382 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2016
From: BULLDOG UNITED LLC
To: GRACENOTE, INC.
Reel/Frame 040709/0431 →