IP Library › Granted Patent US 11,889,155
Granted Patent B2
US 11,889,155 · App. 16/017,900 · Granted Jan 30, 2024

Method and system for presenting additional content at a media system

Inventor: Donald F. Gordon (Morgan Hills, CA)
Assignee: Roku, Inc.
H04N21/4722H04N21/23418H04N21/23892H04N21/254H04N21/278H04N21/4402H04N21/44008H04N21/44213H04N21/6581H04N21/812H04N21/8133H04N21/8358
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,889,155
App. No.
16/017,900
Granted
Jan 30, 2024
Kind
B2
Abstract

A media system, receives a received sequence of media content, for presentation at the media system and generates a comparison fingerprint of the received sequence of media content. The comparison fingerprint is for comparison with a plurality of reference fingerprints so as to identify the received sequence of media content. The media system sends a request for identification of additional content to a server system. The request is based at least in part on the comparison fingerprint. The media system receives a response to the request, including information enabling additional content to be selected for display at the media system based at least in part on the identification of the received sequence of media content, and presents a displayed sequence of media content that includes at least a portion of the received sequence of media content and at least a portion of the additional content.

Claims (44)

1. A method comprising:

receiving, by a server system from a media system, a request for additional media content, wherein the request includes data indicative of a sequence of first media content comprising a weak fingerprint generated based on a subset of blocks of a single frame of the first media content;

determining, by the server system using the data indicative of the sequence of first media content, that a portion of the sequence of first media content is associated with a content selection parameter stored in a database of the server system, wherein the content selection parameter is indicative of a circumstance under which the portion of the sequence of first media content is to be replaced or supplemented with additional media content, wherein the content selection parameter is associated with the portion of the sequence of first media content in the database of the server system based on instructions provided by a content provider of the sequence of first media content;

selecting, by the server system based on the weak fingerprint and the content selection parameter, second media content for display by the media system in place of or overlaying the portion of the sequence of first media content;

generating a strong fingerprint for the first media content based on a larger subset of the blocks of one or more frames of the first media content, relative to the subset of blocks associated with the weak fingerprint;

verifying the selection of the second media content for display by the media system in place of or overlaying the portion of the sequence of first media content based on a determination that the strong fingerprint of the first media content and the weak fingerprint of the first media content match; and

sending, by the server system to the media system, responsive to the verifying the match between the strong fingerprint and the weak fingerprint, a response to the request, wherein the response includes information enabling the media system to display the second media content in place of or overlaying the portion of the sequence of first media content at an insertion point in the first media content while the sequence of first media content continues to advance at the media system, wherein the information comprises data indicative of the insertion point for the second media content such that the media system is enabled to make a determination, based on the data, when to begin displaying the second media content.

2. The method of claim 1 , wherein the second media content comprises a sequence of replacement media content for display in place of the portion of the sequence of first media content.

3. The method of claim 2 , wherein the portion of the sequence of first media content comprises a generic advertisement, and wherein the sequence of replacement media content comprises a targeted advertisement for display by the media system in place of the generic advertisement.

4. The method of claim 1 , wherein the second media content comprises supplemental content for display overlaying the portion of the sequence of first media content.

5. The method of claim 4 , wherein the supplemental content comprises interactive supplemental content.

6. The method of claim 1 , wherein the data indicative of the sequence of first media content comprises a channel identifier and a timestamp.

7. The method of claim 1 , wherein the request includes data indicative of a reference position within the sequence of first media content, and wherein the selecting is further based on the reference position within the sequence of first media content.

8. The method of claim 1 , further comprising obtaining information about an end-user of the media system, wherein the selecting is further based on the information about the end-user of the media system.

9. The method of claim 8 , wherein the content selection parameter comprises a target demographic, and wherein the information about the end-user of the media system comprises demographic information about the end-user of the media system.

10. The method of claim 1 , wherein the request includes data indicative of a technical limitation of the media system, and wherein the selecting is further based on the technical limitation of the media system.

11. The method of claim 1 , wherein the data indicative of the sequence of first media content comprises a fingerprint, and wherein determining the content selection parameter using the data indicative of the sequence of first media content comprises:

determining an identifier of the sequence of first media content using the fingerprint; and

determining the content selection parameter using the identifier of the sequence of first media content.

12. The method of claim 1 , wherein the server system comprises a processing unit and a network communication interface, and wherein sending the response to the media system comprises sending the response to the media system using the network communication interface.

13. The method of claim 1 , wherein the weak fingerprint is generated based on sampling a luminance of a plurality of blocks.

14. The method of claim 1 , wherein the second media content comprises an advertisement, and wherein the method further comprises:

generating a strong fingerprint for the advertisement based on sampling every block of a first frame of the advertisement.

15. A non-transitory computer-readable medium having stored therein instructions that are executable to cause a server system to perform functions comprising:

receiving, from a media system, a request for additional media content, wherein the request includes data indicative of a sequence of first media content comprising a weak fingerprint generated based on a subset of blocks of a single frame of the first media content;

determining, using the data indicative of the sequence of first media content, that a portion of the sequence of first media content is associated with a content selection parameter stored in a database of the server system, wherein the content selection parameter is indicative of a circumstance under which the portion of the sequence of first media content is to be replaced or supplemented with additional media content, wherein the content selection parameter is associated with the portion of the sequence of first media content in the database of the server system based on instructions provided by a content provider of the sequence of first media content;

selecting, based on the weak fingerprint and the content selection parameter, second media content for display by the media system in place of or overlaying the portion of the sequence of first media content;

generating a strong fingerprint for the first media content based on a larger subset of the blocks of one or more frames of the first media content, relative to the subset of blocks associated with the weak fingerprint;

verifying the selection of the second media content for display by the media system in place of or overlaying the portion of the sequence of first media content based on a determination that the strong fingerprint of the first media content and the weak fingerprint of the first media content match; and

sending, to the media system, responsive to the verifying the match between the strong fingerprint and the weak fingerprint, a response to the request, wherein the response includes information enabling the media system to display the second media content in place of or overlaying the portion of the sequence of first media content at an insertion point in the first media content while the sequence of first media content continues to advance at the media system, wherein the information comprises data indicative of the insertion point for the second media content such that the media system is enabled to make a determination, based on the data, when to begin displaying the second media content.

16. The non-transitory computer-readable medium of claim 15 , wherein the second media content comprises a sequence of replacement media content for display in place of the portion of the sequence of first media content.

17. A server system comprising:

a processing unit; and

a computer-readable medium having stored therein instructions that are executable to cause the server system to perform functions comprising:

receiving, from a media system, a request for additional media content, wherein the request includes data indicative of a sequence of first media content comprising a weak fingerprint generated based on a subset of blocks of a single frame of the first media content;

determining, using the data indicative of the sequence of first media content, that a portion of the sequence of first media content is associated with a content selection parameter stored in a database of the server system, wherein the content selection parameter is indicative of a circumstance under which the portion of the sequence of first media content is to be replaced or supplemented with additional media content, wherein the content selection parameter is associated with the portion of the sequence of first media content in the database of the server system based on instructions provided by a content provider of the sequence of first media content;

selecting, based on the weak fingerprint and the content selection parameter, second media content for display by the media system in place of or overlaying the portion of the sequence of first media content;

generating a strong fingerprint for the first media content based on a larger subset of the blocks of one or more frames of the first media content, relative to the subset of blocks associated with the weak fingerprint;

verifying the selection of the second media content for display by the media system in place of or overlaying the portion of the sequence of first media content based on a determination that the strong fingerprint of the first media content and the weak fingerprint of the first media content match; and

sending, to the media system, responsive to the verifying the match between the strong fingerprint and the weak fingerprint, a response to the request, wherein the response includes information enabling the media system to display the second media content in place of or overlaying the portion of the sequence of first media content at an insertion point in the first media content, wherein the information comprises data indicative of the insertion point for the second media content such that the media system is enabled to make a determination, based on the data, when to begin displaying the second media content.

18. The server system of claim 17 , wherein the second media content comprises a sequence of replacement media content for display in place of the portion of the sequence of first media content.

19. The server system of claim 18 , wherein the portion of the sequence of first media content comprises a generic advertisement, and wherein the sequence of replacement media content comprises a targeted advertisement for display by the media system in place of the generic advertisement.

20. The server system of claim 17 , wherein the second media content comprises supplemental content for display overlaying the portion of the sequence of first media content.

21. The server system of claim 17 , wherein the data indicative of the insertion point comprises data indicating a position in the first media content relative to a frame of the sequence of first media content used to generate the data indicative of the sequence of first media content.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2018
From: GORDON, DONALD F.
To: BULLDOG UNITED LLC
Reel/Frame 046197/0251 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2018
From: BULLDOG UNITED LLC
To: GRACENOTE, INC.
Reel/Frame 046197/0257 →