IP Library Granted Patent US 11,743,543
Granted Patent B2
US 11,743,543 · App. 16/670,954 · Granted Aug 29, 2023

Method and system for presenting additional content at a media system

Inventor: Donald F. Gordon (Morgan Hills, CA)
Assignee: Roku, Inc.
H04N21/4722H04N21/23418H04N21/23892H04N21/254H04N21/278H04N21/4402H04N21/44008H04N21/44213H04N21/6581H04N21/812H04N21/8133H04N21/8358
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,743,543
App. No.
16/670,954
Granted
Aug 29, 2023
Kind
B2
Abstract

A media system, receives a received sequence of media content, for presentation at the media system and generates a comparison fingerprint of the received sequence of media content. The comparison fingerprint is for comparison with a plurality of reference fingerprints so as to identify the received sequence of media content. The media system sends a request for identification of additional content to a server system. The request is based at least in part on the comparison fingerprint. The media system receives a response to the request, including information enabling additional content to be selected for display at the media system based at least in part on the identification of the received sequence of media content, and presents a displayed sequence of media content that includes at least a portion of the received sequence of media content and at least a portion of the additional content.

Claims (58)

1. A method for use in connection with a client device and a sequence of media content that includes a first portion followed by a second portion, the method comprising:

receiving, by the client device, from a content distributor, the media content;

while the client device is receiving at least a portion of the media content:

(i) presenting, by the client device, the first portion of the sequence of media content;

(ii) performing, by the client device, a content replacement operation, wherein performing the content replacement operation comprises presenting replacement media content instead of the second portion of the sequence of media content, wherein both the second portion of the sequence of media content and the replacement media content are non-interactive media content, and wherein the second portion of the sequence of media content lacks a link presented therein;

(iii) monitoring, by the client device, the second portion of the sequence of media content to detect an overlay-triggered change in characteristic of the second portion of the sequence of media content; and

(iv) while performing the content replacement operation and responsive to detecting the overlay-triggered change in characteristic of the second portion of the sequence of media content,

performing, by the client device, an overlay operation, wherein performing the overlay operation comprises overlaying supplemental media content on at least a portion of the replacement media content so as to mirror the detected overlay triggered change in characteristic of the second portion of the sequence of media content, in the replacement media content as well.

2. The method of claim 1 , wherein the overlay-triggered characteristics of the second portion of the sequence of media content results from an on-screen programming guide being invoked.

3. The method of claim 1 , further comprising:

receiving an instruction to perform at least one of the content replacement operation or the overlay operation, wherein the client device performs at least one of the content replacement operation or the overlay operation responsive to receiving the instruction.

4. The method of claim 3 , further comprising:

generating, by the client device, fingerprint data representing the first portion of the sequence of media content; and

sending, by the client device, the generated fingerprint data to be used to recognize the first portion of the sequence of media content, and wherein the client device receives the instruction to perform at least one of the content replacement operation or the overlay operation in response to sending the generated fingerprint data.

5. The method of claim 1 , wherein the second portion of the sequence of media content is a portion of a non-targeted advertisement, and wherein at least one of the replacement media content or the supplemental media content is a portion of a targeted advertisement.

6. The method of claim 1 , wherein the supplemental media content comprises interactive supplemental media content.

7. The method of claim 6 , further comprising:

receiving, by the client device, user input representing a user interaction with the interactive supplemental media content; and

responsive to receiving the user input, performing, by the client device, a corresponding action.

8. The method of claim 1 , wherein the overlay-triggered characteristic of the second portion of the sequence of media content results from an Emergency Alert System overlay being invoked.

9. A non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by one or more processors of a client device, cause the client device to perform operations in connection with a sequence of media content that includes a first portion followed by a second portion, the operations comprising:

receiving from a content distributor, the media content;

while receiving at least a portion of the media content:

(i) presenting the first portion of the sequence of media content;

(ii) performing a content replacement operation, wherein performing the content replacement operation comprises presenting replacement media content instead of the second portion of the sequence of media content, wherein both the second portion of the sequence of media content and the replacement media content are non-interactive media content, and wherein the second portion of the sequence of media content lacks a link presented therein; media content; and

(iii) monitoring, by the client device, the second portion of the sequence of media content to detect an overlay-triggered change in characteristic of the second portion of the sequence of media content; and

(iv) while performing the content replacement operation and responsive to detecting the overlay-triggered change in characteristic of the second portion of the sequence of media content, wherein performing the overlay operation comprises overlaying supplemental media content on at least a portion of the replacement media content so as to mirror the detected overlay triggered change in characteristic of the second portion of the sequence of media content, in the replacement media content as well.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the overlay-triggered characteristic of the second portion of the sequence of media content results from an on-screen programming guide being invoked.

11. The non-transitory computer-readable storage medium of claim 9 , the operations further comprising:

receiving an instruction to perform at least one of the content replacement operation or the overlay operation, wherein the client device performs at least one of the content replacement operation or the overlay operation responsive to receiving the instruction.

12. The non-transitory computer-readable storage medium of claim 11 , the operations further comprising:

generating fingerprint data representing the first portion of the sequence of media content; and

sending the generated fingerprint data to be used to recognize the first portion of the sequence of media content, and wherein the client device receives the instruction to perform at least one of the content replacement operation or the overlay operation in response to sending the generated fingerprint data.

13. The non-transitory computer-readable storage medium of claim 9 , wherein the second portion of the sequence of media content is a portion of a non-targeted advertisement, and wherein at least one of the replacement media content or the supplemental media content is a portion of a targeted advertisement.

14. The non-transitory computer-readable storage medium of claim 9 , wherein the supplemental media content comprises interactive supplemental media content.

15. The non-transitory computer-readable storage medium of claim 14 , the operations further comprising:

receiving user input representing a user interaction with the interactive supplemental media content; and

responsive to receiving the user input, performing a corresponding action.

16. The non-transitory computer-readable storage medium of claim 9 , wherein the overlay-triggered characteristic of the second portion of the sequence of media content results from an Emergency Alert System overlay being invoked.

17. A client device comprising one or more processors and a non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by the one or more processors, cause the client device to perform operations in connection with a sequence of media content that includes a first portion followed by a second portion, the operations comprising:

receiving, by the client device, from a content distributor, the media content;

while the client device is receiving at least a portion of the media content:

(i) presenting the first portion of the sequence of media content;

(ii) performing a content replacement operation, wherein performing the content replacement operation comprises presenting replacement media content instead of the second portion of the sequence of media content, wherein both the second portion of the sequence of

(iii) monitoring, by the client device, the second portion of the sequence of media content to detect an overlay-triggered change in characteristic of the second portion of the sequence of media content; and

(iv) while performing the content replacement operation and responsive to detecting the overlay-triggered change in characteristic of the second portion of the sequence of media content, wherein performing the overlay operation comprises overlaying supplemental media content on at least a portion of the replacement media content so as to mirror the detected overlay triggered change in characteristic of the second portion of the sequence of media content, in the replacement media content as well.

18. The client device of claim 17 , wherein the overlay-triggered characteristic of the second portion of the sequence of media content results from an on-screen programming guide being invoked.

19. The client device of claim 17 , the operations further comprising:

receiving an instruction to perform at least one of the content replacement operation or the overlay operation, wherein the client device performs at least one of the content replacement operation or the overlay operation responsive to receiving the instruction.

20. The client device of claim 19 , the operations further comprising:

generating fingerprint data representing the first portion of the sequence of media content; and

sending the generated fingerprint data to be used to recognize the first portion of the sequence of media content, and wherein the client device receives the instruction to perform at least one of the content replacement operation or the overlay operation in response to sending the generated fingerprint data.

21. The client device of claim 17 , wherein the second portion of the sequence of media content is a portion of a non-targeted advertisement, and wherein at least one of the replacement media content or the supplemental media content is a portion of a targeted advertisement.

22. The client device of claim 17 , wherein the supplemental media content comprises interactive supplemental media content.

23. The client device of claim 22 , the operations further comprising:

receiving user input representing a user interaction with the interactive supplemental media content; and

responsive to receiving the user input, performing a corresponding action.

24. The client device of claim 17 , wherein the overlay-triggered characteristic of the second portion of the sequence of media content results from an Emergency Alert System overlay being invoked.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2019
From: GORDON, DONALD F.
To: BULLDOG UNITED LLC
Reel/Frame 050888/0057 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2019
From: BULLDOG UNITED LLC
To: GRACENOTE, INC.
Reel/Frame 050888/0095 →