IP Library Granted Patent US 11,445,258
Granted Patent B2
US 11,445,258 · App. 16/835,215 · Granted Sep 13, 2022

Method and system for presenting additional content at a media system

Inventor: Donald F. Gordon (Morgan Hills, CA)
Assignee: Roku, Inc.
H04N21/4722H04N21/23418H04N21/23892H04N21/254H04N21/278H04N21/4402H04N21/44008H04N21/44213H04N21/6581H04N21/812H04N21/8133H04N21/8358
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,445,258
App. No.
16/835,215
Granted
Sep 13, 2022
Kind
B2
Abstract

A media system, receives a received sequence of media content, for presentation at the media system and generates a comparison fingerprint of the received sequence of media content. The comparison fingerprint is for comparison with a plurality of reference fingerprints so as to identify the received sequence of media content. The media system sends a request for identification of additional content to a server system. The request is based at least in part on the comparison fingerprint. The media system receives a response to the request, including information enabling additional content to be selected for display at the media system based at least in part on the identification of the received sequence of media content, and presents a displayed sequence of media content that includes at least a portion of the received sequence of media content and at least a portion of the additional content.

Claims (50)

1. A method comprising:

receiving and presenting, by a client device, a sequence of media content;

generating, by the client device, first comparison fingerprint data representing the sequence of media content for comparison with a plurality of sets of reference fingerprint data;

receiving, by the client device, an indication that the first comparison fingerprint data matches multiple sets of reference fingerprint data of the plurality of sets of reference fingerprint data, wherein each of the multiple sets of reference fingerprint data correspond to different sequences of reference media content, and wherein the received indication comprises multiple sets of additional reference fingerprint data, each set of the multiple sets of additional reference fingerprint data corresponding to a respective one of the different sequences of reference media content;

generating, by the client device, second comparison fingerprint data representing the sequence of media content; and

comparing, by the client device, the generated second comparison fingerprint data with the received multiple sets of additional reference fingerprint data.

2. The method of claim 1 , wherein the multiple sets of additional reference fingerprint data corresponding to different sequences of reference media content include reference fingerprint data corresponding to: (i) a first sequence of reference media content that matches the sequence of media content being presented by the client device and (ii) a second sequence of reference media content that does not match the sequence of media content being presented by the client device.

3. The method of claim 2 , further comprising:

determining, by the client device, that the second comparison fingerprint data matches a given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content; and

based on the determining, the client device identifying the sequence of media content being presented by the client device as the first sequence of reference media content.

4. The method of claim 3 , wherein determining that the second comparison fingerprint data matches the given one of the received multiple sets of additional fingerprint data comprises determining that the second comparison fingerprint data matches only the given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content and that the second comparison fingerprint data does not match another of the received multiple sets of additional fingerprint data corresponding to any other sequence of the different sequences of reference media content.

5. The method of claim 3 , further comprising, subsequent, to the client device identifying the sequence of media content being presented by the client device as the first sequence of reference media content:

receiving and presenting, by the client device, a second sequence of media content;

receiving second additional reference fingerprint data corresponding to the first sequence of reference media content; and

generating third comparison fingerprint data representing the second sequence of media content for comparison with the second additional reference fingerprint data so as to identify whether the second sequence of media content is a continuation of the first sequence of reference media content.

6. The method of claim 1 , further comprising, based on the comparing, the client device sending to a server a request for supplemental media content.

7. The method of claim 6 , wherein the request includes an indication of a result of the comparing.

8. The method of claim 7 , wherein the request includes an indication of a matching one of the multiple sets of additional reference fingerprint data.

9. A non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by one or more processors of a client device, cause the client device to perform operations comprising:

receiving and presenting a sequence of media content;

generating first comparison fingerprint data representing the sequence of media content for comparison with a plurality of sets of reference fingerprint data;

receiving an indication that the first comparison fingerprint data matches multiple sets of reference fingerprint data of the plurality of sets of reference fingerprint data, wherein each of the multiple sets of reference fingerprint data correspond to different sequences of reference media content, and wherein the received indication comprises multiple sets of additional reference fingerprint data, each set of the multiple sets of additional, reference fingerprint data corresponding to a respective one of the different sequences of reference media content;

generating second comparison fingerprint data representing the sequence of media content; and

comparing the generated second comparison fingerprint data with the received multiple sets of additional reference fingerprint data.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the multiple sets of additional reference fingerprint data corresponding to different sequences of reference media content include reference fingerprint data corresponding to: (i) a first sequence of reference media content that matches the sequence of media content being presented by the client device and (ii) a second sequence of reference media content that does not match the sequence of media content being presented by the client device.

11. The non-transitory computer-readable storage medium of claim 10 , the operations further comprising:

determining that the second comparison fingerprint data matches a given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content; and

based on the determining, identifying the sequence of media content being presented by the client device as the first sequence of reference media content.

12. The non-transitory computer-readable storage medium of claim 11 , wherein determining that the second comparison fingerprint data matches the given one of the received multiple sets of additional fingerprint data comprises determining that the second comparison fingerprint data matches only the given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content and that the second comparison fingerprint data does not match another of the received multiple sets of additional fingerprint data corresponding to any other sequence of the different sequences of reference media content.

13. The non-transitory computer-readable storage medium of claim 11 , the operations further comprising, subsequent to the client device identifying the sequence of media content being presented by the client device as the first sequence of reference media content:

receiving and presenting a second sequence of media content;

receiving second additional reference fingerprint data corresponding to the first sequence of reference media content; and

generating third comparison fingerprint data representing the second sequence of media content for comparison with the second additional reference fingerprint data so as to identify whether the second sequence of media content is a continuation of the first sequence of reference media content.

14. The non-transitory computer-readable storage medium of claim 9 , the operations further comprising, based on the comparing, sending to a server a request for supplemental media content, wherein the request includes an indication of a matching one of the multiple sets of additional reference fingerprint data.

15. A client device comprising one or more processors and a non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by the one or more processors, cause the client device to perform operations comprising:

receiving and presenting a sequence of media content;

generating first comparison fingerprint data representing the sequence of media content for comparison with a plurality of sets of reference fingerprint data;

receiving an indication that the first comparison fingerprint data matches multiple sets of reference fingerprint data of the plurality of sets of reference fingerprint data, wherein each of the multiple sets of reference fingerprint data correspond to different sequences of reference media content, and wherein the received indication comprises multiple sets of additional, reference fingerprint data, each set of the multiple sets of additional reference fingerprint data corresponding to a respective one of the different sequences of reference media content;

generating second comparison fingerprint data representing the sequence of media content; and

comparing the generated second comparison fingerprint data with the received multiple sets of additional reference fingerprint data.

16. The client device of claim 15 , wherein the multiple sets of additional reference fingerprint data corresponding to different sequences of reference media content include reference fingerprint data corresponding to: (i) a first sequence of reference media content that matches the sequence of media content being presented by the client device and (ii) a second sequence of reference media content that does not match the sequence of media content being presented by the client device.

17. The client device of claim 16 , the operations further comprising:

determining that the second comparison fingerprint data matches a given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content; and

based on the determining, identifying the sequence of media content being presented by the client device as the first sequence of reference media content.

18. The client device of claim 17 , wherein determining that the second comparison fingerprint data matches the given one of the received multiple sets of additional fingerprint data comprises determining that the second comparison fingerprint data matches only the given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content and that the second comparison fingerprint data does not match another of the received multiple sets of additional fingerprint data corresponding to any other sequence of the different sequences of reference media content.

19. The client device of claim 17 , the operations further comprising, subsequent to the client device identifying the sequence of media content being presented by the client device as the first sequence of reference media content:

receiving and presenting a second sequence of media content;

receiving second additional reference fingerprint data corresponding to the first sequence of reference media content; and

generating third comparison fingerprint data representing the second sequence of media content for comparison with the second additional reference fingerprint data so as to identify whether the second sequence of media content is a continuation of the first sequence of reference media content.

20. The client device of claim 16 , the operations further comprising, based on the comparing, sending to a server a request for supplemental media content, wherein the request includes an indication of a matching one of the multiple sets of additional reference fingerprint data.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2020
From: GORDON, DONALD F.
To: BULLDOG UNITED LLC
Reel/Frame 052534/0560 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2020
From: BULLDOG UNITED LLC
To: GRACENOTE, INC.
Reel/Frame 052534/0860 →
Continuity (6)
Continuation 16017926 · Jun 25, 2018
Continuation 15375698 · Dec 12, 2016
Continuation 14475971 · Sep 3, 2014
Continuation 13286138 · Oct 31, 2011
Provisional Application 61409018 · Nov 1, 2010
Related Publication 20200228875A1 · Jul 16, 2020