IP Library Granted Patent US 11,336,964
Granted Patent B2
US 11,336,964 · App. 16/835,213 · Granted May 17, 2022

Method and system for presenting additional content at a media system

Inventor: Donald F. Gordon (Morgan Hills, CA)
Assignee: Roku, Inc.
H04N21/4722H04N21/23418H04N21/23892H04N21/254H04N21/278H04N21/4402H04N21/44008H04N21/44213H04N21/6581H04N21/812H04N21/8133H04N21/8358
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,336,964
App. No.
16/835,213
Granted
May 17, 2022
Kind
B2
Abstract

A media system, receives a received sequence of media content, for presentation at the media system and generates a comparison fingerprint of the received sequence of media content. The comparison fingerprint is for comparison with a plurality of reference fingerprints so as to identify the received sequence of media content. The media system sends a request for identification of additional content to a server system. The request is based at least in part on the comparison fingerprint. The media system receives a response to the request, including information enabling additional content to be selected for display at the media system based at least in part on the identification of the received sequence of media content, and presents a displayed sequence of media content that includes at least a portion of the received sequence of media content and at least a portion of the additional content.

Claims (40)

1. A method comprising:

receiving, by a computing system, first comparison fingerprint data representing a sequence of media content being received and presented by a client device;

comparing, by the computing system, the first comparison fingerprint data with a plurality of sets of reference fingerprint data;

based on the comparing, the computing system detecting respective matches between the first comparison fingerprint data and multiple ones of the plurality of sets of reference fingerprint data, wherein each of the multiple sets of reference fingerprint data correspond to different sequences of reference media content;

responsive to detecting the respective matches, the computing system sending, to the client device, multiple sets of additional reference fingerprints, each set of the multiple sets of additional reference fingerprints corresponding to a respective one of the different sequences of reference media content; and

receiving, from the client device, an indication of a result of a comparison, performed by the client device, between second comparison fingerprint data representing the sequence of media content being received by the client device and one or more of the multiple sets of additional reference fingerprints.

2. The method of claim 1 , wherein the multiple sets of additional reference fingerprint data corresponding to different sequences of reference media content include reference fingerprint data corresponding to: (i) a first sequence of reference media content that, matches the sequence of media content being presented by the client device and (ii) a second sequence of reference media content that does not match the sequence of media content being presented by the client device.

3. The method of claim 2 , wherein the received indication comprises data indicating that the second comparison fingerprint representing the sequence of media content being presented by the client device matches a given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content, the method further comprising:

based on the received indication, the computing system identifying the sequence of media content being presented by the client device as the first sequence of reference media content.

4. The method of claim 3 , wherein the received indication comprises data indicating that, the second comparison fingerprint matches only the given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content and that the second comparison fingerprint data does not match another of the received multiple sets of additional fingerprint data corresponding to any other sequence of the different sequences of reference media content.

5. The method of claim 3 , further comprising, subsequent to the computing system identifying the sequence of media content being presented by the client device as the first sequence of reference media content, the computing system sending, to the client device, additional reference fingerprint data corresponding to the first sequence of reference media content so as to identify whether a second sequence of media content that is received and presented by the client device is a continuation of the first sequence of reference media content.

6. The method of claim 3 , further comprising, responsive to identifying the sequence of media content being presented by the client device, the computing system sending, to the client device, second media content for replacing or supplementing first media content of the sequence of media content.

7. The method of claim 6 , wherein:

(i) the first media content comprises a generic advertisement, and the second media content comprises a targeted advertisement for display in place of the generic advertisement; or

(ii) the second media content comprises supplemental content for display overlaying the first media content.

8. The method of claim 7 , wherein the supplemental content comprises interactive supplemental content.

9. A non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations comprising:

receiving first comparison fingerprint data representing a sequence of media content being received and presented by a client device;

comparing the first comparison fingerprint data with a plurality of sets of reference fingerprint data;

based on the comparing, detecting respective matches between the first comparison fingerprint data and multiple ones of the plurality of sets of reference fingerprint data, wherein each of the multiple sets of reference fingerprint data correspond to different sequences of reference media content;

responsive to detecting the respective matches, sending, to the client device, multiple sets of additional reference fingerprints, each set of the multiple sets of additional reference fingerprints corresponding to a respective one of the different sequences of reference media content; and

receiving, from the client device, an indication of a result of a comparison, performed by the client device, between second comparison fingerprint data representing the sequence of media content being received by the client device and one or more of the multiple sets of additional reference fingerprints.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the multiple sets of additional reference fingerprint data corresponding to different sequences of reference media content include reference fingerprint data corresponding to: (i) a first sequence of reference media content that matches the sequence of media content being presented by the client device and (ii) a second sequence of reference media content that does not match the sequence of media content being presented by the client device.

11. The non-transitory computer-readable storage medium of claim 10 , wherein the received indication comprises data indicating that the second comparison fingerprint representing the sequence of media content being presented by the client device matches a given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content, the operations further comprising:

based on the received indication, identifying the sequence of media content being presented by the client device as the first sequence of reference media content.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the received indication comprises data indicating that the second comparison fingerprint matches only the given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content and that the second comparison fingerprint data does not match another of the received multiple sets of additional fingerprint data corresponding to any other sequence of the different sequences of reference media content.

13. The non-transitory computer-readable storage medium of claim 11 , the operations further comprising, subsequent to identifying the sequence of media content being presented by the client device as the first sequence of reference media content, sending, to the client device, additional reference fingerprint data corresponding to the first sequence of reference media content so as to identify whether a second sequence of media content that is received and presented by the client device is a continuation of the first sequence of reference media content.

14. The non-transitory computer-readable storage medium of claim 11 , the operations further comprising, responsive to identifying the sequence of media content being presented by the client device, sending, to the client device, second media content for replacing or supplementing first media content of the sequence of media content.

15. A computing system comprising one or more processors and a non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by the one or more processors, cause the computing system to perform operations comprising:

receiving first comparison fingerprint data representing a sequence of media content being received and presented by a client device;

comparing the first comparison fingerprint data with a plurality of sets of reference fingerprint data;

based on the comparing, detecting respective matches between the first comparison fingerprint data and multiple ones of the plurality of sets of reference fingerprint data, wherein each of the multiple sets of reference fingerprint data correspond to different sequences of reference media content;

responsive to detecting the respective matches, sending, to the client device, multiple sets of additional reference fingerprints, each set of the multiple sets of additional reference fingerprints corresponding to a respective one of the different sequences of reference media content; and

receiving, from the client device, an indication of a result of a comparison, performed by the client device, between second comparison fingerprint data representing the sequence of media content being received by the client device and one or more of the multiple sets of additional reference fingerprints.

16. The computing system of claim 15 , wherein the multiple sets of additional reference fingerprint data corresponding to different sequences of reference media content include reference fingerprint data corresponding to: (i) a first sequence of reference media content that matches the sequence of media content being presented by the client device and (ii) a second sequence of reference media content that does not match the sequence of media content being presented by the client device.

17. The computing system of claim 16 , wherein the received indication comprises data indicating that the second comparison fingerprint representing the sequence of media content being presented by the client device matches a given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content, the operations further comprising:

based on the received indication, identifying the sequence of media content being presented by the client device as the first sequence of reference media content.

18. The computing system of claim 17 , wherein the received indication comprises data indicating that the second comparison fingerprint matches only the given one of the received multiple sets of additional fingerprint data corresponding to the first sequence of reference media content and that the second comparison fingerprint data does not, match another of the received multiple sets of additional fingerprint data corresponding to any other sequence of the different sequences of reference media content.

19. The computing system of claim 17 , the operations further comprising, subsequent to identifying the sequence of media content being presented by the client device as the first sequence of reference media content, sending, to the client device, additional reference fingerprint data corresponding to the first sequence of reference media content so as to identify whether a second sequence of media content that is received and presented by the client device is a continuation of the first sequence of reference media content.

20. The computing system of claim 17 , the operations further comprising, responsive to identifying the sequence of media content being presented by the client device, sending, to the client device, second media content for replacing or supplementing first media content of the sequence of media content.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2020
From: BULLDOG UNITED LLC
To: GRACENOTE, INC.
Reel/Frame 052534/0841 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2020
From: GORDON, DONALD F.
To: BULLDOG UNITED LLC
Reel/Frame 052534/0512 →
Continuity (6)
Continuation 16017926 · Jun 25, 2018
Continuation 15375698 · Dec 12, 2016
Continuation 14475971 · Sep 3, 2014
Continuation 13286138 · Oct 31, 2011
Provisional Application 61409018 · Nov 1, 2010
Related Publication 20200228874A1 · Jul 16, 2020