IP Library Granted Patent US 11,450,110
Granted Patent B2
US 11,450,110 · App. 16/994,033 · Granted Sep 20, 2022

Content-modification system with use of multiple fingerprint data types feature

Inventors: Andrew Laurence Ashbacher (Aptos, CA); Steven Michael Cormie (Cambridge, GB); John L. Haynes, III (Sandy, UT); Stefan Matthijs Maris (Brooklyn, NY)
Assignee: Roku, Inc.
G06V20/48G06F16/14G06K9/6201H04N21/2353
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,450,110
App. No.
16/994,033
Granted
Sep 20, 2022
Kind
B2
Abstract

In one aspect, a method includes receiving first query fingerprint data representing first content channeled through a portion of a content-distribution system. The method also includes detecting a first match between the received first query fingerprint data and first reference fingerprint data representing a modifiable content-segment. The method also includes responsive to detecting the first match, performing a first action. The method also includes receiving second query fingerprint data representing content received by a content-presentation device. The method also includes detecting a second match between the received second query fingerprint data and second reference fingerprint data representing second content transmitted by the content-distribution system, where the second content is a modified version of the first content. The method also includes responsive to detecting the second match, performing a second action that is different from the first action.

Claims (34)

1. A method comprising:

receiving query fingerprint data representing first content channeled through a first portion of a content-distribution system, wherein the first portion of the content-distribution system is upstream from a second portion of the content-distribution system in which a modified version of the first content is generated and transmitted to a content-presentation device, and wherein the modified version of the first content includes at least a portion of the first content;

detecting a match between the received query fingerprint data and reference fingerprint data representing a modifiable content-segment; and

responsive to detecting the match, performing an action.

2. The method of claim 1 , wherein the modified version of the first content comprises the first content with overlay content overlaid thereon.

3. The method of claim 2 , wherein the overlay content is a digital video effect (DVE), and

wherein the second portion of the content-distribution system is different from the first portion and comprises a DVE system configured to modify the first content by overlaying the DVE on the first content and then outputting the modified version of the first content.

4. The method of claim 1 , wherein after the modified version of the first content is generated, the modified version of the first content is accessed to generate fingerprint data representing the modified version of the first content.

5. The method of claim 4 , wherein the fingerprint data representing the modified version of the first content is used to identify a channel on which the content-presentation device received content.

6. The method of claim 1 , wherein performing the action comprises identifying an upcoming content-modification opportunity on a channel on which the content-presentation device received content.

7. The method of claim 1 , wherein the content-distribution system comprises a television-broadcast station.

8. A non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by a processor, cause performance of a set of operations comprising:

receiving query fingerprint data representing first content channeled through a first portion of a content-distribution system, wherein the first portion of the content-distribution system is upstream from a second portion of the content-distribution system in which a modified version of the first content is generated and transmitted to a content-presentation device, and wherein the modified version of the first content includes at least a portion of the first content;

detecting a match between the received query fingerprint data and reference fingerprint data representing a modifiable content-segment; and

responsive to detecting the match, performing an action.

9. The non-transitory computer-readable storage medium of claim 8 , wherein the modified version of the first content comprises the first content with overlay content overlaid thereon.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the overlay content is a digital video effect (DVE), and

wherein the second portion of the content-distribution system is different from the first portion and comprises a DVE system configured to modify the first content by overlaying the DVE on the first content and then outputting the modified version of the first content.

11. The non-transitory computer-readable storage medium of claim 8 , wherein after the modified version of the first content is generated, the modified version of the first content is accessed to generate fingerprint data representing the modified version of the first content.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the fingerprint data representing the modified version of the first content is used to identify a channel on which the content-presentation device received content.

13. The non-transitory computer-readable storage medium of claim 8 , wherein performing the action comprises identifying an upcoming content-modification opportunity on a channel on which the content-presentation device received content.

14. The non-transitory computer-readable storage medium of claim 8 , wherein the content-distribution system comprises a television-broadcast station.

15. A computing system comprising:

a processor; and

a non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by the processor, cause performance of a set of operations comprising:

receiving query fingerprint data representing first content channeled through a first portion of a content-distribution system, wherein the first portion of the content-distribution system is upstream from a second portion of the content-distribution system in which a modified version of the first content is generated and transmitted to a content-presentation device, and wherein the modified version of the first content includes at least a portion of the first content;

detecting a match between the received query fingerprint data and reference fingerprint data representing a modifiable content-segment; and

responsive to detecting the match, performing an action.

16. The computing system of claim 15 , wherein the modified version of the first content comprises the first content with overlay content overlaid thereon.

17. The computing system of claim 16 , wherein the overlay content is a digital video effect (DVE), and

wherein the second portion of the content-distribution system is different from the first portion and comprises a DVE system configured to modify the first content by overlaying the DVE on the first content and then outputting the modified version of the first content.

18. The computing system of claim 15 , wherein after the modified version of the first content is generated, the modified version of the first content is accessed to generate fingerprint data representing the modified version of the first content.

19. The computing system of claim 18 , wherein the fingerprint data representing the modified version of the first content is used to identify a channel on which the content-presentation device received content.

20. The computing system of claim 19 , wherein performing the action comprises identifying an upcoming content-modification opportunity on a channel on which the content-presentation device received content.

Assignments (5)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2020
From: ASHBACHER, ANDREW LAURENCE; CORMIE, STEVEN MICHAEL; HAYNES, JOHN L., III; MARIS, STEFAN MATTHIJS
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 053502/0504 →