IP Library Granted Patent US 11,343,565
Granted Patent B2
US 11,343,565 · App. 17/162,299 · Granted May 24, 2022

Content-modification system with feature for detecting and responding to a content modification by a tuner device

Inventors: Steven Michael Cormie (Cambridge, GB); Brian Patrick Jentz (Buxton, GB); Stefanos Christakis Liassides (Cardiff, GB)
Assignee: Roku, Inc.
H04N21/44016G06T1/0021G06V40/1365H04N21/23424H04N21/2407H04N21/25816H04N21/25841H04N21/262H04N21/266H04N21/431H04N21/44204H04N21/458H04N21/8358H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,343,565
App. No.
17/162,299
Granted
May 24, 2022
Kind
B2
Abstract

In one aspect, a method is performed by a content-presentation device that is scheduled to perform, at a modification start-time, a content-modification operation that comprises modifying a modifiable content-segment that the content-presentation device is scheduled to receive. The method includes receiving reference fingerprint data representing the modifiable content-segment. The method also includes making a comparison of the reference fingerprint data with query fingerprint data representing content received by the content-presentation device from a tuner device connected to the content-presentation device. The method also includes based on the comparison, detecting, within a predefined time period after the modification start-time and during performance of the content-modification operation, a mismatch between the reference fingerprint data and the query fingerprint data. The method also includes in response to detecting the mismatch within the predefined time period after the modification start-time and during performance of the content-modification operation, performing an action.

Claims (44)

1. A method performed by a content-presentation device that is scheduled to perform, at a modification start-time, a content-modification operation that comprises modifying a modifiable content-segment that the content-presentation device is scheduled to receive, the method comprising:

receiving reference fingerprint data representing the modifiable content-segment;

making a comparison of the reference fingerprint data with query fingerprint data representing content received by the content-presentation device from a tuner device connected to the content-presentation device;

based on the comparison, detecting, within a predefined time period after the modification start-time and during performance of the content-modification operation, a mismatch between the reference fingerprint data and the query fingerprint data, wherein the predefined time period after the modification start-time represents a time period during which a detected mismatch between reference fingerprint data and query fingerprint data is expected to be caused by the tuner device having already modified the modifiable content-segment before the modification start-time; and

in response to detecting the mismatch within the predefined time period after the modification start-time and during performance of the content-modification operation, performing an action.

2. The method of claim 1 , wherein the content-presentation device is part of a content-modification system, and

wherein the tuner device is a set-top box (STB) that is not part of the content-modification system and that is associated with a multi-channel video program distributor (MVPD).

3. The method of claim 1 , wherein the predefined time period is a value in a range of 1 to 4 seconds.

4. The method of claim 1 , wherein performing the action comprises continuing performance of the content-modification operation until the content-modification operation is complete.

5. The method of claim 1 , wherein performing the action comprises transmitting, to a fingerprint-matching server, a notification that the content-presentation device has detected the mismatch within the predefined time period after the modification start-time and during performance of the content-modification operation, to facilitate the fingerprint-matching server determining that the mismatch is due to the tuner device having modified the modifiable content-segment before the modification start-time.

6. The method of claim 1 , wherein the content-modification operation is scheduled to be performed relative to an identified content-modification opportunity on a channel to which the content-presentation device is tuned, and

wherein performing the action comprises transmitting, to a fingerprint-matching server, an indication that the content-presentation device is receiving content on the channel.

7. The method of claim 1 , wherein performing the action comprises aborting the content-modification operation before the content-modification operation is complete.

8. The method of claim 1 , further comprising:

determining, within the predefined time period after the modification start-time and during performance of the content-modification operation, that at least a portion of the content that was received by the content-presentation device from the tuner device and that is being modified as part of the content-modification operation includes a watermark associated with a content distributor,

wherein performing the action is performed further in response to determining that at least the portion of the content that was received by the content-presentation device from the tuner device and that is being modified as part of the content-modification operation includes the watermark associated with the content distributor.

9. The method of claim 1 , wherein the content-modification operation is a content-replacement operation that comprises replacing the modifiable content-segment with first supplemental content, and

wherein the query fingerprint data represents second supplemental content with which the tuner device replaced the modifiable content-segment before the modification start-time.

10. A non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by a processor, cause performance of a set of operations comprising:

receiving reference fingerprint data representing a modifiable content-segment, wherein a content-presentation device is scheduled to perform, at a modification start-time, a content-modification operation that comprises modifying the modifiable content-segment that the content-presentation device is scheduled to receive;

making a comparison of the reference fingerprint data with query fingerprint data representing content received by the content-presentation device from a tuner device connected to the content-presentation device;

based on the comparison, detecting, within a predefined time period after the modification start-time and during performance of the content-modification operation, a mismatch between the reference fingerprint data and the query fingerprint data, wherein the predefined time period after the modification start-time represents a time period during which a detected mismatch between reference fingerprint data and query fingerprint data is expected to be caused by the tuner device having already modified the modifiable content-segment before the modification start-time; and

in response to detecting the mismatch within the predefined time period after the modification start-time and during performance of the content-modification operation, performing an action.

11. The non-transitory computer-readable storage medium of claim 10 , wherein the content-presentation device is part of a content-modification system, and

wherein the tuner device is a set-top box (STB) that is not part of the content-modification system and that is associated with a multi-channel video program distributor (MVPD).

12. The non-transitory computer-readable storage medium of claim 10 , wherein the predefined time period is a value in a range of 1 to 4 seconds.

13. The non-transitory computer-readable storage medium of claim 10 , wherein performing the action comprises continuing performance of the content-modification operation until the content-modification operation is complete.

14. The non-transitory computer-readable storage medium of claim 10 , wherein performing the action comprises transmitting, to a fingerprint-matching server, a notification that the content-presentation device has detected the mismatch within the predefined time period after the modification start-time and during performance of the content-modification operation, to facilitate the fingerprint-matching server determining that the mismatch is due to the tuner device having modified the modifiable content-segment before the modification start-time.

15. The non-transitory computer-readable storage medium of claim 10 , wherein the content-modification operation is scheduled to be performed relative to an identified content-modification opportunity on a channel to which the content-presentation device is tuned, and

wherein performing the action comprises transmitting, to a fingerprint-matching server, an indication that the content-presentation device is receiving content on the channel.

16. The non-transitory computer-readable storage medium of claim 10 , the set of operations further comprising:

determining, within the predefined time period after the modification start-time and during performance of the content-modification operation, that at least a portion of the content that was received by the content-presentation device from the tuner device and that is being modified as part of the content-modification operation includes a watermark associated with a content distributor,

wherein performing the action is performed further in response to determining that at least the portion of the content that was received by the content-presentation device from the tuner device and that is being modified as part of the content-modification operation includes the watermark associated with the content distributor.

17. A computing system comprising:

a processor; and

a non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by the processor, cause performance of a set of operations comprising:

receiving reference fingerprint data representing a modifiable content-segment, wherein a content-presentation device is scheduled to perform, at a modification start-time, a content-modification operation that comprises modifying the modifiable content-segment that the content-presentation device is scheduled to receive;

making a comparison of the reference fingerprint data with query fingerprint data representing content received by the content-presentation device from a tuner device connected to the content-presentation device;

based on the comparison, detecting, within a predefined time period after the modification start-time and during performance of the content-modification operation, a mismatch between the reference fingerprint data and the query fingerprint data, wherein the predefined time period after the modification start-time represents a time period during which a detected mismatch between reference fingerprint data and query fingerprint data is expected to be caused by the tuner device having already modified the modifiable content-segment before the modification start-time; and

in response to detecting the mismatch within the predefined time period after the modification start-time and during performance of the content-modification operation, performing an action.

18. The computing system of claim 17 , wherein the content-presentation device is part of a content-modification system, and

wherein the tuner device is a set-top box (STB) that is not part of the content-modification system and that is associated with a multi-channel video program distributor (MVPD).

19. The computing system of claim 17 , wherein the predefined time period is a value in a range of 1 to 4 seconds.

20. The computing system of claim 17 , wherein performing the action comprises continuing performance of the content-modification operation until the content-modification operation is complete.

Assignments (5)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2021
From: CORMIE, STEVEN MICHAEL; JENTZ, BRIAN PATRICK; LIASSIDES, STEFANOS CHRISTAKIS
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 055081/0839 →