IP Library Granted Patent US 11,962,846
Granted Patent B2
US 11,962,846 · App. 17/644,120 · Granted Apr 16, 2024

Use of steganographically-encoded data as basis to control dynamic content modification as to at least one modifiable-content segment identified based on fingerprint analysis

Inventors: Shashank Merchant (Sunnyvale, CA); Do Phuoc Hoang Tuong Lan (Seoul, KR)
Assignee: ROKU, INC.
H04N21/440245G06F16/783H04N21/4627H04N21/4852H04N21/4854
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,962,846
App. No.
17/644,120
Granted
Apr 16, 2024
Kind
B2
Abstract

The disclosure provides for use of steganographically-encoded data as a basis to control content modification. A server could determine through a fingerprint comparison that a portion of media content on a channel being rendered by a content presentation device matches at least one modifiable-content segment, such as at least one replaceable ad. The server could then use watermark data encoded in the media content of the channel as a basis to determine an actual identity of a modifiable-content segment present on the channel, so as to then control content modification.

Claims (35)

1. A method comprising:

starting by a content presentation device to prepare for carrying out content modification with respect to a portion of media content on a channel being received by the content presentation device, wherein the starting is responsive to signaling from a server based on the server having determined through a fingerprint comparison that the portion of the media content is a particular modifiable-content segment; and

before starting by the content presentation device to carry out the content modification, abandoning by the content presentation device the content modification, wherein the abandoning is responsive to further signaling from the server based on the server having determined based on watermark data encoded in the media content that the portion of the media content is not the particular modifiable-content segment.

2. The method of claim 1 , wherein the starting to prepare for carrying out the content modification comprises an action selected from the group consisting of (i) receiving a directive for the content presentation device to carry out the content modification, (ii) querying storage to obtain modified content specifically for presentation in place of the particular modifiable-content segment, and (iii) setting a trigger for beginning to play out of the modified content in place of the particular modifiable-content segment.

3. The method of claim 1 , further comprising:

receiving by the content presentation device the signaling from the server based on the server having determined through the fingerprint comparison that the portion of the media content is the particular modifiable-content segment; and

receiving by the content presentation device the further signaling from the server based on the server having determined based on the watermark data encoded in media content of the channel that the portion of the media content is not the particular modifiable-content segment.

4. The method of claim 1 , wherein the content modification comprises substituting replacement content in place of the particular modifiable-content segment, and wherein abandoning the content modification before starting to carry out the content modification comprises forgoing the substituting of the replacement content in place of the particular modifiable-content segment and therefore not beginning the substituting.

5. The method of claim 1 , wherein the particular modifiable-content segment is a replaceable ad.

6. The method of claim 1 , wherein the fingerprint comparison is video based and the watermark data is audio based.

7. The method of claim 1 , wherein the content presentation device comprises a television.

8. A content presentation device comprising:

at least one processor;

at least one non-transitory data storage; and

program instructions stored in the at least one non-transitory data storage and executable by the at least one processor to cause the content presentation device to carry out operations including:

starting to prepare for carrying out content modification with respect to a portion of media content on a channel being received by the content presentation device, wherein the starting is responsive to signaling from a server based on the server having determined through a fingerprint comparison that the portion of the media content is a particular modifiable-content segment, and

before starting to carry out the content modification, abandoning the content modification, wherein the abandoning is responsive to further signaling from the server based on the server having determined based on watermark data encoded in the media content that the portion of the media content is not the particular modifiable-content segment.

9. The content presentation device of claim 8 , wherein the starting to prepare for carrying out the content modification comprises an action selected from the group consisting of (i) receiving a directive for the content presentation device to carry out the content modification, (ii) querying storage to obtain modified content specifically for presentation in place of the particular modifiable-content segment, and (iii) setting a trigger for beginning to play out of the modified content in place of the particular modifiable-content segment.

10. The content presentation device of claim 8 , wherein the operations additionally include:

receiving the signaling from the server based on the server having determined through the fingerprint comparison that the portion of the media content is the particular modifiable-content segment; and

receiving the further signaling from the server based on the server having determined based on the watermark data encoded in media content of the channel that the portion of the media content is not the particular modifiable-content segment.

11. The content presentation device of claim 8 , wherein the content modification comprises substituting replacement content in place of the particular modifiable-content segment, and wherein abandoning the content modification before starting to carry out the content modification comprises forgoing the substituting of the replacement content in place of the particular modifiable-content segment and therefore not beginning the substituting.

12. The content presentation device of claim 8 , wherein the particular modifiable-content segment is a replaceable ad.

13. The content presentation device of claim 8 , wherein the fingerprint comparison is video based and the watermark data is audio based.

14. The content presentation device of claim 8 , wherein the content presentation device comprises a television.

15. At least one non-transitory computer-readable medium embodying program instructions executable by at least one processing unit to cause a content presentation device to carry out operations including:

starting to prepare for carrying out content modification with respect to a portion of media content on a channel being received by the content presentation device, wherein the starting is responsive to signaling from a server based on the server having determined through a fingerprint comparison that the portion of the media content is a particular modifiable-content segment; and

before starting to carry out the content modification, abandoning the content modification, wherein the abandoning is responsive to further signaling from the server based on the server having determined based on watermark data encoded in the media content that the portion of the media content is not the particular modifiable-content segment.

16. The at least one non-transitory computer-readable medium of claim 15 , wherein the starting to prepare for carrying out the content modification comprises an action selected from the group consisting of (i) receiving a directive for the content presentation device to carry out the content modification, (ii) querying storage to obtain modified content specifically for presentation in place of the particular modifiable-content segment, and (iii) setting a trigger for beginning to play out of the modified content in place of the particular modifiable-content segment.

17. The at least one non-transitory computer-readable medium of claim 15 , wherein the operations additionally include:

receiving the signaling from the server based on the server having determined through the fingerprint comparison that the portion of the media content is the particular modifiable-content segment; and

receiving the further signaling from the server based on the server having determined based on the watermark data encoded in media content of the channel that the portion of the media content is not the particular modifiable-content segment.

18. The at least one non-transitory computer-readable medium of claim 15 , wherein the content modification comprises substituting replacement content in place of the particular modifiable-content segment, and wherein abandoning the content modification before starting to carry out the content modification comprises forgoing the substituting of the replacement content in place of the particular modifiable-content segment and therefore not beginning the substituting.

19. The at least one non-transitory computer-readable medium of claim 15 , wherein the particular modifiable-content segment is a replaceable ad.

20. The at least one non-transitory computer-readable medium of claim 15 , wherein the fingerprint comparison is video based and the watermark data is audio based.

Assignments (3)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2021
From: MERCHANT, SHASHANK; LAN, DO PHUOC HOANG TUONG
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 058382/0359 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 058920/0278 →
Continuity (3)
Continuation 15929225 · Feb 14, 2020
Provisional Application 62863007 · Jun 18, 2019
Related Publication 20220109912A1 · Apr 7, 2022