IP Library Granted Patent US 11,134,281
Granted Patent B2
US 11,134,281 · App. 16/836,417 · Granted Sep 28, 2021

Method and system for remotely controlling consumer electronic devices

Inventor: Donald F. Gordon (Morgan Hills, CA)
Assignee: Roku, Inc.
H04N21/23424H04N7/17318H04N21/20H04N21/21H04N21/23H04N21/234H04N21/235H04N21/2347H04N21/23418H04N21/23439H04N21/24H04N21/25H04N21/251H04N21/2543H04N21/25883H04N21/2668H04N21/44H04N21/442H04N21/4405H04N21/44008H04N21/44016H04N21/44204H04N21/44213H04N21/44222H04N21/4722H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,134,281
App. No.
16/836,417
Granted
Sep 28, 2021
Kind
B2
Abstract

A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.

Claims (41)

1. A method comprising:

receiving, at a media system, a sequence of video content distributed over a communication network, the sequence of video content including control data steganographically encoded in the video content by adjustment of chrominance of pixels of the video content;

processing, by the media system, the sequence of video content for presentation; and

while processing the sequence of video content for presentation, detecting by the media system the control data steganographically encoded in the video content by adjustment of chrominance of pixels of the video content, extracting by the media system the detected control data from the video content, and using by the media system the extracted control data as a basis to perform an action.

2. The method of claim 1 , wherein the control data as steganographically encoded in and extracted from the video content is encrypted.

3. The method of claim 2 , further comprising decrypting by the media system the extracted control data.

4. The method of claim 2 , further comprising:

sending at least a portion of the extracted control data to a computing system that is external to the media system and that decrypts the control data; and

receiving by the media system, in a response from the external computing system, an instruction to perform the action.

5. The method of claim 4 , wherein, by having the control data be decrypted at the computing system external to the media system, the media system does not learn of the decrypted control data.

6. The method of claim 1 , wherein the action comprises content replacement, and wherein the control data indicates a content-replacement opportunity in the sequence of video content.

7. The method of claim 1 , wherein the control data indicates an advertisement-replacement opportunity in the sequence of video content.

8. The method of claim 7 , wherein the action comprises sending a request to a content-replacement system and receiving in response from the content-replacement system a replacement advertisement.

9. The method of claim 7 , wherein the control data comprises an item selected from the group consisting of (i) an advertiser identifier, (ii) an advertisement campaign identifier, (iii) advertisement duration, and (iv) advertisement pre-roll period or advertisement start time.

10. The method of claim 1 , wherein the sequence of video content includes interstitial advertisements, wherein the action comprises inserting at least one replacement advertisement for presentation in place of at least one of the interstitial advertisements, and wherein the control data includes timing information of when in the sequence of video content the at least one replacement advertisement should be inserted for presentation in place of the at least one interstitial advertisement.

11. The method of claim 10 , wherein the sequence of video content comprises video content of a television show with the interstitial advertisements.

12. The method of claim 10 , wherein the timing information comprises a frame count useable by the media system to determine when to switch from presenting the sequence of video content to presenting the at least one replacement advertisement.

13. The method of claim 1 , wherein processing the sequence of video content for presentation comprise video-decoding the sequence of video content.

14. A media system comprising:

one or more processors;

memory;

a display; and

instructions stored in the memory and executable by the one or more processors to cause the media system to carry out operations including:

receiving a sequence of video content distributed over a communication network, the sequence of video content including control data steganographically encoded in the video content by adjustment of chrominance of pixels of the video content,

processing the sequence of video content for presentation, and

while processing the sequence of video content for presentation, detecting the control data steganographically encoded in the video content by adjustment of chrominance of pixels of the video content, extracting the detected control data from the video content, and using the extracted control data as a basis to perform an action.

15. The media system of claim 14 , wherein the control data as steganographically encoded in and extracted from the video content is encrypted.

16. The media system of claim 15 , wherein the operations further include:

sending at least a portion of the extracted control data to a computing system that is external to the media system and that decrypts the control data; and

receiving, in a response from the external computing system, an instruction to perform the action,

wherein, by having the control data be decrypted at the computing system external to the media system, the media system does not learn of the decrypted control data.

17. The media system of claim 15 , wherein the action comprises content replacement, and wherein the control data indicates a content-replacement opportunity in the sequence of video content.

18. The method of claim 1 , wherein the control data indicates an advertisement-replacement opportunity in the sequence of video content.

19. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of a media system, cause the media system to carry out operations comprising:

receiving a sequence of video content distributed over a communication network, the sequence of video content including control data steganographically encoded in the video content by adjustment of chrominance of pixels of the video content;

processing the sequence of video content for presentation; and

while processing the sequence of video content for presentation, detecting the control data steganographically encoded in the video content by adjustment of chrominance of pixels of the video content, extracting the detected control data from the video content, and using the extracted control data as a basis to perform an action.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the control data as steganographically encoded in and extracted from the video content is encrypted, and wherein the operations further include:

outputting at least a portion of the extracted control data for transmission to a computing system that is external to the media system and that decrypts the control data; and

receiving, in a response from the external computing system, an instruction to perform the action,

wherein, by having the control data be decrypted at the computing system external to the media system, the media system does not learn of the decrypted control data.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2020
From: GORDON, DONALD F.
To: GRACENOTE, INC.
Reel/Frame 052287/0180 →