IP Library Granted Patent US 11,064,223
Granted Patent B2
US 11,064,223 · App. 16/403,075 · Granted Jul 13, 2021

Method and system for remotely controlling consumer electronic devices

Inventor: Donald F. Gordon (Morgan Hills, CA)
Assignee: Roku, Inc.
H04N21/23424H04N7/17318H04N21/20H04N21/21H04N21/23H04N21/234H04N21/235H04N21/2347H04N21/23418H04N21/23439H04N21/24H04N21/25H04N21/251H04N21/2543H04N21/25883H04N21/2668H04N21/44H04N21/442H04N21/4405H04N21/44008H04N21/44016H04N21/44204H04N21/44213H04N21/44222H04N21/4722H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,064,223
App. No.
16/403,075
Granted
Jul 13, 2021
Kind
B2
Abstract

A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.

Claims (63)

1. A method comprising:

receiving, at a media system, a first sequence of media content from a media content source over a first communication network, wherein the first sequence of media content includes steganographic data indicating a replaceable portion of the first sequence of media content, wherein receiving the first sequence of media content comprises receiving a video signal that has been passed through a data filter, and wherein the video signal comprises the steganographic data before being passed through the data filter and after being passed through the data filter;

causing presentation of a portion of the first sequence of media content on a display of the media system;

detecting, by the media system, the steganographic data in the first sequence of media content;

responsive to detecting the steganographic data, transmitting a request for replacement content to a content replacement system over a second communication network, wherein the second communication network is distinct from the first communication network;

receiving, at the media system, a response to the request, wherein the response comprises an indication of a second sequence of media content; and

after receiving the indication of the second sequence of media content, causing presentation of the second sequence of media content on the display of the media system instead of the replaceable portion of the first sequence of media content.

2. The method of claim 1 , further comprising:

generating, by the media system, a fingerprint of the first sequence of media content,

wherein transmitting the request comprises transmitting the fingerprint to the content replacement system for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content.

3. The method of claim 1 , wherein the steganographic data is encrypted, and

wherein the method further comprises decrypting the steganographic data.

4. The method of claim 1 , wherein the steganographic data is a watermark.

5. The method of claim 1 , wherein the steganographic data comprises an instruction for the media system to request the replacement content,

wherein the method further comprises detecting the instruction, and

wherein transmitting the request for the replacement content is in response to detecting the instruction.

6. The method of claim 1 , wherein receiving the first sequence of media content comprises receiving, at a first input of the media system, the first sequence of media content, and

wherein the method further comprises, based on the steganographic data, switching from the first input to a second input of the media system to cause the presentation of the second sequence of media content.

7. The method of claim 1 , wherein the first sequence of media content comprises an audio signal, and wherein the steganographic data is encoded in the audio signal.

8. A system comprising:

one or more processors;

memory;

a display;

instructions stored in the memory, which when executed by the one or more processors cause the one or more processors to perform operations comprising:

receiving a first sequence of media content from a media content source over a first communication network, wherein the first sequence of media content includes steganographic data indicating a replaceable portion of the first sequence of media content, wherein receiving the first sequence of media content comprises receiving a video signal that has been passed through a data filter, and wherein the video signal comprises the steganographic data before being passed through the data filter and after being passed through the data filter,

causing presentation of a portion of the first sequence of media content on the display,

detecting the steganographic data in the first sequence of media content,

responsive to detecting the steganographic data, transmitting a request for replacement content to a content replacement system over a second communication network, wherein the second communication network is distinct from the first communication network,

receiving a response to the request, wherein the response comprises an indication of a second sequence of media content, and

after receiving the indication of the second sequence of media content, causing presentation of the second sequence of media content on the display instead of the replaceable portion of the first sequence of media content.

9. The system of claim 8 , wherein the operations further comprise:

generating, using the one or processors, a fingerprint of the first sequence of media content,

wherein transmitting the request comprises transmitting the fingerprint to the content replacement system for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content.

10. The system of claim 8 , wherein:

the steganographic data is encrypted, and the operations further comprise decrypting the steganographic data.

11. The system of claim 8 , wherein the steganographic data is a watermark.

12. The system of claim 8 , wherein the steganographic data comprises an instruction for the one or more processors to request the replacement content,

wherein the operations further comprise detecting the instruction, and

wherein transmitting the request for the replacement content is in response to detecting the instruction.

13. The system of claim 8 , further comprising:

a first input; and

a second input,

wherein receiving the first sequence of media content comprises receiving, at the first input, the first sequence of media content, and

wherein the operations further comprise, based on the steganographic data, switching from the first input to the second input to cause the presentation of the second sequence of media content.

14. A non-transitory computer readable storage medium storing instructions which, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving a first sequence of media content from a media content source over a first communication network, wherein the first sequence of media content includes steganographic data indicating a replaceable portion of the first sequence of media content, wherein receiving the first sequence of media content comprises receiving a video signal that has been passed through a data filter, and wherein the video signal comprises the steganographic data before being passed through the data filter and after being passed through the data filter;

causing presentation of a portion of the first sequence of media content on a display;

detecting the steganographic data in the first sequence of media content;

responsive to detecting the steganographic data, transmitting a request for replacement content to a content replacement system over a second communication network, wherein the second communication network is distinct from the first communication network;

receiving a response to the request, wherein the response comprises an indication of a second sequence of media content; and

after receiving the indication of the second sequence of media content, causing presentation of the second sequence of media content on the display instead of the replaceable portion of the first sequence of media content.

15. The non-transitory computer readable storage medium of claim 14 , wherein the operations further comprise:

generating, using the one or processors, a fingerprint of the first sequence of media content,

wherein transmitting the request comprises transmitting the fingerprint to the content replacement system for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content.

16. The non-transitory computer readable storage medium of claim 14 , wherein the steganographic data is a watermark.

17. The non-transitory computer readable storage medium of claim 14 , wherein the steganographic data comprises an instruction for the one or more processors to request the replacement content,

wherein the operations further comprise detecting the instruction, and

wherein transmitting the request for the replacement content is in response to detecting the instruction.

18. The non-transitory computer readable storage medium of claim 14 , further comprising:

a first input; and

a second input,

wherein receiving the first sequence of media content comprises receiving, at the first input, the first sequence of media content, and

wherein the operations further comprise, based on the steganographic data, switching from the first input to the second input to cause the presentation of the second sequence of media content.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: GRACENOTE, INC.; A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2019
From: GORDON, DONALD F.
To: GRACENOTE, INC.
Reel/Frame 049112/0799 →