IP Library Granted Patent US 10,904,589
Granted Patent B2
US 10,904,589 · App. 16/568,445 · Granted Jan 26, 2021

Method and system for remotely controlling consumer electronic devices

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,904,589
App. No.
16/568,445
Granted
Jan 26, 2021
Kind
B2
Abstract

A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.

Claims (51)

1. A method for use in connection with a client device and a sequence of media content that includes a first portion followed by a second portion, the method comprising:

presenting, by the client device, the first portion of the sequence of media content;

performing, by the client device, a content replacement operation, wherein performing the content replacement operation comprises presenting replacement media content instead of the second portion of the sequence of media content;

while performing the content replacement operation:

(i) extracting, by the client device, steganographic data included in the second portion of the sequence of media content,

(ii) sending, by the client device, the extracted steganographic data to a server device to facilitate the server device using the steganographic data to determine that the second portion of the sequence of media content was interrupted by interrupting media content, and

(iii) responsive to sending the extracted steganographic data to the server device, receiving an instruction to switch from presenting the replacement media content to presenting the interrupting media content instead; and

responsive to receiving the instruction, switching, by the client device, from presenting the replacement media content to presenting the interrupting media content.

2. The method of claim 1 , wherein the client device is a television.

3. The method of claim 1 , wherein the media content comprises video content.

4. The method of claim 1 , wherein the second portion of the sequence of media content is a portion of a non-targeted advertisement and wherein the replacement media content is a portion of a targeted advertisement.

5. The method of claim 1 , wherein the interrupting media content comprises media content comprising an emergency alert received by the client device.

6. The method of claim 1 , wherein the interrupting media content comprises media content received by the client device in response to a channel change.

7. The method of claim 1 , wherein the interrupting media content comprises an on-screen programming guide.

8. The method of claim 1 , further comprising:

responsive to switching from presenting the replacement media content to presenting the interrupting media content, generating usage data, by the client device, indicating an extent of the replacement media content presented by the client device; and

sending the generated usage data.

9. A non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by one or more processors of a client device, cause the client device to perform operations in connection with a sequence of media content that includes a first portion followed by a second portion, the operations comprising:

presenting the first portion of the sequence of media content;

performing a content replacement operation, wherein performing the content replacement operation comprises presenting replacement media content instead of the second portion of the sequence of media content;

while performing the content replacement operation:

(i) extracting steganographic data included in the second portion of the sequence of media content,

(ii) sending the extracted steganographic data to a server device to facilitate the server device using the steganographic data to determine that the second portion of the sequence of media content was interrupted by interrupting media content, and

(iii) responsive to sending the extracted steganographic data to the server device, receiving an instruction to switch from presenting the replacement media content to presenting the interrupting media content instead; and

responsive to receiving the instruction, switching from presenting the replacement media content to presenting interrupting media content.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the client device is a television.

11. The non-transitory computer-readable storage medium of claim 9 , wherein the media content comprises video content.

12. The non-transitory computer-readable storage medium of claim 9 , wherein the second portion of the sequence of media content is a portion of a non-targeted advertisement and wherein the replacement media content is a portion of a targeted advertisement.

13. The non-transitory computer-readable storage medium of claim 9 , wherein the interrupting media content comprises media content comprising an emergency alert received by the client device.

14. The non-transitory computer-readable storage medium of claim 9 , wherein the interrupting media content comprises media content received by the client device in response to a channel change.

15. The non-transitory computer-readable storage medium of claim 9 , wherein the interrupting media content comprises an on-screen programming guide.

16. The non-transitory computer-readable storage medium of claim 9 , the operations further comprising:

responsive to switching from presenting the replacement media content to presenting the interrupting media content, generating usage data indicating an extent of the replacement media content presented on the client device; and

sending the generated usage data.

17. A client device comprising one or more processors and a non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by the one or more processors, cause the client device to perform operations in connection with an original sequence of media content that includes a first portion followed by a second portion, the operations comprising:

presenting the first portion of the sequence of media content;

performing a content replacement operation, wherein performing the content replacement operation comprises presenting replacement media content instead of the second portion of the sequence of media content;

while performing the content replacement operation:

(i) extracting steganographic data included in the second portion of the sequence of media content,

(ii) sending the extracted steganographic data to a server device to facilitate the server device using the steganographic data to determine that the second portion of the sequence of media content was interrupted by interrupting media content, and

(iii) responsive to sending the extracted steganographic data to the server device, receiving an instruction to switch from presenting the replacement media content to presenting the interrupting media content instead; and

responsive to receiving the instruction, switching from presenting the replacement media content to presenting the interrupting media content.

18. The client device of claim 17 , wherein the client device is a television.

19. The client device of claim 17 , wherein the media content comprises video content.

20. The client device of claim 17 , wherein the second portion of the sequence of media content is a portion of a non-targeted advertisement and wherein the replacement media content is a portion of a targeted advertisement.

21. The client device of claim 17 , wherein the interrupting media content comprises media content comprising an emergency alert received by the client device.

22. The client device of claim 17 , wherein the interrupting media content comprises media content received by the client device in response to a channel change.

23. The client device of claim 17 , wherein the interrupting media content comprises an on-screen programming guide.

24. The client device of claim 17 , the operations further comprising:

responsive to switching from presenting the replacement media content to presenting the interrupting media content, generating usage data indicating an extent of the replacement media content presented by the client device; and

sending the generated usage data.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2019
From: GORDON, DONALD F.
To: GRACENOTE, INC.
Reel/Frame 050354/0343 →