IP Library Granted Patent US 10,735,782
Granted Patent B2
US 10,735,782 · App. 16/403,089 · Granted Aug 4, 2020

Method and system for remotely controlling consumer electronic devices

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,735,782
App. No.
16/403,089
Granted
Aug 4, 2020
Kind
B2
Abstract

A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.

Claims (47)

1. A method comprising:

receiving, at a media system, a sequence of media content from a media content distributor over a communication network, the sequence of media content including interstitial advertisements, and the sequence of media content being watermarked with control data that includes timing information of when in the sequence of media content at least one replacement advertisement should be presented in place of at least one of the interstitial advertisements, wherein at least a portion of the watermarked control data includes encrypted control data;

outputting, by the media system, the sequence of media content for presentation;

while outputting the sequence of media content for presentation, (i) detecting, by the media system, the watermarked control data in the sequence of media content and (ii) determining, by the media system, from the detected watermarked control data, the timing information of when in the sequence of media content the at least one replacement advertisement should be presented;

responsive to detecting the watermarked control data in the sequence of media content, transmitting from the media system to a content-replacement system a replacement-content request, including in the replacement-content request the encrypted control data without decrypting the encrypted control data;

receiving at the media system, in response to the replacement-content request, the at least one replacement advertisement; and

causing, by the media system, the at least one replacement advertisement to be presented in accordance with the determined timing information, in place of content of the sequence of media content.

2. The method of claim 1 , wherein the sequence of media content includes a television show with the interstitial advertisements.

3. The method of claim 1 , wherein the timing information comprises a frame count, and wherein causing the at least one replacement advertisement to be presented in accordance with the determined timing information comprises counting frames to determine when to switch from presenting the sequence of media content to presenting the at least one replacement advertisement.

4. The method of claim 1 , wherein the timing information comprises an advertisement duration, and wherein causing the at least one replacement advertisement to be presented comprises causing presentation of the at least one replacement advertisement until detecting an end of the at least one replacement advertisement.

5. The method of claim 1 , wherein the sequence of media content defines a first channel, the method further comprising:

detecting, by the media system, a channel-change request defining a request for the media system to switch from presenting the first channel to presenting a second channel; and

responsive to detecting the channel-change request, causing, by media system, presentation of the at least one replacement advertisement to cease before an end of the at least one replacement advertisement.

6. The method of claim 1 , wherein receiving the at least one replacement advertisement comprises receiving, with the at least one replacement advertisement, information that uniquely identifies the sequence of media content, the method further comprising:

using, by the media system, the received information as a basis to validate a replacement opportunity for presentation of the at least one replacement advertisement.

7. The method of claim 1 ,

wherein the watermarked control data further includes original-advertisement data comprising at least one of an advertisement identifier or an advertisement campaign identifier for the at least one interstitial advertisement that the at least one replacement advertisement would replace, and

wherein the replacement-content request includes the original-advertisement data from the watermarked control data, for use by the content-replacement system as a basis to determine the at least one replacement advertisement to provide to the media system.

8. The method of claim 1 , wherein the replacement-content request includes information for use by the content replacement system as a basis to determine the at least one replacement advertisement to provide to the media system, the information being selected from the group consisting of (i) video profile information, (ii) bandwidth information, (iii) program context information, and (iv) at least one of viewer demographic, psychographic, or behavioral information.

9. The method of claim 1 , wherein the communication network is a first communication network, and where the transmitting of the replacement-content request and receiving of the at least one replacement advertisement occur over a second communication network different than the first communication network.

10. The method of claim 1 , further comprising reporting presentation of the at least one replacement advertisement.

11. The method of claim 1 , wherein the control data is watermarked inside of a transport layer.

12. The method of claim 1 , further comprising extracting the watermarked control data from the sequence of media content.

13. The method of claim 1 , wherein the sequence of media content comprises video content, and wherein detecting the watermarked control data in the sequence of media content comprises detecting an adjusted chrominance of a pixel of the sequence of media content.

14. The method of claim 1 , wherein the sequence of media content comprises an audio signal, and wherein the watermarked control data comprises control data watermarked in the audio signal.

15. A media system comprising:

one or more processors;

memory;

a display; and

instructions stored in the memory and executable by the one or more processors to cause the media system to carry out operations including:

receiving a sequence of media content from a media content distributor over a communication network, the sequence of media content including interstitial advertisements, and the sequence of media content being watermarked with control data that includes timing information of when in the sequence of media content at least one replacement advertisement should be presented in place of at least one of the interstitial advertisements, wherein at least a portion of the watermarked control data includes encrypted control data,

outputting the sequence of media content for presentation,

while outputting the sequence of media content for presentation, (i) detecting the watermarked control data in the sequence of media content and (ii) determining, from the detected watermarked control data, the timing information of when in the sequence of media content the at least one replacement advertisement should be presented,

responsive to detecting the watermarked control data in the sequence of media content, transmitting to a content-replacement system a replacement-content request, including in the replacement-content request the encrypted control data without decrypting the encrypted control data,

receiving, in response to the replacement-content request, the at least one replacement advertisement, and

causing the at least one replacement advertisement to be presented in accordance with the determined timing information, in place of content of the sequence of media content.

16. The media system of claim 15 , wherein the timing information comprises a frame count, and wherein causing the at least one replacement advertisement to be presented in accordance with the determined timing information comprises counting frames to determine when to switch from presenting the sequence of media content to presenting the at least one replacement advertisement.

17. The media system of claim 15 , wherein the sequence of media content comprises video content, and wherein detecting the watermarked control data in the sequence of media content comprises detecting an adjusted chrominance of a pixel of the sequence of media content.

18. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of a media system, cause the media system to carry out operations comprising:

receiving a sequence of media content from a media content distributor over a communication network, the sequence of media content including interstitial advertisements, and the sequence of media content being watermarked with control data that includes timing information of when in the sequence of media content at least one replacement advertisement should be presented in place of at least one of the interstitial advertisements, wherein at least a portion of the watermarked control data includes encrypted control data;

outputting the sequence of media content for presentation;

while outputting the sequence of media content for presentation, (i) detecting the watermarked control data in the sequence of media content and (ii) determining, from the detected watermarked control data, the timing information of when in the sequence of media content the at least one replacement advertisement should be presented;

responsive to detecting the watermarked control data in the sequence of media content, transmitting to a content-replacement system a replacement-content request, including in the replacement-content request the encrypted control data without decrypting the encrypted control data;

receiving, in response to the replacement-content request, the at least one replacement advertisement; and

causing the at least one replacement advertisement to be presented in accordance with the determined timing information, in place of content of the sequence of media content.

19. The non-transitory computer-readable storage medium claim 18 , wherein the timing information comprises a frame count, and wherein causing the at least one replacement advertisement to be presented in accordance with the determined timing information comprises counting frames to determine when to switch from presenting the sequence of media content to presenting the at least one replacement advertisement.

20. The non-transitory computer-readable storage medium claim 18 , wherein the sequence of media content comprises video content, and wherein detecting the watermarked control data in the sequence of media content comprises detecting an adjusted chrominance of a pixel of the sequence of media content.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2019
From: GORDON, DONALD F.
To: GRACENOTE, INC.
Reel/Frame 049113/0071 →