IP Library Granted Patent US 9,015,741
Granted Patent B2
US 9,015,741 · App. 12/760,004 · Granted Apr 21, 2015

Method and system for remotely controlling consumer electronic devices

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,015,741
App. No.
12/760,004
Granted
Apr 21, 2015
Kind
B2
Abstract

A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.

Claims (68)

1. A computer-implemented method for replacing a portion of a first sequence of media content with replacement media content at a media system, the method comprising:

receiving at the media system, the first sequence of media content from a media content distributor over a first communication network;

presenting the first sequence of media content to an end-user of the media system;

generating a fingerprint of the first sequence of media content, wherein the fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content;

sending a request for a replacement sequence of content to a content replacement system over a second communication network that is distinct from the first communication network, wherein the request is based at least in part on the fingerprint of the first sequence of media content;

receiving, at the media system, a response to the request, the response including the replacement media content, wherein the replacement media content is selected based at least in part on the identified first sequence of media content; and

presenting the replacement media content to the end-user of the media system instead of the portion of the first sequence of media content, wherein the presenting of the replacement media content begins at an offset position in the first sequence of media content relative to the reference position within the first sequence of which the fingerprint is generated.

2. The method of claim 1 , wherein the media system is a consumer electronic device of the end-user.

3. The method of claim 1 , wherein the plurality of reference fingerprints are predetermined fingerprints.

4. The method of claim 1 , wherein:

the first sequence of media content is a sequence of video content including video content requested by the end-user and replaceable advertisement video content; and

the replacement media content is a sequence of video content including one or more replacement advertisements.

5. The method of claim 4 , wherein identifying the first sequence of media content includes identifying a channel and a timestamp for the first sequence of media content.

6. The method of claim 1 , further comprising:

prior to generating the fingerprint, receiving, from the content replacement system, at least a subset of the reference fingerprints selected from the plurality of reference fingerprints; and

after generating the fingerprint, comparing the fingerprint to respective reference fingerprints of the subset of reference fingerprints; and

if a respective reference fingerprint of the subset of reference fingerprints matches the fingerprint, the request for a replacement sequence of content includes data indicating that the fingerprint matches the respective reference fingerprint; and

if the fingerprint does not match any of the respective reference fingerprints of the subset of reference fingerprints, the request for a replacement sequence of content includes the fingerprint, for comparison with additional reference fingerprints at the content replacement system.

7. The method of claim 6 , wherein the subset of reference fingerprints are selected from the plurality of reference fingerprints based on usage data.

8. The method of claim 1 , wherein the fingerprint is determined using luminance sampling.

9. The method of claim 8 , wherein the fingerprint is determined based on values sampled from multiple predefined positions in a single frame in the sequence of media content.

10. The method of claim 8 , wherein the fingerprint is determined based on values sampled from a predefined position in a plurality of sequentially displayed frames in the sequence of media content.

11. The method of claim 1 , wherein:

the first sequence of media content includes an advertisement on a television channel;

the replacement media content is targeted advertisement; and

the targeted advertisement is selected based at least in part on information selected from the list consisting of: demographic, psychographic, and behavioral information of the end-user of the media system.

12. The method of claim 1 , further comprising:

while presenting the replacement media content to the end-user, receiving a request for a second sequence of media content;

in response to the request for the second sequence of media content:

ceasing to present the replacement media content; and

presenting the second sequence of media content to the end-user.

13. The method of claim 12 , further comprising, while presenting the second sequence of media content to the end-user:

continuing to advance the replacement media content;

receiving a request for the first sequence of media content; and

in response to the request for the first sequence of media content:

if the replacement media content is still advancing, presenting the replacement media content; and

if the replacement media content has reached an end of the replacement media content, presenting the first sequence of media content to the end-user.

14. The method of claim 1 , wherein the replacement media content is selected at the content replacement system in accordance with predefined criteria.

15. The method of claim 14 , wherein the predefined criteria includes information about a provider of the replacement media content, including information selected from the list consisting of: advertiser identifier, and campaign identifier.

16. The method of claim 14 , wherein predefined criteria includes information about the end-user of the media system.

17. The method of claim 16 , wherein the information about the end-user of the media system is provided by an entity selected from the list consisting of: a content provider, a content distributor; a manufacturer of the media system, and a service provider to the end-user of the media system.

18. The method of claim 1 , wherein:

receiving the first sequence of media content includes receiving one or more television channels over a managed data network from a content distributor, the content distributor including an entity selected from the list consisting of: a satellite network, radio frequency broadcast network, internet protocol television provider, and a cable network.

19. The method of claim 1 , wherein sending the request to the content replacement system includes sending the request over an unmanaged data network.

20. The method of claim 1 , wherein receiving replacement media content includes receiving the replacement media content as a stream over an unmanaged data network.

21. The method of claim 1 , wherein the replacement media content has an end, and the method further comprises:

detecting the end of the replacement media content while presenting the replacement media content;

ceasing to present the replacement media content; and

presenting the first sequence of media content.

22. The method of claim 1 , wherein the offset position within the first sequence of media content indicates a first frame of media content; and

the reference position within the first sequence of media content indicates a second frame of media content at which the fingerprint is generated, the second frame being separated from the first frame by a quantity of frames of media content.

23. A media system, comprising:

one or more processors;

memory; and

one or more programs stored in the memory, the one or more programs comprising instructions to:

receive at the media system, the first sequence of media content from a media content distributor over a first communication network;

present the first sequence of media content to an end-user of the media system;

generate a fingerprint of the first sequence of media content, wherein the fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content;

send a request for a replacement sequence of content to a content replacement system over a second communication network that is distinct from the first communication network, wherein the request is based at least in part on the fingerprint of the first sequence of media content;

receive, at the media system, a response to the request, the response including the replacement media content, wherein the replacement media content is selected based at least in part on the identified first sequence of media content; and

present the replacement media content to the end-user of the media system instead of a portion of the first sequence of media content, wherein the presenting of the replacement media content begins at an offset position in the first sequence of media content relative to the reference position within the first sequence of which the fingerprint is generated.

24. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs configuring the computer to perform operations comprising:

receiving at the media system, the first sequence of media content from a media content distributor over a first communication network;

presenting the first sequence of media content to an end-user of the media system;

generating a fingerprint of the first sequence of media content, wherein the fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content;

a request for a replacement sequence of content to a content replacement system over a second communication network that is distinct from the first communication network, wherein the request is based at least in part on the fingerprint of the first sequence of media content;

receiving, at the media system, a response to the request, the response including the replacement media content, wherein the replacement media content is selected based at least in part on the identified first sequence of media content; and

presenting the replacement media content to the end-user of the media system instead of a portion of the first sequence of media content, wherein the presenting of the replacement media content begins at an offset position in the first sequence of media content relative to the reference position within the first sequence of which the fingerprint is generated.

Assignments (14)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
RELEASE (REEL 042262 / FRAME 0601) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC
Reel/Frame 061748/0001 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Apr 13, 2017
From: GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE DIGITAL VENTURES, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042262/0601 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Feb 8, 2017
From: JPMORGAN CHASE BANK, N.A.
To: GRACENOTE, INC.; CASTTV INC.; TRIBUNE MEDIA SERVICES, LLC; TRIBUNE DIGITAL VENTURES, LLC
Reel/Frame 041656/0804 →
SECURITY AGREEMENT Recorded Aug 14, 2015
From: GRACENOTE, INC.; TRIBUNE BROADCASTING COMPANY, LLC
To: JPMORGAN CHASE BANK, N.A., AS AGENT
Reel/Frame 036354/0902 →
SECURITY INTEREST Recorded Mar 19, 2014
From: GRACENOTE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 032480/0272 →