IP Library Granted Patent US 10,979,742
Granted Patent B2
US 10,979,742 · App. 16/390,595 · Granted Apr 13, 2021

Method and system for remotely controlling consumer electronic device

Inventor: Donald F. Gordon (Morgan Hills, CA)
Assignee: Gracenote, Inc.
H04N21/23424H04N7/17318H04N21/20H04N21/21H04N21/23H04N21/234H04N21/235H04N21/2347H04N21/23418H04N21/23439H04N21/24H04N21/25H04N21/251H04N21/2543H04N21/25883H04N21/2668H04N21/44H04N21/442H04N21/4405H04N21/44008H04N21/44016H04N21/44204H04N21/44213H04N21/44222H04N21/4722H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,979,742
App. No.
16/390,595
Granted
Apr 13, 2021
Kind
B2
Abstract

A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.

Claims (66)

1. A method comprising:

receiving usage data for a client device that is configured to present media content sequences;

based on the received usage data, selecting, from among a plurality of reference fingerprints, a subset of reference fingerprints;

sending to the client device, the selected subset of reference fingerprints;

receiving from the client device, an indication that the client device has detected a match between (i) one of more of the selected subset of reference fingerprints, and (ii) one or more fingerprints generated by the client device; and

determining, based on the received indication from the client device, an identity of a media sequence being presented on the client device.

2. The method of claim 1 , wherein the usage data indicates a state change of a content selector module of the client device.

3. The method of claim 1 , wherein the usage data indicates information about one or more replacement media sequences sent to the client device.

4. The method of claim 1 , wherein the usage data indicates that the client device is routinely tuned to a subset of multiple channels from among a plurality of channels, and wherein selecting the subset of reference fingerprints comprises selecting a subset of reference fingerprints that corresponds to the subset of multiple channels.

5. The method of claim 1 , wherein selecting the subset of reference fingerprints comprises:

selecting, based on the received usage data, a subset of multiple channels from among a plurality of channels, each of the plurality of channels having corresponding reference fingerprints, and

selecting the subset of reference fingerprints that correspond to the selected subset of multiple channels.

6. The method of claim 1 , wherein the client device is a television and the media content sequences are video content sequences.

7. The method of claim 1 , further comprising performing the recited operations in connection with each of multiple different client devices and wherein a different subset of reference fingerprints is sent to each of the multiple client devices.

8. The method of claim 1 , further comprising:

receiving from the client device, a request for a replacement media content sequence, wherein the request was generated by the client device in response to the client device detecting the match between (i) the one or more reference fingerprints in the subset of reference fingerprints and (ii) the one or more fingerprints generated by the client device;

responsive to receiving the request from the client device, selecting a replacement media content sequence; and

performing an action that facilitates causing the client device to present the selected replacement media content sequence in place of an original media content sequence.

9. The method of claim 8 , wherein the request for the replacement media content sequence comprises the one or more fingerprints generated by the client device.

10. The method of claim 8 , wherein the request for the replacement media content sequence comprises an indication that the client device detected the match.

11. The method of claim 8 , wherein the action comprises sending the selected replacement media content sequence to the client device.

12. The method of claim 8 , wherein the original media content sequence is an original commercial and the replacement media content sequence is a replacement commercial.

13. A server device comprising one or more processors, wherein the server device is configured to perform operations comprising:

receiving usage data for a client device that is configured to present media content sequences;

based on the received usage data, selecting, from among a plurality of reference fingerprints, a subset of reference fingerprints;

sending to the client device, the selected subset of reference fingerprints;

receiving from the client device, an indication that the client device has detected a match between (i) one of more of the selected subset of reference fingerprints, and (ii) one or more fingerprints generated by the client device; and

determining, based on the received indication from the client device, an identity of a media sequence being presented on the client device.

14. The server device of claim 13 , wherein the usage data indicates a state change of a content selector module of the client device.

15. The server device of claim 13 , wherein the usage data indicates information about one or more replacement media sequences sent to the client device.

16. The server device of claim 13 , wherein the usage data indicates that the client device is routinely tuned to a subset of multiple channels from among a plurality of channels, and wherein selecting the subset of reference fingerprints comprises selecting a subset of reference fingerprints that corresponds to the subset of multiple channels.

17. The server device of claim 13 , wherein selecting the subset of reference fingerprints comprises:

selecting, based on the received usage data, a subset of multiple channels from among a plurality of channels, each of the plurality of channels having corresponding reference fingerprints, and

selecting the subset of reference fingerprints that correspond to the selected subset of multiple channels.

18. The server device of claim 13 , wherein the client device is a television and the media content sequences are video content sequences.

19. The server device of claim 13 , wherein the operations further comprise performing the recited operations in connection with each of multiple different client devices and wherein a different subset of reference fingerprints is sent to each of the multiple client devices.

20. The server device of claim 13 , wherein the operations further comprise:

receiving from the client device, a request for a replacement media content sequence, wherein the request was generated by the client device in response to the client device detecting the match between (i) the one or more reference fingerprints in the subset of reference fingerprints and (ii) the one or more fingerprints generated by the client device;

responsive to receiving the request from the client device, selecting a replacement media content sequence; and

performing an action that facilitates causing the client device to present the selected replacement media content sequence in place of an original media content sequence.

21. The server device of claim 20 , wherein the request for the replacement media content sequence comprises the one or more fingerprints generated by the client device.

22. The server device of claim 20 , wherein the request for the replacement media content sequence comprises an indication that the client device detected the match.

23. The server device of claim 20 , wherein the action comprises sending the selected replacement media content sequence to the client device.

24. The server device of claim 20 , wherein the original media content sequence is an original commercial and the replacement media content sequence is a replacement commercial.

25. A non-transitory computer-readable storage medium having stored thereon program instructions that when executed by a server device having one or more processors, cause the server device to perform operations comprising:

receiving usage data for a client device that is configured to present media content sequences;

based on the received usage data, selecting, from among a plurality of reference fingerprints, a subset of reference fingerprints;

sending to the client device, the selected subset of reference fingerprints;

receiving from the client device, an indication that the client device has detected a match between (i) one of more of the selected subset of reference fingerprints, and (ii) one or more fingerprints generated by the client device; and

determining, based on the received indication from the client device, an identity of a media sequence being presented on the client device.

26. The non-transitory computer-readable storage medium of claim 25 , wherein the usage data indicates a state change of a content selector module of the client device.

27. The non-transitory computer-readable storage medium of claim 25 , wherein the usage data indicates information about one or more replacement media sequences sent to the client device.

28. The non-transitory computer-readable storage medium of claim 25 , wherein the usage data indicates that the client device is routinely tuned to a subset of multiple channels from among a plurality of channels, and wherein selecting the subset of reference fingerprints comprises selecting a subset of reference fingerprints that corresponds to the subset of multiple channels.

29. The non-transitory computer-readable storage medium of claim 25 , wherein selecting the subset of reference fingerprints comprises:

selecting, based on the received usage data, a subset of multiple channels from among a plurality of channels, each of the plurality of channels having corresponding reference fingerprints, and

selecting the subset of reference fingerprints that correspond to the selected subset of multiple channels.

30. The non-transitory computer-readable storage medium of claim 25 , wherein the client device is a television and the media content sequences are video content sequences.

31. The non-transitory computer-readable storage medium of claim 25 , wherein the operations further comprise performing the recited operations in connection with each of multiple different client devices and wherein a different subset of reference fingerprints is sent to each of the multiple client devices.

32. The non-transitory computer-readable storage medium of claim 25 , wherein the operations further comprise:

receiving from the client device, a request for a replacement media content sequence, wherein the request was generated by the client device in response to the client device detecting the match between (i) the one or more reference fingerprints in the subset of reference fingerprints and (ii) the one or more fingerprints generated by the client device;

responsive to receiving the request from the client device, selecting a replacement media content sequence; and

performing an action that facilitates causing the client device to present the selected replacement media content sequence in place of an original media content sequence.

33. The non-transitory computer-readable storage medium of claim 32 , wherein the request for the replacement media content sequence comprises the one or more fingerprints generated by the client device.

34. The non-transitory computer-readable storage medium of claim 32 , wherein the request for the replacement media content sequence comprises an indication that the client device detected the match.

35. The non-transitory computer-readable storage medium of claim 32 , wherein the action comprises sending the selected replacement media content sequence to the client device.

36. The non-transitory computer-readable storage medium of claim 32 , wherein the original media content sequence is an original commercial and the replacement media content sequence is a replacement commercial.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 25, 2019
From: GORDON, DONALD F.
To: GRACENOTE, INC.
Reel/Frame 048995/0941 →