IP Library Granted Patent US 10,972,766
Granted Patent B2
US 10,972,766 · App. 16/775,126 · Granted Apr 6, 2021

Method and system for remotely controlling consumer electronic device

Inventor: Donald F. Gordon (Morgan Hills, CA)
Assignee: Gracenote, Inc.
H04N21/23424H04N7/17318H04N21/20H04N21/21H04N21/23H04N21/234H04N21/235H04N21/2347H04N21/23418H04N21/23439H04N21/24H04N21/25H04N21/251H04N21/2543H04N21/25883H04N21/2668H04N21/44H04N21/442H04N21/4405H04N21/44008H04N21/44016H04N21/44204H04N21/44213H04N21/44222H04N21/4722H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,972,766
App. No.
16/775,126
Granted
Apr 6, 2021
Kind
B2
Abstract

A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.

Claims (72)

1. A method for use in connection with a client device that is configured to present media content sequences, the method comprising:

receiving, by the client device, one or more reference fingerprints, wherein the one or more reference fingerprints is associated with channel data for a particular channel;

receiving, by the client device, one or more media content sequences;

generating, by the client device, one or more fingerprints of the received one or more media content sequences;

detecting a match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints; and

responsive to detecting the match, sending, by the client device, to one or more server devices, a message that comprises the channel data.

2. The method of claim 1 , wherein the client device is a television and the media content sequences are video content sequences.

3. The method of claim 1 , wherein the channel data comprises data identifying the particular channel.

4. The method of claim 1 , wherein the channel data comprises a timestamp of the particular channel.

5. The method of claim 1 , wherein the message further comprises a request for a replacement media content sequence.

6. The method of claim 5 , further comprising:

receiving, by the client device, the replacement media content sequence, wherein the replacement media content sequence is sent to the client device by the one or more server devices responsive to the one or more server devices detecting a match between (i) the generated one or more fingerprints and (ii) one or more reference fingerprints stored in association with the one or more server devices, and wherein the replacement media content sequence is selected by the one or more server devices based on the channel data; and

performing an action that facilitates presenting the replacement media content sequence in place of at least a portion of the received one or more media content sequences.

7. The method of claim 6 , wherein the request for the replacement media content sequence comprises the one or more fingerprints generated by the client device.

8. The method of claim 6 , wherein the request for the replacement media content sequence comprises an indication that the client device detected the match.

9. The method of claim 6 , wherein the at least a portion of the received one or more media content sequences is an original commercial and the replacement media content sequence is a replacement commercial.

10. The method of claim 1 , wherein the operation of receiving the one or more reference fingerprints occurs before the operation of generating the one or more fingerprints.

11. The method of claim 1 , further comprising:

storing, by the client device, in a local storage of the client device, the received one or more reference fingerprints.

12. The method of claim 1 , further comprising:

before generating the one or more fingerprints, generating an additional one or more fingerprints of the received one or more media content sequences; and

before detecting the match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints, detecting a match between (i) the received one or more reference fingerprints and (ii) the generated additional one or more fingerprints.

13. The method of claim 1 , wherein the particular channel is different from a former channel that the client device previously determined that it was tuned to based on one or more additional reference fingerprints received by the client device.

14. The method of claim 13 , wherein the message comprises an indication that the client device changed from being tuned to the former channel to being tuned to the particular channel.

15. A client device comprising one or more processors, wherein the client device is configured to perform operations comprising:

receiving, by the client device, one or more reference fingerprints, wherein the one or more reference fingerprints is associated with channel data for a particular channel;

receiving, by the client device, one or more media content sequences;

generating, by the client device, one or more fingerprints of the received one or more media content sequences;

detecting a match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints; and

responsive to detecting the match, sending, by the client device, to one or more server devices, a message that comprises the channel data.

16. The client device of claim 15 , wherein the client device is a television and all the media content sequences are video content sequences.

17. The client device of claim 15 , wherein the channel data comprises data identifying the particular channel.

18. The client device of claim 15 , wherein the channel data comprises a timestamp of the particular channel.

19. The client device of claim 15 , wherein the message further comprises a request for a replacement media content sequence.

20. The client device of claim 19 , wherein the operations further comprise:

receiving, by the client device, the replacement media content sequence, wherein the replacement media content sequence is sent to the client device by the one or more server devices responsive to the one or more server devices detecting a match between (i) the generated one or more fingerprints and (ii) one or more reference fingerprints stored in association with the one or more server devices, and wherein the replacement media content sequence is selected by the one or more server devices based on the channel data; and

performing an action that facilitates presenting the replacement media content sequence in place of at least a portion of the received one or more media content sequences.

21. The client device of claim 20 , wherein the request for the replacement media content sequence comprises the one or more fingerprints generated by the client device.

22. The client device of claim 20 , wherein the request for the replacement media content sequence comprises an indication that the client device detected the match.

23. The client device of claim 20 , wherein the at least a portion of the received one or more media content sequences is an original commercial and the replacement media content sequence is a replacement commercial.

24. The client device of claim 15 , wherein the operation of receiving the one or more reference fingerprints occurs before the operation of generating the one or more fingerprints.

25. The client device of claim 15 , wherein the operations further comprise:

storing, by the client device, in a local storage of the client device, the received one or more reference fingerprints.

26. The client device of claim 15 , wherein the operations further comprise:

before generating the one or more fingerprints, generating an additional one or more fingerprints of the received one or more media content sequences; and

before detecting the match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints, detecting a match between (i) the received one or more reference fingerprints and (ii) the generated additional one or more fingerprints.

27. The client device of claim 15 , wherein the particular channel is different from a former channel that the client device previously determined that it was tuned to based on one or more additional reference fingerprints received by the client device.

28. The client device of claim 27 , wherein the message comprises an indication that the client device changed from being tuned to the former channel to being tuned to the particular channel.

29. A non-transitory computer-readable storage medium having stored thereon program instructions that when executed by a client device having one or more processors, cause the client device to perform operations comprising:

receiving, by the client device, one or more reference fingerprints, wherein the one or more reference fingerprints is associated with channel data for a particular channel;

receiving, by the client device, one or more media content sequences;

generating, by the client device, one or more fingerprints of the received one or more media content sequences;

detecting a match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints; and

responsive to detecting the match, sending, by the client device, to one or more server devices, a message that comprises the channel data.

30. The non-transitory computer-readable storage medium of claim 29 , wherein the client device is a television and the media content sequences are video content sequences.

31. The non-transitory computer-readable storage medium of claim 29 , wherein the channel data comprises data identifying the particular channel.

32. The non-transitory computer-readable storage medium of claim 29 , wherein the channel data comprises a timestamp of the particular channel.

33. The non-transitory computer-readable storage medium of claim 29 , wherein the message further comprises a request for a replacement media content sequence.

34. The non-transitory computer-readable storage medium of claim 33 , wherein the operations further comprise:

receiving, by the client device, the replacement media content sequence, wherein the replacement media content sequence is sent to the client device by the one or more server devices responsive to the one or more server devices detecting a match between (i) the generated one or more fingerprints and (ii) one or more reference fingerprints stored in association with the one or more server devices, and wherein the replacement media content sequence is selected by the one or more server devices based on the channel data; and

performing an action that facilitates presenting the replacement media content sequence in place of at least a portion of the received one or more media content sequences.

35. The non-transitory computer-readable storage medium of claim 34 , wherein the request for the replacement media content sequence comprises the one or more fingerprints generated by the client device.

36. The non-transitory computer-readable storage medium of claim 34 , wherein the request for the replacement media content sequence comprises an indication that the client device detected the match.

37. The non-transitory computer-readable storage medium of claim 34 , wherein the at least a portion of the received one or more media content sequences is an original commercial and the replacement media content sequence is a replacement commercial.

38. The non-transitory computer-readable storage medium of claim 29 , wherein the operation of receiving the one or more reference fingerprints occurs before the operation of generating the one or more fingerprints.

39. The non-transitory computer-readable storage medium of claim 29 , wherein the operations further comprise:

storing, by the client device, in a local storage of the client device, the received one or more reference fingerprints.

40. The non-transitory computer-readable storage medium of claim 29 , wherein the operations further comprise:

before generating the one or more fingerprints, generating an additional one or more fingerprints of the received one or more media content sequences; and

before detecting the match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints, detecting a match between (i) the received one or more reference fingerprints and (ii) the generated additional one or more fingerprints.

41. The non-transitory computer-readable storage medium of claim 29 , wherein the particular channel is different from a former channel that the client device previously determined that it was tuned to based on one or more additional reference fingerprints received by the client device.

42. The non-transitory computer-readable storage medium of claim 41 , wherein the message comprises an indication that the client device changed from being tuned to the former channel to being tuned to the particular channel.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2020
From: GORDON, DONALD F
To: GRACENOTE, INC.
Reel/Frame 051825/0722 →