IP Library Granted Patent US 11,611,783
Granted Patent B2
US 11,611,783 · App. 16/942,711 · Granted Mar 21, 2023

Method and system for remotely controlling consumer electronic device

Inventor: Donald F. Gordon (Morgan Hills, CA)
Assignee: Roku, Inc.
H04N21/23424H04N7/17318H04N21/20H04N21/21H04N21/23H04N21/234H04N21/235H04N21/2347H04N21/23418H04N21/23439H04N21/24H04N21/25H04N21/251H04N21/2543H04N21/25883H04N21/2668H04N21/44H04N21/442H04N21/4405H04N21/44008H04N21/44016H04N21/44204H04N21/44213H04N21/44222H04N21/44224H04N21/4722H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,611,783
App. No.
16/942,711
Granted
Mar 21, 2023
Kind
B2
Abstract

A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.

Claims (69)

1. A method for use in connection with a client device that is configured to present media content sequences, the method comprising:

receiving, by the client device, one or more reference fingerprints, wherein the one or more reference fingerprints are associated with channel data for a particular channel, and wherein the one or more reference fingerprints were selected based on a usage history of the client device;

receiving, by the client device, one or more media content sequences;

generating, by the client device, one or more fingerprints of the received one or more media content sequences;

detecting a match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints; and

responsive to detecting the match, sending, by the client device, to one or more server devices, a message that comprises the channel data associated with the particular channel, wherein the particular channel is different from a former channel that a device previously determined, based on a fingerprint comparison, that the client was tuned to.

2. The method of claim 1 , wherein the client device is a television and the media content sequences are video content sequences.

3. The method of claim 1 , wherein the channel data comprises data identifying the particular channel.

4. The method of claim 1 , wherein the channel data comprises a timestamp of the particular channel.

5. The method of claim 1 , wherein the message further comprises a request for a replacement media content sequence.

6. The method of claim 5 , further comprising:

receiving, by the client device, the replacement media content sequence, wherein the replacement media content sequence is sent to the client device by the one or more server devices responsive to the one or more server devices detecting a match between (i) the generated one or more fingerprints and (ii) one or more reference fingerprints stored in association with the one or more server devices, and wherein the replacement media content sequence is selected by the one or more server devices based on the channel data; and

performing an action that facilitates presenting the replacement media content sequence in place of at least a portion of the received one or more media content sequences.

7. The method of claim 6 , wherein the request for the replacement media content sequence comprises the one or more fingerprints generated by the client device.

8. The method of claim 6 , wherein the request for the replacement media content sequence comprises an indication that the client device detected the match.

9. The method of claim 6 , wherein the at least the portion of the received one or more media content sequences is an original commercial and the replacement media content sequence is a replacement commercial.

10. The method of claim 1 , wherein the receiving the one or more reference fingerprints occurs before the generating the one or more fingerprints.

11. The method of claim 1 , further comprising:

storing, by the client device, in a local storage of the client device, the received one or more reference fingerprints.

12. The method of claim 1 , further comprising:

before generating the one or more fingerprints, generating an additional one or more fingerprints of the received one or more media content sequences; and

before detecting the match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints, detecting a match between (i) the received one or more reference fingerprints and (ii) the generated additional one or more fingerprints.

13. The method of claim 1 , wherein the message comprises an indication that the client device changed from being tuned to a former channel to being tuned to the particular channel.

14. A client device comprising one or more processors, wherein the client device is configured to perform operations comprising:

receiving one or more reference fingerprints, wherein the one or more reference fingerprints are associated with channel data for a particular channel, and wherein the one or more reference fingerprints were selected based on a usage history of the client device;

receiving one or more media content sequences;

generating one or more fingerprints of the received one or more media content sequences;

detecting a match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints; and

responsive to detecting the match, sending, to one or more server devices, a message that comprises the channel data associated with the particular channel, wherein the particular channel is different from a former channel that a device previously determined, based on a fingerprint comparison, that the client was tuned to.

15. The client device of claim 14 , wherein the client device is a television and the media content sequences are video content sequences.

16. The client device of claim 14 , wherein the channel data comprises data identifying the particular channel.

17. The client device of claim 14 , wherein the channel data comprises a timestamp of the particular channel.

18. The client device of claim 14 , wherein the message further comprises a request for a replacement media content sequence.

19. The client device of claim 18 , wherein the operations further comprise:

receiving the replacement media content sequence, wherein the replacement media content sequence is sent to the client device by the one or more server devices responsive to the one or more server devices detecting a match between (i) the generated one or more fingerprints and (ii) one or more reference fingerprints stored in association with the one or more server devices, and wherein the replacement media content sequence is selected by the one or more server devices based on the channel data; and

performing an action that facilitates presenting the replacement media content sequence in place of at least a portion of the received one or more media content sequences.

20. The client device of claim 19 , wherein the request for the replacement media content sequence comprises the one or more fingerprints generated by the client device.

21. The client device of claim 19 , wherein the request for the replacement media content sequence comprises an indication that the client device detected the match.

22. The client device of claim 19 , wherein the at least the portion of the received one or more media content sequences is an original commercial and the replacement media content sequence is a replacement commercial.

23. The client device of claim 14 , wherein the operation of receiving the one or more reference fingerprints occurs before the operation of generating the one or more fingerprints.

24. The client device of claim 14 , wherein the operations further comprise:

storing in a local storage of the client device, the received one or more reference fingerprints.

25. The client device of claim 14 , wherein the operations further comprise:

before generating the one or more fingerprints, generating an additional one or more fingerprints of the received one or more media content sequences; and

before detecting the match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints, detecting a match between (i) the received one or more reference fingerprints and (ii) the generated additional one or more fingerprints.

26. The client device of claim 14 , wherein the message comprises an indication that the client device changed from being tuned to a former channel to being tuned to the particular channel.

27. A non-transitory computer-readable storage medium having stored thereon program instructions that when executed by a client device having one or more processors, cause the client device to perform operations comprising:

receiving one or more reference fingerprints, wherein the one or more reference fingerprints are associated with channel data for a particular channel, and wherein the one or more reference fingerprints were selected based on a usage history of the client device,

receiving one or more media content sequences;

generating one or more fingerprints of the received one or more media content sequences;

detecting a match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints; and

responsive to detecting the match, sending to one or more server devices, a message that comprises the channel data associated with the particular channel, wherein the particular channel is different from a former channel that a device previously determined, based on a fingerprint comparison, that the client was tuned to.

28. The non-transitory computer-readable storage medium of claim 27 , wherein the client device is a television and the media content sequences are video content sequences.

29. The non-transitory computer-readable storage medium of claim 27 , wherein the channel data comprises data identifying the particular channel.

30. The non-transitory computer-readable storage medium of claim 27 , wherein the channel data comprises a timestamp of the particular channel.

31. The non-transitory computer-readable storage medium of claim 27 , wherein the message further comprises a request for a replacement media content sequence.

32. The non-transitory computer-readable storage medium of claim 31 , wherein the operations further comprise:

receiving the replacement media content sequence, wherein the replacement media content sequence is sent to the client device by the one or more server devices responsive to the one or more server devices detecting a match between (i) the generated one or more fingerprints and (ii) one or more reference fingerprints stored in association with the one or more server devices, and wherein the replacement media content sequence is selected by the one or more server devices based on the channel data; and

performing an action that facilitates presenting the replacement media content sequence in place of at least a portion of the received one or more media content sequences.

33. The non-transitory computer-readable storage medium of claim 32 , wherein the request for the replacement media content sequence comprises the one or more fingerprints generated by the client device.

34. The non-transitory computer-readable storage medium of claim 32 , wherein the request for the replacement media content sequence comprises an indication that the client device detected the match.

35. The non-transitory computer-readable storage medium of claim 32 , wherein the at least the portion of the received one or more media content sequences is an original commercial and the replacement media content sequence is a replacement commercial.

36. The non-transitory computer-readable storage medium of claim 27 , wherein the operation of receiving the one or more reference fingerprints occurs before the operation of generating the one or more fingerprints.

37. The non-transitory computer-readable storage medium of claim 27 , wherein the operations further comprise:

storing, in a local storage of the client device, the received one or more reference fingerprints.

38. The non-transitory computer-readable storage medium of claim 27 , wherein the operations further comprise:

before generating the one or more fingerprints, generating an additional one or more fingerprints of the received one or more media content sequences; and

before detecting the match between (i) the received one or more reference fingerprints and (ii) the generated one or more fingerprints, detecting a match between (i) the received one or more reference fingerprints and (ii) the generated additional one or more fingerprints.

39. The non-transitory computer-readable storage medium of claim 27 , wherein the message comprises an indication that the client device changed from being tuned to a former channel to being tuned to the particular channel.

Assignments (5)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2020
From: GORDON, DONALD F.
To: GRACENOTE, INC.
Reel/Frame 053376/0986 →
Continuity (10)
Continuation 16390631 · Apr 22, 2019
Continuation 16018050 · Jun 26, 2018
Continuation 15614566 · Jun 5, 2017
Continuation 15292705 · Oct 13, 2016
Continuation 15287116 · Oct 6, 2016
Continuation 14659971 · Mar 17, 2015
Continuation 12760004 · Apr 14, 2010
Provisional Application 61293798 · Jan 11, 2010
Provisional Application 61170586 · Apr 17, 2009
Related Publication 20200366945A1 · Nov 19, 2020