IP Library Granted Patent US 11,323,777
Granted Patent B2
US 11,323,777 · App. 17/003,211 · Granted May 3, 2022

Modifying playback of replacement content responsive to detection of remote control signals that control a device providing video to the playback device

Inventors: Kurt R. Thielen (Maple Grove, MN); Shashank Merchant (Sunnyvale, CA); Peter Dunker (Weimar, DE); Markus K. Cremer (Orinda, CA); Chungwon Seo (Seoul, KR); Seunghyeong Lee (Seoul, KR); Steven D. Scherf (Oakland, CA)
Assignee: Roku, Inc.
H04N21/47217H04N9/8715H04N21/4312H04N21/44016H04N21/812H04N21/8146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,323,777
App. No.
17/003,211
Granted
May 3, 2022
Kind
B2
Abstract

In one aspect, an example method includes (i) providing, by a playback device, replacement media content for display; (ii) determining, by the playback device that while the playback device is displaying the replacement media content a remote control transmitted an instruction to a media device that provides media content to the playback device; (iii) determining, by the playback device, a playback-modification action corresponding to the instruction and the media device; and (iv) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.

Claims (53)

1. A method comprising:

providing, by a playback device, replacement media content for display;

while the playback device is displaying the replacement media content, receiving, using a receiver of the playback device, an instruction that a remote control transmitted to a media device, wherein the media device provides media content to the playback device;

determining, by the playback device, an overlay corresponding to the instruction and the media device;

determining, by the playback device, a region within a display of the playback device corresponding to the overlay; and

modifying, by the playback device, a transparency of the region such that the overlay is visible through the replacement media content when the playback device provides the overlay for display.

2. The method of claim 1 , wherein determining the overlay corresponding to the instruction and the media device comprises determining the overlay using correlation data corresponding to the media device that maps instructions to overlays.

3. The method of claim 2 , further comprising:

identifying, by the playback device, the media device; and

obtaining, by the playback device, the correlation data corresponding to the media device.

4. The method of claim 3 , wherein identifying the media device comprises:

determining a plurality of instructions transmitted by the remote control to the media device prior to the instruction; and

identifying the media device based at least on the plurality of instructions.

5. The method of claim 3 , wherein identifying the media device comprises:

generating a fingerprint from a portion of media content received from the media device; and

identifying the media device based at least on the fingerprint.

6. The method of claim 1 , wherein modifying the transparency of the region comprises applying an opacity mask to the region.

7. The method of claim 1 , wherein the instruction comprises an instruction configured to cause a modification to playback of the replacement media content.

8. The method of claim 7 , wherein the instruction comprises a volume adjustment, and wherein the overlay comprises a volume-adjustment graphic.

9. The method of claim 7 , wherein the instruction comprises a playback-speed adjustment, and wherein the overlay comprises a playback-speed graphic.

10. The method of claim 9 , further comprising adjusting a playback speed at which the replacement media content is provided responsive to determining that the remote control transmitted the instruction.

11. The method of claim 1 , wherein the instruction comprises a request to access a channel-selection guide, and wherein the overlay comprises the channel-selection guide.

12. The method of claim 1 , wherein the playback device comprises a television, and wherein providing the replacement media content for display comprises providing the replacement media content for display using a media player.

13. The method of claim 12 , wherein the replacement media content is an advertisement.

14. The method of claim 1 , further comprising determining that the instruction is an unknown instruction,

wherein determining the overlay corresponding to the instruction and the media device comprises:

generating a fingerprint from a portion of media content received from the media device,

determining a playback-modification action corresponding to the unknown instruction using the fingerprint, and

determining an overlay corresponding to the playback-modification action and the media device.

15. A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:

providing replacement media content for display;

while a playback device is displaying the replacement media content, receiving, using a receiver of the playback device, an instruction that a remote control transmitted to a media device, wherein the media device provides media content to the playback device;

determining an overlay corresponding to the instruction and the media device;

determining a region within a display of the playback device corresponding to the overlay; and

modifying a transparency of the region such that the overlay is visible through the replacement media content when the playback device provides the overlay for display.

16. The non-transitory computer-readable medium of claim 15 , wherein determining the overlay corresponding to the instruction and the media device comprises determining the overlay using correlation data corresponding to the media device that maps instructions to overlays.

17. The non-transitory computer-readable medium of claim 16 , wherein the set of acts further comprises:

identifying the media device; and

obtaining the correlation data corresponding to the media device.

18. The non-transitory computer-readable medium of claim 17 , wherein identifying the media device comprises:

determining a plurality of instructions transmitted by the remote control to the media device prior to the instruction; and

identifying the media device based at least on the plurality of instructions.

19. The non-transitory computer-readable medium of claim 17 , wherein identifying the media device comprises:

generating a fingerprint from a portion of media content received from the media device; and

identifying the media device based at least on the fingerprint.

20. A computing system comprising:

one or more processors; and

a non-transitory computer-readable medium having stored therein instructions that are executable to cause the computing system to perform a set of acts comprising:

providing replacement media content for display,

while a playback device is displaying the replacement media content, receiving, using a receiver of the playback device, an instruction that a remote control transmitted to a media device, wherein the media device provides media content to the playback device,

determining an overlay corresponding to the instruction and the media device,

determining a region within a display of the playback device corresponding to the overlay, and

modifying a transparency of the region such that the overlay is visible through the replacement media content when the playback device provides the overlay for display.

Assignments (5)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2020
From: THIELEN, KURT R.; MERCHANT, SHASHANK; DUNKER, PETER; CREMER, MARKUS K.; SEO, CHUNGWON; LEE, SEUNGHYEONG; SCHERF, STEVEN D.
To: GRACENOTE, INC.
Reel/Frame 053603/0388 →
Continuity (3)
Continuation 16181978 · Nov 6, 2018
Provisional Application 62700409 · Jul 19, 2018
Related Publication 20200396513A1 · Dec 17, 2020