IP Library Granted Patent US 11,272,252
Granted Patent B2
US 11,272,252 · App. 16/182,201 · Granted Mar 8, 2022

Modifying playback of replacement content based on control messages

Inventors: Kurt R. Thielen (Maple Grove, MN); Peter Dunker (Weimar, DE); Markus K. Cremer (Orinda, CA); Steven D. Scherf (Oakland, CA); Shashank Merchant (Sunnyvale, CA)
Assignee: Roku, Inc.
H04N21/4622H04N21/23424H04N21/26241H04N21/4316H04N21/4325H04N21/4415H04N21/44016H04N21/44231H04N21/4882
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,272,252
App. No.
16/182,201
Granted
Mar 8, 2022
Kind
B2
Abstract

In one aspect, an example method includes (i) identifying, by a playback device, a media device based on a control message received from the media device by way of an audio and/or video interface, where the media device provides media content to the playback device; (ii) providing, by the playback device, replacement media content for display; (iii) determining, by the playback device, that while the playback device is displaying the replacement media content a remote control transmitted an instruction to the identified media device; (iv) determining, by the playback device, a playback-modification action corresponding to the instruction and the identified media device; and (v) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.

Claims (52)

1. A method comprising:

identifying, by a playback device, a media device based on a control message received from the media device by way of an audio and/or video interface, wherein the media device provides media content to the playback device;

switching, by the playback device, from providing media content received from the identified media device to providing replacement media content, wherein the replacement media content is stored in a database of the playback device;

while the playback device is displaying the replacement media content, receiving, using a receiver of the playback device, an instruction that a remote control of the media device transmitted to the identified media device;

determining, by the playback device, a playback-modification action corresponding to the instruction and the identified media device, wherein determining the playback-modification action corresponding to the instruction and the media device comprises selecting the playback-modification action corresponding to the instruction from among a set of playback-modification actions corresponding to a type of the identified media device; and

modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.

2. The method of claim 1 , further comprising obtaining the set of playback-modification actions corresponding to the type of the identified media device.

3. The method of claim 1 , further comprising:

generating, by the playback device, a fingerprint from a portion of media content received from the media device,

wherein the identifying is further based on the fingerprint.

4. The method of claim 1 , wherein the audio and/or video interface comprises a High-Definition Multimedia Interface (HDMI) interface, and wherein the control message comprises a Consumer Electronics Control (CEC) message.

5. The method of claim 4 :

wherein the CEC message includes a logical address of the media device, the logical address being indicative of a device type of the media device, and

wherein identifying the media device comprises identifying the media device based at least on the logical address of the media device.

6. The method of claim 4 :

wherein the CEC message includes a device vendor identifier (ID) of the media device, the device vendor ID being indicative of a manufacturer of the media device, and

wherein identifying the media device comprises identifying the media device based at least on the device vendor ID of the media device.

7. The method of claim 4 :

wherein the CEC message includes an on-screen display name of the media device, and

wherein identifying the media device comprises identifying the media device based at least on the on-screen display name of the media device.

8. The method of claim 1 , wherein the instruction comprises an instruction configured to cause performance of a channel-change operation, and wherein the playback-modification action comprises causing the display of the replacement media content to cease.

9. The method of claim 1 :

wherein determining the playback-modification action comprises (i) determining an overlay corresponding to the instruction and the identified media device and (ii) determining a region within a display of the playback device corresponding to the overlay, and

wherein modifying playback of the replacement media content comprises modifying a transparency of the region such that the overlay is visible through the replacement media content when the identified media device provides the overlay for display.

10. The method of claim 9 , wherein modifying the transparency of the region comprises applying an opacity mask to the region.

11. The method of claim 1 , wherein the instruction comprises an instruction to access a menu, and wherein the playback-modification action comprises providing the menu within a first region of a display of the playback device and providing the replacement media content within a second region of the display.

12. The method of claim 11 , further comprising determining a template corresponding to the instruction and the identified media device, wherein the template specifies the first region and the second region.

13. The method of claim 12 , further comprising reducing a size of the replacement media content based on a size of the second region.

14. The method of claim 1 , wherein the instruction comprises a playback-speed adjustment, and wherein modifying playback of the replacement media content comprises adjusting a playback speed at which the replacement media content is provided.

15. The method of claim 1 , wherein the playback device comprises a television, and wherein providing the replacement media content for display comprises providing the replacement media content for display using a media player.

16. The method of claim 15 , wherein the replacement media content is an advertisement.

17. The method of claim 1 , wherein:

the instruction is transmitted in accordance with a wireless communication protocol; and

receiving, using the receiver of the playback device, the instruction comprises monitoring, by a decoder of the playback device, wireless communication traffic over a wireless network.

18. The method of claim 1 , wherein receiving, using the receiver of the playback device, the instruction comprises:

receiving, via a wireless communication interface of the playback device, the instruction; and

matching a characteristic of the instruction with a characteristic of a reference instruction.

19. A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:

identifying a media device based on a control message received from the media device by way of an audio and/or video interface, wherein the media device provides media content to a playback device;

switching from providing media content received from the identified media device to providing replacement media content, wherein the replacement media content is stored in a database of the playback device;

while the playback device is displaying the replacement media content, receiving, using a receiver of the playback device, an instruction that a remote control of the media device transmitted to the identified media device;

determining a playback-modification action corresponding to the instruction and the identified media device, wherein determining the playback-modification action corresponding to the instruction and the media device comprises selecting the playback-modification action corresponding to the instruction from among a set of playback-modification actions corresponding to a type of the identified media device; and

modifying playback of the replacement media content in accordance with the playback-modification action.

20. The non-transitory computer-readable medium of claim 19 , wherein the audio and/or video interface comprises a High-Definition Multimedia Interface (HDMI) interface, and wherein the control message comprises a Consumer Electronics Control (CEC) message.

21. A computing system comprising:

one or more processors; and

a non-transitory computer-readable medium having stored therein instructions that are executable to cause the computing system to perform a set of acts comprising:

identifying a media device based on a control message received from the media device by way of an audio and/or video interface, wherein the media device provides media content to a playback device,

switching from providing media content received from the identified media device to providing replacement media content, wherein the replacement media content is stored in a database of the playback device,

while the playback device is displaying the replacement media content, receiving, using a receiver of the playback device, an instruction that a remote control of the media device transmitted to the identified media device,

determining a playback-modification action corresponding to the instruction and the identified media device, wherein determining the playback-modification action corresponding to the instruction and the media device comprises selecting the playback-modification action corresponding to the instruction from among a set of playback-modification actions corresponding to a type of the identified media device, and

modifying playback of the replacement media content in accordance with the playback-modification action.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2018
From: THIELEN, KURT R.; DUNKER, PETER; CREMER, MARKUS K.; SCHERF, STEVEN D.; MERCHANT, SHASHANK
To: GRACENOTE, INC.
Reel/Frame 047426/0109 →