IP Library Granted Patent US 11,245,958
Granted Patent B2
US 11,245,958 · App. 16/433,530 · Granted Feb 8, 2022

Detection of mute and compensation therefor during media replacement event

Inventors: Markus K. Cremer (Orinda, CA); Shashank Merchant (Sunnyvale, CA)
Assignee: Roku, Inc.
H04N21/44016H04N21/4396H04N21/442H04N21/4622H04N21/812G06Q30/0251
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,245,958
App. No.
16/433,530
Granted
Feb 8, 2022
Kind
B2
Abstract

In one aspect, an example method includes (i) presenting, by a playback device, first media content from a first source; (ii) encountering, by the playback device, a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining, by the playback device, that the playback device is presenting the first media content from the first source in a muted state; and (iv) responsive to encountering the trigger, and based on the determining that the playback device is presenting the first media content from the first source in a muted state, presenting, by the playback device, the second media content from the second source in the muted state.

Claims (29)

1. A method comprising:

presenting, by a playback device, media content that is provided to the playback device by a media device, wherein the media device receives the media content from a content source;

encountering, by the playback device, a trigger to replace a replaceable content segment of the media content with a replacement content segment, wherein the replacement content segment is stored in a local cache of the playback device;

detecting, by the playback device, within an audio signal associated with the media content, a silent period having a duration that satisfies a threshold condition;

determining that the silent period is within a threshold time of a time at which the playback device is scheduled to replace the replaceable content segment;

based on detecting the silent period having the duration that satisfies the threshold condition and determining that the silent period is within the threshold time of the time at which the playback device is scheduled to replace the replaceable content segment, determining, by the playback device, that the media device is providing the media content to the playback device in a muted state; and

responsive to encountering the trigger, and based on the determining that the media device is providing the media content to the playback device in the muted state, presenting, by the playback device, the replacement content segment in the muted state and in place of the replaceable content segment.

2. The method of claim 1 , wherein detecting the silent period comprises detecting a silent period having a duration that satisfies a threshold condition after encountering the trigger.

3. The method of claim 1 , wherein the playback device comprises a television, and wherein presenting the replacement content segment comprises presenting a replacement advertisement using a media player.

4. The method of claim 1 , wherein encountering the trigger comprises determining that the playback device is presenting a first segment occurring immediately prior to a second segment, wherein the second segment is designated to be replaced with the replacement content segment.

5. The method of claim 4 , wherein the replaceable content segment is a first advertisement, and wherein the replacement content segment is a second advertisement.

6. The method of claim 1 , wherein presenting the replacement content segment comprises retrieving the replacement content segment from the local cache and displaying the replacement content segment using a media player that is configured to display media files.

7. The method of claim 1 , wherein presenting the replacement content segment comprises presenting the replacement content segment in a media-player layer using a media player, wherein the media-player layer is on top of another layer in which the media content is provided for display.

8. A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:

presenting media content that is provided to a playback device by a media device, wherein the media device receives the media content from a first source;

encountering a trigger to replace a replaceable content segment of the media content with a replacement content segment, wherein the replacement content segment is stored in a local cache of the playback device;

detecting, within an audio signal associated with the media content, a silent period having a duration that satisfies a threshold condition;

determining that the silent period is within a threshold time of a time at which the playback device is scheduled to replace the replaceable content segment;

based on detecting the silent period having the duration that satisfies the threshold condition and determining that the silent period is within the threshold time of the time at which the playback device is scheduled to replace the replaceable content segment, determining that the media device is providing the media content to the playback device in a muted state; and

responsive to encountering the trigger, and based on the determining that the media device is providing the media content to the playback device in the muted state, presenting the replacement content segment in the muted state and in place of the replaceable content segment.

9. The non-transitory computer-readable medium of claim 8 , wherein detecting the silent period comprises detecting a silent period having a duration that satisfies a threshold condition after encountering the trigger.

10. The non-transitory computer-readable medium of claim 8 , wherein presenting the media content comprises presenting the media content using a television, and wherein presenting the replacement content segment comprises presenting a replacement advertisement using a media player.

11. A computing system configured for performing a set of acts comprising:

presenting media content that is provided to a playback device by a media device, wherein the media device receives the media content from a first source;

encountering a trigger to replace a replaceable content segment of the media content with a replacement content segment, wherein the replacement content segment is stored in a local cache of the playback device;

detecting, within an audio signal associated with the media content, a silent period having a duration that satisfies a threshold condition;

determining that the silent period is within a threshold time of a time at which the playback device is scheduled to replace the replaceable content segment;

based on detecting the silent period having the duration that satisfies the threshold condition and determining that the silent period is within the threshold time of the time at which the playback device is scheduled to replace the replaceable content segment, determining that the media device is providing the media content to the playback device in a muted state; and

responsive to encountering the trigger, and based on the determining that the media device is providing the media content to the playback device in the muted state, presenting the replacement content segment in the muted state and in place of the replaceable content segment.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2019
From: CREMER, MARKUS K.; MERCHANT, SHASHANK
To: GRACENOTE, INC.
Reel/Frame 049396/0455 →
Cited By (1)
US 12,309,452