IP Library Granted Patent US 11,317,144
Granted Patent B2
US 11,317,144 · App. 16/847,532 · Granted Apr 26, 2022

Detection of mute and compensation therefor during media replacement event

Inventors: Markus K. Cremer (Orinda, CA); Shashank Merchant (Sunnyvale, CA)
Assignee: Roku, Inc.
H04N21/44016H04N21/4396H04N21/442H04N21/4622H04N21/812G06Q30/0251
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,317,144
App. No.
16/847,532
Granted
Apr 26, 2022
Kind
B2
Abstract

In one aspect, an example method includes (i) presenting, by a playback device, first media content from a first source; (ii) encountering, by the playback device, a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining, by the playback device, that the playback device is presenting the first media content from the first source in a muted state; and (iv) responsive to encountering the trigger, and based on the determining that the playback device is presenting the first media content from the first source in a muted state, presenting, by the playback device, the second media content from the second source in the muted state.

Claims (29)

1. A computing system configured for performing a set of acts comprising:

encountering a trigger to replace a replaceable content segment of media content with a replacement content segment, wherein the media content is provided to a playback device by a media device, and wherein the replacement content segment is stored in a local cache of the playback device;

detecting, within an audio signal associated with the media content, a silent period having a duration that exceeds a threshold duration;

determining that the silent period is within a threshold time of a time at which the playback device is scheduled replace the replaceable content segment;

based on detecting the silent period having the duration that exceeds the threshold duration and determining that the silent period is within the threshold time of the time at which the playback device is scheduled to replace the replaceable content segment, determining that the media device is providing the media content to the playback device in a muted state;

responsive to encountering the trigger, and based on the determining that the media device is providing the media content to the playback device in the muted state, presenting the replacement content segment in the muted state and in place of the replaceable content segment; and

storing audibility data indicative of the presenting of the replacement content segment in the muted state.

2. The computing system of claim 1 , wherein the audibility data indicative of the presenting of the replacement content segment in the muted state comprises an identifier of the replacement content segment and an indication of when the replacement content segment was presented.

3. The computing system of claim 2 , wherein the set of acts further comprises providing the audibility data to a server.

4. The computing system of claim 1 , wherein encountering the trigger comprises determining that a first segment occurring immediately prior to a second segment is being presented, wherein the second segment is designated to be replaced with the replacement content segment.

5. The computing system of claim 4 , wherein the first segment is a first advertisement, and wherein the second segment is a second advertisement.

6. A method comprising:

encountering, by a playback device, a trigger to replace a replaceable content segment of media content with a replacement content segment, wherein the media content is provided to the playback device by a media device, and wherein the replacement content segment is stored in a local cache of the playback device;

detecting, by the playback device, within an audio signal associated with the media content, a silent period having a duration that exceeds a threshold duration;

determining, by the playback device, that the silent period is within a threshold time of a time at which a playback device is scheduled to replace the replaceable content segment;

based on detecting the silent period having the duration that exceeds the threshold duration and determining that the silent period is within the threshold time of the time at which the playback device is scheduled to replace the replaceable content segment, determining, by the playback device, that the media device is providing the media content to the playback device in a muted state;

responsive to encountering the trigger, and based on the determining that the media device is providing the media content to the playback device in the muted state, presenting, by the playback device, the replacement content segment in the muted state; and

storing audibility data indicative of the presenting of the replacement content segment in the muted state.

7. The method of claim 6 , wherein the audibility data indicative of the presenting of the replacement content segment in the muted state comprises an identifier of the replacement content segment and an indication of when the replacement content segment was presented.

8. The method of claim 7 , further comprising providing the audibility data to a server.

9. A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:

encountering a trigger to replace a replaceable content segment of media content with a replacement content segment, wherein the media content is provided to a playback device by a media device, and wherein the replacement content segment is stored in a local cache of the playback device;

detecting, within an audio signal associated with the media content, a silent period having a duration that exceeds a threshold duration;

determining that the silent period is within a threshold time of a time at which the playback device is scheduled to replace the replaceable content segment;

based on detecting the silent period having the duration that exceeds the threshold duration and determining that the silent period is within the threshold time of the time at which the playback device is scheduled to replace the replaceable content segment, determining that the media device is providing the media content to the playback device in a muted state;

responsive to encountering the trigger, and based on the determining that the media device is providing the media content to the playback device in the muted state, presenting the replacement content segment in the muted state and in place of the replaceable content segment; and

storing audibility data indicative of the presenting of the replacement content segment in the muted state.

10. The non-transitory computer-readable medium of claim 9 , wherein the audibility data indicative of the presenting of the replacement content segment in the muted state comprises an identifier of the replacement content segment and an indication of when the replacement content segment was presented.

11. The non-transitory computer-readable medium of claim 9 , wherein the set of acts further comprises providing the audibility data to a server.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2020
From: CREMER, MARKUS K.; MERCHANT, SHASHANK
To: GRACENOTE, INC.
Reel/Frame 052384/0121 →