IP Library Granted Patent US 11,042,353
Granted Patent B2
US 11,042,353 · App. 16/684,514 · Granted Jun 22, 2021

Monitoring loudness level during media replacement event using shorter time constant

Inventors: Markus K. Cremer (Orinda, CA); Shashank Merchant (Sunnyvale, CA); Robert Coover (Orinda, CA); Todd J. Hodges (Oakland, CA); Joshua Ernest Morris (Oakland, CA)
Assignee: Roku, Inc.
G06F3/165G06N3/08H03G3/24H03G3/3005H03G3/3089H04N5/147H04N21/439H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,042,353
App. No.
16/684,514
Granted
Jun 22, 2021
Kind
B2
Abstract

In one aspect, an example method includes (i) determining, by a playback device, a first loudness level of a first portion of first media content from a first source while the playback device presents the first media content, with the first portion having a first length; (ii) switching, by the playback device, from presenting the first media content from the first source to presenting second media content from a second source; (iii) based on the switching, determining, by the playback device, second loudness levels of second portions of the first media content while the playback device presents the second media content, with the second portions having a second length that is shorter than the first length; and (iv) while the playback device presents the second media content, adjusting, by the playback device, a volume of the playback device based on one or more of the second loudness levels.

Claims (51)

1. A method comprising:

determining, by a playback device, a first loudness level of a first portion of first media content from a first source while the playback device presents the first media content, wherein the first portion has a first length;

switching, by the playback device, from presenting the first media content from the first source to presenting second media content from a second source;

while the playback device presents the second media content from the second source, receiving, by the playback device, an audio signal corresponding to the first media content;

based on the switching, determining, by the playback device, second loudness levels of second portions of the first media content using the audio signal corresponding to the first media content while the playback device presents the second media content, wherein the second portions have a second length that is shorter than the first length; and

while the playback device presents the second media content, adjusting, by the playback device, a volume of the playback device based on one or more of the second loudness levels.

2. The method of claim 1 , wherein the second loudness levels comprise a loudness level of a given portion and a loudness level of a subsequent portion, wherein the method further comprises determining that the loudness level of the given portion differs from the loudness level of the subsequent portion by more than a threshold amount, and wherein adjusting the volume of the playback device comprises adjusting the volume based on a difference between the loudness level of the given portion and the loudness level of the subsequent portion.

3. The method of claim 2 , further comprising determining a target volume based on the difference, wherein adjusting the volume comprises adjusting the volume toward the target volume.

4. The method of claim 1 , wherein adjusting the volume based on one or more of the second loudness levels comprises:

comparing a given loudness level of the second loudness levels with a reference loudness level indicated by a loudness level profile for the first media content;

determining a target volume level for the playback device based on a difference between the given loudness level and the reference loudness level; and

adjusting the volume toward the target volume level.

5. The method of claim 4 , wherein the loudness level profile comprises respective loudness levels for portions of the first media content, and wherein the method further comprises aligning the loudness level profile with the first media content that the playback device is receiving.

6. The method of claim 1 , wherein adjusting the volume based on one or more of the second loudness levels comprises:

providing the second loudness levels as input to a neural network, wherein the neural network is trained using audio samples that include volume adjustments;

detecting a volume adjustment to the first media content based on an output of the neural network; and

adjusting the volume based on the volume adjustment.

7. The method of claim 1 , wherein determining the first loudness level comprises determining a moving average of the first loudness level.

8. The method of claim 7 , further comprising:

detecting a channel-change event; and

upon detecting the channel-change event, resetting the moving average of the first loudness level.

9. The method of claim 1 , further comprising:

determining a loudness level of the second media content; and

based on a difference between the first loudness level and the loudness level of the second media content, adjusting the loudness level of the second media content prior to presenting the second media content.

10. The method of claim 1 , wherein the playback device comprises a television, and wherein presenting the second media content comprises presenting a replacement advertisement using a media player.

11. The method of claim 1 , wherein the second media content is stored in a local cache of the playback device, and wherein the method further comprises retrieving the second media content from the local cache prior to presenting the second media content.

12. A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:

determining a first loudness level of a first portion of first media content from a first source while a playback device presents the first media content, wherein the first portion has a first length;

switching from presenting the first media content from the first source to presenting second media content from a second source;

while the playback device presents the second media content from the second source, receiving an audio signal corresponding to the first media content;

based on the switching, determining second loudness levels of second portions of the first media content using the audio signal corresponding to the first media content while the playback device presents the second media content, wherein the second portions have a second length that is shorter than the first length; and

while the playback device presents the second media content, adjusting a volume of the playback device based on one or more of the second loudness levels.

13. The non-transitory computer-readable medium of claim 12 , wherein the second loudness levels comprise a loudness level of a given portion and a loudness level of a subsequent portion, wherein the set of acts further comprises determining that the loudness level of the given portion differs from the loudness level of the subsequent portion by more than a threshold amount, and wherein adjusting the volume of the playback device comprises adjusting the volume based on a difference between the loudness level of the given portion and the loudness level of the subsequent portion.

14. The non-transitory computer-readable medium of claim 12 , wherein adjusting the volume based on one or more of the second loudness levels comprises:

comparing a given loudness level of the second loudness levels with a reference loudness level indicated by a loudness level profile for the first media content;

determining a target volume level for the playback device based on a difference between the given loudness level and the reference loudness level; and

adjusting the volume toward the target volume level.

15. The non-transitory computer-readable medium of claim 12 , wherein the playback device comprises a television, and wherein presenting the second media content comprises presenting a replacement advertisement using a media player.

16. The non-transitory computer-readable medium of claim 12 , wherein the second media content is stored in a local cache of the playback device, and wherein the set of acts further comprises retrieving the second media content from the local cache prior to presenting the second media content.

17. A computing system configured for performing a set of acts comprising:

determining a first loudness level of a first portion of first media content from a first source while a playback device presents the first media content, wherein the first portion has a first length;

switching from presenting the first media content from the first source to presenting second media content from a second source;

while the playback device presents the second media content from the second source, receiving an audio signal corresponding to the first media content;

based on the switching, determining second loudness levels of second portions of the first media content using the audio signal corresponding to the first media content while the playback device presents the second media content, wherein the second portions have a second length that is shorter than the first length; and

while the playback device presents the second media content, adjusting a volume of the playback device based on one or more of the second loudness levels.

18. The computing system of claim 17 , wherein the second loudness levels comprise a loudness level of a given portion and a loudness level of a subsequent portion, wherein the set of acts further comprises determining that the loudness level of the given portion differs from the loudness level of the subsequent portion by more than a threshold amount, and wherein adjusting the volume of the playback device comprises adjusting the volume based on a difference between the loudness level of the given portion and the loudness level of the subsequent portion.

19. The computing system of claim 17 , wherein adjusting the volume based on one or more of the second loudness levels comprises:

comparing a given loudness level of the second loudness levels with a reference loudness level indicated by a loudness level profile for the first media content;

determining a target volume level for the playback device based on a difference between the given loudness level and the reference loudness level; and

adjusting the volume toward the target volume level.

20. The computing system of claim 17 , wherein the second media content is stored in a local cache of the playback device, and wherein the set of acts further comprises retrieving the second media content from the local cache prior to presenting the second media content.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2020
From: CREMER, MARKUS K.; MERCHANT, SHASHANK; COOVER, ROBERT; HODGES, TODD J.; MORRIS, JOSHUA ERNEST
To: GRACENOTE, INC.
Reel/Frame 051427/0140 →
Cited By (1)
US 12,237,818