IP Library Granted Patent US 11,372,617
Granted Patent B2
US 11,372,617 · App. 17/325,075 · Granted Jun 28, 2022

Monitoring loudness level during media replacement event using shorter time constant

Inventors: Markus K. Cremer (Orinda, CA); Shashank Merchant (Sunnyvale, CA); Robert Coover (Orinda, CA); Todd J. Hodges (Oakland, CA); Joshua Ernest Morris (Oakland, CA)
Assignee: Roku, Inc.
G06F3/165G06N3/08H03G3/24H03G3/3005H03G3/3089H04N5/147H04N21/439H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,372,617
App. No.
17/325,075
Granted
Jun 28, 2022
Kind
B2
Abstract

In one aspect, an example method includes (i) determining, by a playback device, a first loudness level of a first portion of first media content from a first source while the playback device presents the first media content, with the first portion having a first length; (ii) switching, by the playback device, from presenting the first media content from the first source to presenting second media content from a second source; (iii) based on the switching, determining, by the playback device, second loudness levels of second portions of the first media content while the playback device presents the second media content, with the second portions having a second length that is shorter than the first length; and (iv) while the playback device presents the second media content, adjusting, by the playback device, a volume of the playback device based on one or more of the second loudness levels.

Claims (64)

1. A method comprising:

switching, by a playback device, from presenting first media content from a first source to presenting second media content from a second source;

while the playback device presents the second media content from the second source, receiving, by the playback device, an audio signal corresponding to the first media content;

determining, by the playback device, loudness levels of portions of the first media content using the audio signal corresponding to the first media content while the playback device presents the second media content; and

while the playback device presents the second media content, adjusting, by the playback device, a volume of the playback device based on one or more of the loudness levels.

2. The method of claim 1 , wherein:

the loudness levels comprise a loudness level of a given portion and a loudness level of a subsequent portion,

the method further comprises determining that the loudness level of the given portion differs from the loudness level of the subsequent portion by more than a threshold amount, and

adjusting the volume of the playback device comprises adjusting the volume based on a difference between the loudness level of the given portion and the loudness level of the subsequent portion.

3. The method of claim 2 , further comprising determining a target volume based on the difference,

wherein adjusting the volume comprises adjusting the volume toward the target volume.

4. The method of claim 1 , wherein adjusting the volume based on one or more of the loudness levels comprises:

providing the loudness levels as input to a neural network, wherein the neural network is trained using audio samples that include volume adjustments;

detecting a volume adjustment to the first media content based on an output of the neural network; and

adjusting the volume based on the volume adjustment.

5. The method of claim 4 , wherein the output of the neural network comprises data classifying the loudness levels as being characteristic of a volume adjustment rather than a fluctuation that is inherent to the first media content.

6. The method of claim 4 , further comprising identifying a trend in the loudness levels,

wherein the adjusting the volume is further based on the identified trend.

7. The method of claim 1 , wherein adjusting the volume comprises adjusting the volume using a smoothing filter.

8. The method of claim 1 , wherein:

the playback device comprises a television, and

presenting the second media content comprises presenting a replacement advertisement using a media player.

9. The method of claim 1 , wherein:

the second media content is stored in a local cache of the playback device, and

the method further comprises retrieving the second media content from the local cache prior to presenting the second media content.

10. A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:

switching from presenting first media content from a first source using a playback device to presenting second media content from a second source using the playback device;

while the playback device presents the second media content from the second source, receiving an audio signal corresponding to the first media content;

determining loudness levels of second portions of the first media content using the audio signal corresponding to the first media content while the playback device presents the second media content; and

while the playback device presents the second media content, adjusting a volume of the playback device based on one or more of the loudness levels.

11. The non-transitory computer-readable medium of claim 10 , wherein:

the loudness levels comprise a loudness level of a given portion and a loudness level of a subsequent portion,

the set of acts further comprises determining that the loudness level of the given portion differs from the loudness level of the subsequent portion by more than a threshold amount, and

adjusting the volume of the playback device comprises adjusting the volume based on a difference between the loudness level of the given portion and the loudness level of the subsequent portion.

12. The non-transitory computer-readable medium of claim 11 , wherein:

the set of acts further comprises determining a target volume based on the difference, and

adjusting the volume comprises adjusting the volume toward the target volume.

13. The non-transitory computer-readable medium of claim 10 , wherein adjusting the volume based on one or more of the loudness levels comprises:

providing the loudness levels as input to a neural network, wherein the neural network is trained using audio samples that include volume adjustments;

detecting a volume adjustment to the first media content based on an output of the neural network; and

adjusting the volume based on the volume adjustment.

14. The non-transitory computer-readable medium of claim 13 , wherein the output of the neural network comprises data classifying the loudness levels as being characteristic of a volume adjustment rather than a fluctuation that is inherent to the first media content.

15. The non-transitory computer-readable medium of claim 10 , wherein:

the second media content is stored in a local cache of the playback device, and

the set of acts further comprises retrieving the second media content from the local cache prior to presenting the second media content.

16. A computing system configured for performing a set of acts comprising:

switching from presenting first media content from a first source using a playback device to presenting second media content from a second source using the playback device;

while the playback device presents the second media content from the second source, receiving an audio signal corresponding to the first media content;

determining loudness levels of second portions of the first media content using the audio signal corresponding to the first media content while the playback device presents the second media content; and

while the playback device presents the second media content, adjusting a volume of the playback device based on one or more of the loudness levels.

17. The computing system of claim 16 , wherein:

the loudness levels comprise a loudness level of a given portion and a loudness level of a subsequent portion,

the set of acts further comprises determining that the loudness level of the given portion differs from the loudness level of the subsequent portion by more than a threshold amount, and

adjusting the volume of the playback device comprises adjusting the volume based on a difference between the loudness level of the given portion and the loudness level of the subsequent portion.

18. The computing system of claim 17 , wherein:

the set of acts further comprises determining a target volume based on the difference, and

adjusting the volume comprises adjusting the volume toward the target volume.

19. The computing system of claim 16 , wherein adjusting the volume based on one or more of the loudness levels comprises:

providing the loudness levels as input to a neural network, wherein the neural network is trained using audio samples that include volume adjustments;

detecting a volume adjustment to the first media content based on an output of the neural network; and

adjusting the volume based on the volume adjustment.

20. The computing system of claim 16 , wherein:

the second media content is stored in a local cache of the playback device, and

the set of acts further comprises retrieving the second media content from the local cache prior to presenting the second media content.

Assignments (5)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2021
From: CREMER, MARKUS K.; MERCHANT, SHASHANK; COOVER, ROBERT; HODGES, TODD J.; MORRIS, JOSHUA ERNEST
To: GRACENOTE, INC.
Reel/Frame 056293/0312 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056296/0217 →