IP Library Granted Patent US 11,347,470
Granted Patent B2
US 11,347,470 · App. 16/673,859 · Granted May 31, 2022

Detection of media playback loudness level and corresponding adjustment to audio during media replacement event

Inventors: Markus K. Cremer (Orinda, CA); Shashank Merchant (Sunnyvale, CA); Aneesh Vartakavi (Emeryville, CA)
Assignee: Roku, Inc.
G06F3/165G06N3/08H03G3/24H03G3/3005H03G3/3089H04N5/147H04N21/439H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,347,470
App. No.
16/673,859
Granted
May 31, 2022
Kind
B2
Abstract

In one aspect, an example method includes (i) presenting first media content from a first source; (ii) encountering a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining a first loudness level of the first media content; (iv) determining a second loudness level of the second media content; (v) based on a difference between the first loudness level and the second loudness level, adjusting a loudness level of the second media content so as to generate modified media content having a third loudness level that is different from the second loudness level; and (vi) responsive to encountering the trigger, presenting the modified media content having the third loudness level.

Claims (45)

1. A method comprising:

presenting, by a playback device, first media content from a first source;

encountering, by the playback device, a trigger replace a replaceable content segment of the first media content with a replacement content segment, wherein the replacement content segment is stored in a local cache of the playback device;

obtaining, by the playback device, a loudness level profile for the first media content, wherein the loudness level profile characterizes changes in loudness within the first media content over time;

determining, by the playback device, a first loudness level of the first media content, wherein determining the first loudness level comprises comparing a loudness level observed by the playback device with a loudness level indicated by the loudness level profile;

determining, by the playback device, a second loudness level of the replacement content segment;

based on a difference between the first loudness level and the second loudness level, adjusting, by the playback device, a loudness level of the replacement content segment so as to generate a replacement content segment having a third loudness level that is different from the second loudness level; and

responsive to encountering the trigger, presenting, by the playback device, the replacement content segment having the third loudness level in place of the replaceable content segment.

2. The method of claim 1 , wherein determining the first loudness level comprises determining a moving average of the first loudness level as the playback device presents the first media content.

3. The method of claim 2 , further comprising:

detecting a channel-change event; and

upon detecting the channel-change event, resetting the moving average of the first loudness level.

4. The method of claim 1 , wherein determining the second loudness level comprises determining the second loudness level based on auxiliary information that is received with the replacement content segment.

5. The method of claim 1 , wherein adjusting the loudness level of the replacement content segment based on the difference between the first loudness level and the second loudness level comprises increasing the loudness level of the replacement content segment from the second loudness level to the third loudness level based on the first loudness level being greater than the second loudness level.

6. The method of claim 1 , wherein adjusting the loudness level of the replacement content segment based on the difference between the first loudness level and the second loudness level comprises decreasing the loudness level of the replacement content segment from the second loudness level to the third loudness level based on the first loudness level being less than the second loudness level.

7. The method of claim 1 , further comprising retrieving the replacement content segment from the local cache.

8. The method of claim 1 , wherein the playback device comprises a television, and wherein presenting the replacement content segment having the third loudness level comprises presenting the replacement content segment having the third loudness level using a media player.

9. The method of claim 1 , wherein encountering the trigger comprises determining that the playback device is presenting a segment occurring immediately prior to the replaceable content segment, wherein the replaceable content segment is designated to be replaced with the replacement content segment.

10. The method of claim 9 , wherein the segment occurring immediately prior to the replaceable content segment is a first advertisement, and wherein the replaceable content segment is a second advertisement.

11. A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:

presenting first media content from a first source,

encountering a trigger to replace a replaceable content segment of the first media content with a replacement content segment, wherein the replacement content segment is stored in a local cache of a playback device,

obtaining a loudness level profile for the first media content, wherein the loudness level profile characterizes changes in loudness within the first media content over time,

determining a first loudness level of the first media content, wherein determining the first loudness level comprises comparing a loudness level observed by the playback device with a loudness level indicated by the loudness level profile,

determining a second loudness level of the replacement content segment,

based on a difference between the first loudness level and the second loudness level, adjusting a loudness level of the replacement content segment so as to generate a replacement content segment having a third loudness level that is different from the second loudness level, and

responsive to encountering the trigger, presenting the replacement content segment having the third loudness level in place of the replaceable content segment.

12. The non-transitory computer-readable medium of claim 11 , wherein determining the first loudness level comprises determining a moving average of the first loudness level as a playback device presents the first media content.

13. The non-transitory computer-readable medium of claim 11 , wherein determining the second loudness level comprises determining the second loudness level based on auxiliary information that is received with the replacement content segment.

14. The non-transitory computer-readable medium of claim 11 , wherein the set of acts further comprises retrieving the replacement content segment from the local cache.

15. The non-transitory computer-readable medium of claim 11 , wherein encountering the trigger comprises determining that a playback device is presenting a segment occurring immediately prior to the replaceable content segment, wherein the replaceable content segment is designated to be replaced with the replacement content segment.

16. A computing system comprising:

one or more processors; and

a non-transitory computer-readable medium having stored therein instructions that are executable to cause the computing system to perform a set of acts comprising:

presenting first media content from a first source,

encountering a trigger to replace a replaceable content segment of the first media content with a replacement content segment, wherein the replacement content segment is stored in a local cache of a playback device,

obtaining a loudness level profile for the first media content, wherein the loudness level profile characterizes changes in loudness within the first media content over time,

determining a first loudness level of the first media content, wherein determining the first loudness level comprises comparing a loudness level observed by the playback device with a loudness level indicated by the loudness level profile,

determining a second loudness level of the replacement content segment,

based on a difference between the first loudness level and the second loudness level, adjusting a loudness level of the replacement content segment so as to generate a replacement content segment having a third loudness level that is different from the second loudness level, and

responsive to encountering the trigger, presenting the replacement content segment having the third loudness level in place of the replaceable content segment.

17. The computing system of claim 16 , wherein determining the first loudness level comprises determining a moving average of the first loudness level as a playback device presents the first media content.

18. The computing system of claim 16 , wherein determining the second loudness level comprises determining the second loudness level based on auxiliary information that is received with the replacement content segment.

19. The computing system of claim 16 , wherein the set of acts further comprises retrieving the replacement content segment from the local cache.

20. The computing system of claim 16 , wherein encountering the trigger comprises determining that a playback device is presenting a segment occurring immediately prior to the replaceable content segment, wherein the replaceable content segment is designated to be replaced with the replacement content segment.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2019
From: CREMER, MARKUS K.; MERCHANT, SHASHANK; VARTAKAVI, ANEESH
To: GRACENOTE, INC.
Reel/Frame 050926/0992 →
Continuity (4)
Provisional Application 62909676 · Oct 2, 2019
Provisional Application 62861474 · Jun 14, 2019
Provisional Application 62768596 · Nov 16, 2018
Related Publication 20200159489A1 · May 21, 2020