IP Library Granted Patent US 11,284,151
Granted Patent B2
US 11,284,151 · App. 17/295,735 · Granted Mar 22, 2022

Loudness adjustment method and apparatus, and electronic device and storage medium

Inventor: Chen Zhang (Beijing, CN)
Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
H04N21/4394G06F3/165
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,284,151
App. No.
17/295,735
Granted
Mar 22, 2022
Kind
B2
Abstract

The present application relates to a loudness adjustment method and apparatus, and an electronic device and a storage medium, mainly relating to the technical field of multimedia. The method comprises: converting a sound signal of a multimedia resource into a first frequency domain signal; acquiring a second frequency domain signal based on the first frequency domain signal and frequency response information of a current electronic device, wherein the second frequency domain signal is used for reflecting the loudness of the first frequency domain signal when same is played on the current electronic device; and adjusting the loudness of the sound signal based on the second frequency domain signal and a target loudness, so as to obtain a target sound signal of the multimedia resource.

Claims (54)

1. A method for adjusting loudness, comprising:

converting a sound signal of a multimedia resource into a first frequency domain signal;

acquiring a third frequency domain signal based on the first frequency domain signal and first information of current electronic equipment, wherein the first information is configured to embody the change of an amplitude of the sound signal along with the change of a frequency; and

acquiring the second frequency domain signal based on the third frequency domain signal and second information of the current electronic equipment, wherein the second information is configured to embody the change of the loudness of the sound signal along with the change of the frequency, wherein the second frequency domain signal is configured to embody loudness of the first frequency domain signal when the first frequency domain signal is played on the current electronic equipment; and

obtaining a target sound signal of the multimedia resource by adjusting loudness of the sound signal based on the second frequency domain signal and target loudness.

2. The method according to claim 1 , wherein said obtaining the target sound signal of the multimedia resource by adjusting the loudness of the sound signal based on the second frequency domain signal and the target loudness comprises:

acquiring a loudness adjustment value of the sound signal based on the second frequency domain signal and the target loudness; and

obtaining the target sound signal of the multimedia resource by adjusting the loudness of the sound signal based on the loudness adjustment value.

3. The method according to claim 2 , wherein said acquiring the loudness adjustment value of the sound signal based on the second frequency domain signal and the target loudness comprises:

acquiring a maximum value and an average value of loudness of the second frequency domain signal; and

acquiring the loudness adjustment value of the sound signal based on the maximum value, the average value and the target loudness.

4. The method according to claim 3 , wherein said acquiring the loudness adjustment value of the sound signal based on the maximum value, the average value and the target loudness comprises:

acquiring a first difference value between the target loudness and the average value;

acquiring a second difference value between a loudness threshold and the maximum value; and

acquiring the loudness adjustment value of the sound signal based on the first difference value and the second difference value.

5. The method according to claim 4 , wherein said acquiring the loudness adjustment value of the sound signal based on the first difference value and the second difference value comprises:

acquiring the loudness adjustment value of the sound signal by weighting and summing the first difference value and the second difference value when the first difference value and the second difference value satisfy a target condition, wherein the target condition is that the first difference value is greater than or equal to 0 and the first difference value is greater than the second difference value; or,

determining the first difference value as the loudness adjustment value of the sound signal when the first difference value and the second difference value do not satisfy the target condition.

6. The method according to claim 2 , wherein said obtaining the target sound signal of the multimedia resource by adjusting the loudness of the sound signal based on the loudness adjustment value comprises:

acquiring a threshold of a compressor based on a loudness threshold and the loudness adjustment value;

acquiring a gain value of the compressor based on the loudness adjustment value; and

inputting the sound signal to the compressor, and obtaining the target sound signal of the multimedia resource by adjusting, by the compressor, the loudness of the sound signal based on the threshold and the gain value.

7. The method according to claim 6 , further comprising:

when the target sound signal comprises at least one frame of target sound signal with loudness being greater than the loudness threshold, adjusting the loudness of the at least one frame of target sound signal to the loudness threshold.

8. The method according to claim 7 , wherein said when the target sound signal comprises at least one frame of target sound signal with the loudness being greater than the loudness threshold, adjusting the loudness of the at least one frame of target sound signal to the loudness threshold comprises:

inputting the target sound signal to a limiter, outputting adjusted target sound signal by adjusting, by the limiter, the at least one frame of target sound signal, with the loudness being greater than the loudness threshold, in the target sound signal.

9. Electronic equipment, comprising:

one or more processors; and

one or more memories configured to store instructions executed by the one or more processors;

wherein the one or more processors are configured to execute the instructions to enable the one or more processors to:

convert a sound signal of a multimedia resource into a first frequency domain signal;

acquire a third frequency domain signal based on the first frequency domain signal and first information of current electronic equipment, wherein the first information is configured to embody the change of an amplitude of the sound signal along with the change of a frequency; and

acquire the second frequency domain signal based on the third frequency domain signal and second information of the current electronic equipment, wherein the second information is configured to embody the change of the loudness of the sound signal along with the change of the frequency, wherein the second frequency domain signal is configured to embody loudness of the first frequency domain signal when the first frequency domain signal is played on the current electronic equipment; and

obtain a target sound signal of the multimedia resource by adjusting loudness of the sound signal based on the second frequency domain signal and target loudness.

10. The electronic equipment according to claim 9 , wherein the one or more processors are configured to execute the instructions to enable the one or more processors to:

acquire the loudness adjustment value of the sound signal based on the second frequency domain signal and the target loudness; and

obtain the target sound signal of the multimedia resource by adjusting the loudness of the sound signal based on the loudness adjustment value.

11. The electronic equipment according to claim 10 , wherein the one or more processors are configured to execute the instructions to enable the one or more processors to:

acquire a maximum value and an average value of loudness of the second frequency domain signal; and

acquire the loudness adjustment value of the sound signal based on the maximum value, the average value and the target loudness.

12. The electronic equipment according to claim 11 , wherein the one or more processors are configured to execute the instructions to enable the one or more processors to:

acquire the first difference value between the target loudness and the average value;

acquire the second difference value between a loudness threshold and the maximum value; and

acquire the loudness adjustment value of the sound signal based on the first difference value and the second difference value.

13. The electronic equipment according to claim 12 , wherein the one or more processors are configured to execute the instructions to enable the one or more processors to:

acquire the loudness adjustment value of the sound signal by weighting and summing the first difference value and the second difference value when the first difference value and the second difference value satisfy a target condition, wherein the target condition is that the first difference value is greater than or equal to 0 and the first difference value is greater than the second difference value; or,

determine the first difference value as the loudness adjustment value of the sound signal when the first difference value and the second difference value do not satisfy the target condition.

14. The electronic equipment according to claim 10 , wherein the one or more processors are configured to execute the instructions to enable the one or more processors to:

acquire a threshold of a compressor based on a loudness threshold and the loudness adjustment value;

acquire the gain value of the compressor based on the loudness adjustment value; and

input the sound signal to the compressor, and output the target sound signal of the multimedia resource by adjusting, by the compressor, the loudness of the sound signal based on the threshold and the gain value.

15. The electronic equipment according to claim 14 , wherein the one or more processors are configured to execute the instructions to enable the one or more processors to: when the target sound signal comprises at least one frame of target sound signal with loudness being greater than the loudness threshold, adjust the loudness of the at least one frame of target sound signal to the loudness threshold.

16. The electronic equipment according to claim 14 , wherein the one or more processors are configured to execute the instructions to enable the one or more processors to: input the target sound signal to a limiter, and output adjusted target sound signal by adjusting, by the limiter, the at least one frame of target sound signal, with the loudness being greater than the loudness threshold, in the target sound signal.

17. A non-transitory computer readable storage medium, wherein when instructions in the non-transitory computer readable storage medium are executed by a processor of electronic equipment, the electronic equipment performs the method of claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: ZHANG, CHEN
To: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 056305/0179 →
Priority Claims (1)
CN 201811409335.3 · Nov 23, 2018 · national
Continuity (1)
Related Publication 20210368230A1 · Nov 25, 2021