AUDIO SIGNAL PROCESSING METHOD AND APPARATUS, STORAGE MEDIUM, AND VEHICLE
This application relates to an audio signal processing method and apparatus, a storage medium, and a vehicle. The method includes: obtaining a first audio signal collected by a sound sensor; processing one or more of human voice information, harmonic information, and burst sound information that are included in the first audio signal, to determine a first noise signal in the first audio signal; adjusting a second audio signal based on the first noise signal and the second audio signal to obtain a third audio signal, where the second audio signal is an original audio source of a play device, and the adjustment includes amplitude adjustment; and playing the third audio signal by using the play device. According to embodiments of this application, a current noise level can be accurately estimated, so that an adjusted audio signal has a better noise masking effect, and auditory experience of a user is better. In addition, in the foregoing process, dependency on non-acoustic state information is avoided, and this adjustment method can be used in a plurality of scenarios, is more flexible, and supports fast deployment.
1 . An audio signal processing method, wherein the method comprises:
obtaining a first audio signal collected by a sound sensor;
processing one or more of human voice information, harmonic information, and burst sound information that are comprised in the first audio signal, to determine a first noise signal in the first audio signal;
adjusting a second audio signal based on the first noise signal and the second audio signal to obtain a third audio signal, wherein the second audio signal is an original audio source of a play device, and the adjustment comprises amplitude adjustment; and
playing the third audio signal by using the play device.
2 . The method according to claim 1 , wherein the adjusting a second audio signal based on the first noise signal and the second audio signal to obtain a third audio signal comprises:
determining a second noise signal based on the first noise signal and transfer information, wherein the second noise signal is an estimated noise signal perceived by a user; and
adjusting the second audio signal based on the second noise signal and the second audio signal to obtain the third audio signal.
3 . The method according to claim 2 , wherein the transfer information comprises transfer information from the sound sensor to a human ear of the user, and/or transfer information in the human ear.
4 . The method according to claim 2 , wherein the adjusting the second audio signal based on the second noise signal and the second audio signal to obtain the third audio signal comprises:
determining a gain curve based on the second noise signal and the second audio signal; and
adjusting the second audio signal based on the gain curve to obtain the third audio signal.
5 . The method according to claim 2 , wherein the adjusting the second audio signal based on the second noise signal and the second audio signal to obtain the third audio signal comprises:
determining a gain value based on the second noise signal and the second audio signal; and
adjusting the second audio signal based on the gain value to obtain the third audio signal.
6 . The method according to claim 2 , wherein the adjusting the second audio signal based on the second noise signal and the second audio signal to obtain the third audio signal comprises:
determining a noise masking threshold of the second audio signal based on the second audio signal and psychoacoustic information, wherein the masking threshold indicates a volume threshold of noise that is masked by the second audio signal at each frequency, and noise whose volume is lower than the volume threshold at each frequency is masked by the second audio signal; and
adjusting the second audio signal based on the second noise signal and the masking threshold to obtain the third audio signal.
7 . The method according to claim 1 , wherein the processing one or more of human voice information, harmonic information, and burst sound information that are comprised in the first audio signal, to determine a first noise signal in the first audio signal comprises:
processing echo information and the one or more of the human voice information, the harmonic information, and the burst sound information that are comprised in the first audio signal, to determine the first noise signal in the first audio signal.
8 . The method according to claim 1 , wherein the processing one or more of human voice information, harmonic information, and burst sound information that are comprised in the first audio signal, to determine a first noise signal in the first audio signal comprises:
when it is determined that the first audio signal comprises the human voice information and/or the harmonic information, determining that the first noise signal is a first noise signal of a previous frame.
9 . The method according to claim 1 , wherein the first audio signal comprises a collected first audio signal of current N frames, the second audio signal comprises a to-be-adjusted second audio signal of current N frames, the third audio signal comprises a third audio signal of current N frames, and N is a positive integer.
10 . An audio signal processing apparatus, comprising a processor and a memory, wherein
the memory is configured to store a program; and
the processor is configured to execute the program stored in the memory, to enable the apparatus to obtain a first audio signal collected by a sound sensor;
process one or more of human voice information, harmonic information, and burst sound information that are comprised in the first audio signal, to determine a first noise signal in the first audio signal;
adjust a second audio signal based on the first noise signal and the second audio signal to obtain a third audio signal, wherein the second audio signal is an original audio source of a play device, and the adjustment comprises amplitude adjustment; and
play the third audio signal by using the play device.
11 . The audio signal processing apparatus according to claim 10 , wherein the processor is further configured to
determine a second noise signal based on the first noise signal and transfer information, wherein the second noise signal is an estimated noise signal perceived by a user; and
adjust the second audio signal based on the second noise signal and the second audio signal to obtain the third audio signal.
12 . The audio signal processing apparatus according to claim 11 , wherein the transfer information comprises transfer information from the sound sensor to a human ear of the user, and/or transfer information in the human ear.
13 . The audio signal processing apparatus according to claim 11 , wherein the processor is further configured to
determine a gain curve based on the second noise signal and the second audio signal; and
adjust the second audio signal based on the gain curve to obtain the third audio signal.
14 . The audio signal processing apparatus according to claim 11 , wherein the processor is further configured to
determine a gain value based on the second noise signal and the second audio signal; and
adjust the second audio signal based on the gain value to obtain the third audio signal.
15 . The audio signal processing apparatus according to claim 11 , wherein the processor is further configured to
determine a noise masking threshold of the second audio signal based on the second audio signal and psychoacoustic information, wherein the masking threshold indicates a volume threshold of noise that is masked by the second audio signal at each frequency, and noise whose volume is lower than the volume threshold at each frequency is masked by the second audio signal; and
adjust the second audio signal based on the second noise signal and the masking threshold to obtain the third audio signal.
16 . The audio signal processing apparatus according to claim 10 , wherein the processor is further configured to
process echo information and the one or more of the human voice information, the harmonic information, and the burst sound information that are comprised in the first audio signal, to determine the first noise signal in the first audio signal.
17 . The audio signal processing apparatus according to claim 10 , wherein the processor is further configured to
when it is determined that the first audio signal comprises the human voice information and/or the harmonic information, determine that the first noise signal is a first noise signal of a previous frame.
18 . The audio signal processing apparatus according to claim 10 , wherein the processor is further configured to
wherein the first audio signal comprises a collected first audio signal of current N frames, the second audio signal comprises a to-be-adjusted second audio signal of current N frames, the third audio signal comprises a third audio signal of current N frames, and N is a positive integer.
19 . A computer-readable storage medium, wherein the computer-readable storage medium stores program instructions, and when the program instructions are executed by a computer, the computer is enabled to implement the method according to claim 1 .