Audio signal processing method and electronic device
This application relates to the audio field, and discloses an audio signal processing method and an electronic device, to resolve a problem that a stereo audio signal is directly input to a user through a headset and original expressive and immersive feelings of audio content cannot be accurately restored. A specific solution is as follows: A direct part and a diffusion part are separated from an audio signal. A corresponding room impulse response is obtained from a preset room impulse response database based on a current scene. Synthesis is performed based on a head-related transfer function and the room impulse response to obtain a binaural room impulse response for sense-of-orientation rendering and a binaural room impulse response for sense-of-space rendering.
1. An audio signal processing method, applied to an electronic device in an audio system, wherein the audio system comprises an electronic device and a headset that are communicatively connected, and the method comprises:
splitting an audio signal into a direct part and a diffusion part;
obtaining a corresponding room impulse response from a preset room impulse response database based on a current scene, wherein the room impulse response database comprises room impulse responses corresponding to scenes, and the current scene is a scene in which the electronic device is currently located;
performing synthesis based on the room impulse response and a head-related transfer function to obtain a first binaural room impulse response for sense-of-orientation rendering and a second binaural room impulse response for sense-of-space rendering;
rendering the direct part of the audio signal and the diffusion part of the audio signal based on the first binaural room impulse response to obtain a sense-of-orientation rendered audio signal;
rendering the diffusion part of the audio signal based on the second binaural room impulse response to obtain a sense-of-space rendered audio signal; and
synthesizing the sense-of-orientation rendered audio signal and the sense-of-space rendered audio signal, and inputting a synthesized signal to the headset.
2. The method according to claim 1 , wherein the performing synthesis based on the room impulse response and a head-related transfer function to obtain a first binaural room impulse response for sense-of-orientation rendering and a second binaural room impulse response for sense-of-space rendering comprises:
decomposing the room impulse response into a direct part of the room impulse response, an early reflection part of the room impulse response, and a later reverberation part of the room impulse response;
performing synthesis based on the direct part of the room impulse response, the early reflection part of the room impulse response, and a head-related transfer function to obtain the first binaural room impulse response for sense-of-orientation rendering; and
performing synthesis based on the early reflection part of the room impulse response, the later reverberation part of the room impulse response, and a head-related transfer function in a preset orientation to obtain the second binaural room impulse response for sense-of-space rendering.
3. The method according to claim 2 , wherein the head-related transfer function is a head-related transfer function obtained through matching and adjustment based on head tracking information sent by the headset.
4. The method according to claim 2 , wherein the head-related transfer function in the preset orientation comprises: a head-related transfer function directly in front of a user's head, a head-related transfer function directly behind the user's head, a head-related transfer function on the left of the user's head, a head-related transfer function on the right of the user's head, a head-related transfer function above the user's head, and a head-related transfer function below the user's head.
5. The method according to claim 1 , wherein the diffusion part of the audio signal comprises a left-channel diffusion part and a right-channel diffusion part.
6. The method according to claim 1 , wherein the current scene is a scene selected by the user.
7. The method according to claim 1 , wherein the current scene is a scene recognized by the electronic device.
8. The method according to claim 1 , wherein the current scene comprises any one of a shopping mall, a cinema, a conference room, a concert hall, an office, a kitchen, and a living room.
9. The method according to claim 1 , wherein the preset room impulse response database comprises a room impulse response autonomously measured by the user.
10. The method according to claim 1 , wherein the preset room impulse response database is stored in a cloud server.
11. An electronic device, comprising:
a processor, and a memory configured to store executable instructions of the processor, wherein when the processor is configured to execute the instructions, the electronic device is enabled to perform a method in an audio system, wherein the audio system comprises the electronic device and a headset that are communicatively connected, the method comprising:
splitting an audio signal into a direct part and a diffusion part;
obtaining a corresponding room impulse response from a preset room impulse response database based on a current scene, wherein the room impulse response database comprises room impulse responses corresponding to scenes, and the current scene is a scene in which the electronic device is currently located;
performing synthesis based on the room impulse response and a head-related transfer function to obtain a first binaural room impulse response for sense-of-orientation rendering and a second binaural room impulse response for sense-of-space rendering:
rendering the direct part of the audio signal and the diffusion part of the audio signal based on the first binaural room impulse response to obtain a sense-of-orientation rendered audio signal;
rendering the diffusion part of the audio signal based on the second binaural room impulse response to obtain a sense-of-space rendered audio signal; and
synthesizing the sense-of-orientation rendered audio signal and the sense-of-space rendered audio signal, and inputting a synthesized signal to the headset.
12. A non-transitory computer-readable storage medium, storing computer program instructions, wherein when the computer program instructions are executed by an electronic device, the electronic device is enabled to perform a method applied to an electronic device in an audio system, wherein the audio system comprises the electronic device and a headset that are communicatively connected, the method comprising:
splitting an audio signal into a direct part and a diffusion part;
obtaining a corresponding room impulse response from a preset room impulse response database based on a current scene, wherein the room impulse response database comprises room impulse responses corresponding to scenes, and the current scene is a scene in which the electronic device is currently located;
performing synthesis based on the room impulse response and a head-related transfer function to obtain a first binaural room impulse response for sense-of-orientation rendering and a second binaural room impulse response for sense-of-space rendering;
rendering the direct part of the audio signal and the diffusion part of the audio signal based on the first binaural room impulse response to obtain a sense-of-orientation rendered audio signal;
rendering the diffusion part of the audio signal based on the second binaural room impulse response to obtain a sense-of-space rendered audio signal; and
synthesizing the sense-of-orientation rendered audio signal and the sense-of-space rendered audio signal, and inputting a synthesized signal to the headset.
13. The electronic device according to claim 11 , wherein the performing synthesis based on the room impulse response and a head-related transfer function to obtain a first binaural room impulse response for sense-of-orientation rendering and a second binaural room impulse response for sense-of-space rendering comprises:
decomposing the room impulse response into a direct part of the room impulse response, an early reflection part of the room impulse response, and a later reverberation part of the room impulse response;
performing synthesis based on the direct part of the room impulse response, the early reflection part of the room impulse response, and a head-related transfer function to obtain the first binaural room impulse response for sense-of-orientation rendering; and
performing synthesis based on the early reflection part of the room impulse response, the later reverberation part of the room impulse response, and a head-related transfer function in a preset orientation to obtain the second binaural room impulse response for sense-of-space rendering.
14. The electronic device according to claim 13 , wherein the head-related transfer function is a head-related transfer function obtained through matching and adjustment based on head tracking information sent by the headset.
15. The electronic device according to claim 13 , wherein the head-related transfer function in the preset orientation comprises: a head-related transfer function directly in front of a user's head, a head-related transfer function directly behind the user's head, a head-related transfer function on the left of the user's head, a head-related transfer function on the right of the user's head, a head-related transfer function above the user's head, and a head-related transfer function below the user's head.
16. The electronic device according to claim 11 , wherein the diffusion part of the audio signal comprises a left-channel diffusion part and a right-channel diffusion part.
17. The electronic device according to claim 11 , wherein the current scene is a scene selected by the user.
18. The electronic device according to claim 11 , wherein the current scene is a scene recognized by the electronic device.
19. The electronic device according claim 11 , wherein the current scene comprises any one of a shopping mall, a cinema, a conference room, a concert hall, an office, a kitchen, and a living room.
20. The electronic device according to claim 11 , wherein the preset room impulse response database comprises a room impulse response autonomously measured by the user.