Granted Patent B2

US 12,383,832 · App. 18/223,711 · Granted Aug 12, 2025

Inventor: Muyong Cao (Guangdong, CN)

Assignee: Tencent Technology (Shenzhen) Company Limited

A63F13/54A63F13/424A63F2300/6063

Abstract

Claims (77)

1. An audio processing method, executed by a first terminal, comprising:

obtaining a voice audio of a first game user and spatial position information of a first virtual object controlled by the first game user in a game scene;

performing conversion processing on the voice audio of the first game user to obtain a target audio matching a character attribute of the first virtual object; and

transmitting the target audio and the spatial position information of the first virtual object to a second terminal such that the second terminal plays the target audio according to the spatial position information of the first virtual object, a second virtual object controlled by a second game user using the second terminal and the first virtual object being in a same game scene.

2. The method according to claim 1 , wherein the performing the conversion processing on the voice audio of the first game user to obtain the target audio comprises:

performing first transformation processing on the voice audio of the first game user to extract frequency domain information of the voice audio of the first game user, the frequency domain information comprising fundamental tone frequency domain information and overtone frequency domain information;

performing modification on the overtone frequency domain information according to the character attribute of the first virtual object to obtain modified overtone frequency domain information;

fusing the fundamental tone frequency domain information and the modified overtone frequency domain information; and

performing second transformation processing on fused frequency domain information to obtain the target audio matching the character attribute of the first virtual object.

3. The method according to claim 2 , wherein the performing the modification on the overtone frequency domain information according to the character attribute of the first virtual object to obtain modified overtone frequency domain information comprises:

obtaining audio configuration information corresponding to the character attribute of the first virtual object, the audio configuration information comprising overtone configuration information; and

performing modification on the overtone frequency domain information according to the overtone configuration information to obtain the modified overtone frequency domain information.

4. The method according to claim 3 , wherein the obtaining the audio configuration information comprises:

determining the audio configuration information according to the character attribute of the first virtual object or according to the game scene.

5. The method according to claim 1 , wherein the spatial position information of the first virtual object comprises target coordinates of the first virtual object in the game scene determined based on a coordinate origin, and the obtaining the spatial position information of the first virtual object comprises:

determining a target point in the game scene as the coordinate origin, the target point in the game scene comprising a camera or a light source point; and

establishing a spatial coordinate system according to the coordinate origin; and

generating the target coordinates of the first virtual object based on the spatial coordinate system.

6. The method according to claim 1 , wherein the spatial position information of the first virtual object comprises target distance information and orientation information between the first virtual object and the second virtual object, and the obtaining the spatial position information of the first virtual object comprises:

obtaining first position information of the first virtual object in the game scene, and second position information of the second virtual object in the game scene;

performing a distance operation on the first position information and the second position information to obtain the target distance information between the first virtual object and the second virtual object; and

performing an orientation operation on the first position information and the second position information to obtain the orientation information between the first virtual object and the second virtual object.

7. The method according to claim 1 , wherein the transmitting the target audio and the spatial position information of the first virtual object to the second terminal comprises:

encoding the target audio to generate a first audio data packet;

transmitting the first audio data packet to the second terminal via a first data channel; and

transmitting the spatial position information of the first virtual object to the second terminal via a second data channel, wherein the first data channel is different from the second data channel.

8. The method according to claim 1 , wherein the transmitting the target audio and the spatial position information of the first virtual object to the second terminal comprises:

encoding the target audio to generate a first audio data packet;

adding the spatial position information of the first virtual object to the first audio data packet; and

transmitting the first audio data packet including the spatial position information of the first virtual object to the second terminal.

9. An audio processing method, executed by a second terminal, comprising:

receiving a target audio of a first game user and spatial position information of a first virtual object from a first terminal, the first virtual object being a virtual object controlled by the first game user using the first terminal in a game scene, and the target audio being an audio obtained by performing conversion processing on a voice audio of the first game user and the target audio matching a character attribute of the first virtual object; and

playing the target audio according to the spatial position information of the first virtual object, the first virtual object and a second virtual object controlled by a second game user being in a same game scene.

10. The method according to claim 9 , wherein the playing the target audio according to the spatial position information of the first virtual object comprises:

determining audio playback information between the first virtual object and the second virtual object based on the spatial position information of the first virtual object, the audio playback information comprising audio volume information and audio orientation information; and

playing the target audio according to the audio playback information.

11. The method according to claim 10 , wherein the determining the audio playback information comprises:

obtaining target distance information between the first virtual object and the second virtual object based on the spatial position information of the first virtual object;

obtaining a mapping relationship between different distance information and volume information;

determining the audio volume information between the first virtual object and the second virtual object according to the mapping relationship and the target distance information; and

determining the audio playback information according to the audio volume information.

12. The method according to claim 10 , wherein the spatial position information of the first virtual object comprises target coordinates of the first virtual object in the game scene determined based on a coordinate origin, and the determining the audio playback information comprises:

obtaining reference coordinates of the second virtual object in the game scene;

determining the audio orientation information between the first virtual object and the second virtual object based on the target coordinates and the reference coordinates; and

determining the audio playback information according to the audio orientation information.

13. An audio processing apparatus, comprising:

a memory operable to store computer-readable instructions; and

a processor circuitry operable to read the computer-readable instructions, the processor circuitry when executing the computer-readable instructions is configured to:

obtain a voice audio of a first game user and spatial position information of a first virtual object controlled by the first game user in a game scene;

perform conversion processing on the voice audio of the first game user to obtain a target audio matching a character attribute of the first virtual object; and

transmit the target audio and the spatial position information of the first virtual object to a second terminal such that the second terminal plays the target audio according to the spatial position information of the first virtual object, a second virtual object controlled by a second game user using the second terminal and the first virtual object being in a same game scene.

14. The apparatus according to claim 13 , wherein the processor circuitry is configured to:

perform first transformation processing on the voice audio of the first game user to extract frequency domain information of the voice audio of the first game user, the frequency domain information comprising fundamental tone frequency domain information and overtone frequency domain information;

perform modification on the overtone frequency domain information according to the character attribute of the first virtual object to obtain modified overtone frequency domain information;

fuse the fundamental tone frequency domain information and the modified overtone frequency domain information; and

perform second transformation processing on fused frequency domain information to obtain the target audio matching the character attribute of the first virtual object.

15. The apparatus according to claim 13 , wherein the processor circuitry is configured to:

obtain audio configuration information corresponding to the character attribute of the first virtual object, the audio configuration information comprising overtone configuration information; and

perform modification on the overtone frequency domain information according to the overtone configuration information to obtain the modified overtone frequency domain information.

16. The apparatus according to claim 13 , wherein the spatial position information of the first virtual object comprises target coordinates of the first virtual object in the game scene determined based on a coordinate origin, and the processor circuitry is configured to:

determine a target point in the game scene as the coordinate origin, the target point in the game scene comprising a camera or a light source point; and

establish a spatial coordinate system according to the coordinate origin; and

generate the target coordinates of the first virtual object based on the spatial coordinate system.

17. The apparatus according to claim 13 , wherein the spatial position information of the first virtual object comprises target distance information and orientation information between the first virtual object and the second virtual object, and the processor circuitry is configured to:

obtain first position information of the first virtual object in the game scene, and second position information of the second virtual object in the game scene;

perform a distance operation on the first position information and the second position information to obtain the target distance information between the first virtual object and the second virtual object; and

perform an orientation operation on the first position information and the second position information to obtain the orientation information between the first virtual object and the second virtual object.

18. The apparatus according to claim 13 , wherein the processor circuitry is configured to:

encode the target audio to generate a first audio data packet;

transmit the first audio data packet to the second terminal via a first data channel; and

transmit the spatial position information of the first virtual object to the second terminal via a second data channel, wherein the first data channel is different from the second data channel.

19. The apparatus according to claim 13 , wherein the processor circuitry is configured to:

encode the target audio to generate a first audio data packet;

add the spatial position information of the first virtual object to the first audio data packet; and

transmit the first audio data packet including the spatial position information of the first virtual object to the second terminal.

20. The apparatus according to claim 13 , wherein the processor circuitry is configured to:

determine the audio configuration information according to the character attribute of the first virtual object or according to the game scene.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (12)