IP Library Granted Patent US 10,993,063
Granted Patent B2
US 10,993,063 · App. 16/569,053 · Granted Apr 27, 2021

Method for processing 3D audio effect and related products

Inventor: Fenggui Yan (Guangdong, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04S7/303H04S3/008H04S7/304H04S2400/01H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,993,063
App. No.
16/569,053
Granted
Apr 27, 2021
Kind
B2
Abstract

A method for processing a 3D audio effect and related products are provided. The method includes the following. In a VR scenario, eight first positions of eight monaural sound sources and eight pieces of monaural data corresponding to the eight monaural sound sources are obtained, where the eight monaural sound sources correspond to a target object, and each eight monaural sound source locates at a position with unique 3D coordinates. A second position of a target object in the VR scenario is obtained, where the second position has 3D coordinates, and the eight first positions and the second position are based on the same coordinate origin. A distance between each of the eight first positions and the second position is determined to obtain eight distances. The eight pieces of monaural data are adjusted according to the eight distances. The eight pieces of monaural data adjusted are synthesized to 7.1-channel data.

Claims (95)

1. A method for processing a three dimensions (3D) audio effect, comprising:

obtaining, in a virtual reality (VR) scenario, eight first positions of eight monaural sound sources and eight pieces of monaural data corresponding to the eight monaural sound sources, the eight monaural sound sources corresponding to a target object, the eight monaural sound sources being in a one-to-one correspondence relation with the eight pieces of monaural data, and each of the eight monaural sound sources locating at a position with unique 3D coordinates;

obtaining a second position of the target object in the VR scenario, the second position having 3D coordinates, and the eight first positions and the second position being based on same coordinate origin;

determining a distance between each of the eight first positions and the second position to obtain eight distances;

adjusting the eight pieces of monaural data according to the eight distances; and

synthesizing the eight pieces of monaural data adjusted to 7.1-channel data;

wherein adjusting the eight pieces of monaural data according to the eight distances comprises:

selecting, from the eight distances, at least one distance smaller than a preset threshold to obtain at least one target distance;

determining at least one piece of monaural data corresponding to the at least one target distance as a first monaural-data set;

determining, among the eight pieces of monaural data, at least one piece of monaural data that fails to be contained in the first monaural-data set as a second monaural-data set;

performing a first processing on the first monaural-data set to obtain a first target monaural-data set; and

performing a second processing on the second monaural-data set to obtain a second target monaural-data set.

2. The method of claim 1 , wherein the preset threshold is selected from the following: an average value of the eight distances, a minimum value among the eight distances, and a second minimum value among the eight distances.

3. The method of claim 1 , wherein performing the first processing on the first monaural-data set to obtain the first target monaural-data set comprises:

performing an audio effect enhancement processing on each piece of monaural data in the first monaural-data set to obtain the first target monaural-data set; and

performing the second processing on the second monaural-data set to obtain the second target monaural-data set comprises:

performing an audio effect reduction processing on at least one piece of monaural data in the second monaural-data set to obtain the second target monaural-data set.

4. The method of claim 3 , wherein performing the audio effect reduction processing on the at least one piece of monaural data in the second monaural-data set comprises:

obtaining at least one distance, wherein each of the at least one distance corresponds to one piece of monaural data in the second monaural-data set;

determining, according to a predetermined mapping relation between distances and audio effect reduction coefficients, at least one target audio effect reduction coefficient corresponding to the at least one distance; and

performing, according to the at least one target audio effect reduction coefficient, the audio effect reduction processing on the second monaural-data set.

5. The method of claim 1 , wherein performing the first processing on the first monaural-data set to obtain the first target monaural-data set comprises:

performing an audio effect maintaining processing on at least one piece of monaural data in the first monaural-data set to obtain the first target monaural-data set; and

performing the second processing on the second monaural-data set to obtain the second target monaural-data set comprises:

performing an audio effect reduction processing on at least one piece of monaural data in the second monaural-data set to obtain the second target monaural-data set.

6. The method of claim 1 , wherein determining the distance between each of the eight first positions and the second position comprises:

obtaining a first pixel position corresponding to a first position i, wherein the first position i is one of the eight first positions;

obtaining a second pixel position corresponding to the second position;

determining a target pixel difference between the first pixel position and the second pixel position; and

determining, according to a predetermined mapping relation between distances and pixel differences, a target distance corresponding to the target pixel difference, wherein the target distance is a distance between the first position i and the second position.

7. The method of claim 1 , wherein determining the second position of the target object in the VR scenario comprises:

obtaining a map corresponding to the VR scenario; and

determining a coordinate position of the target object in the map to obtain the second position.

8. The method of claim 1 , further comprising:

obtaining a target wallpaper corresponding to current environment;

determining, according to a predetermined mapping relation between wallpapers and reverberation effect parameters, a target reverberation effect parameter corresponding to the target wallpaper; and

processing, according to the target reverberation effect parameter, the 7.1-channel data to obtain reverberation 7.1-channel data.

9. An electronic device comprising:

a processor; and

a memory, configured to store one or more programs;

the one or more programs, when executed, being operable with the processor to:

obtain, in a virtual reality (VR) scenario, eight first positions of eight monaural sound sources and eight pieces of monaural data corresponding to the eight monaural sound sources, the eight monaural sound sources corresponding to a target object, the eight monaural sound sources being in a one-to-one correspondence relation with the eight pieces of monaural data, and each of the eight monaural sound sources locating at a position with unique 3D coordinates;

obtain a second position of the target object in the VR scenario, the second position having 3D coordinates, and the eight first positions and the second position being based on same coordinate origin;

determine a distance between each of the eight first positions and the second position to obtain eight distances;

adjust the eight pieces of monaural data according to the eight distances; and

synthesize the eight pieces of monaural data adjusted to 7.1-channel data;

wherein the one or more programs operable with the processor to adjust the eight pieces of monaural data according to the eight distances are operable with the processor to:

select, from the eight distances, at least one distance smaller than a preset threshold to obtain at least one target distance;

determine at least one piece of monaural data corresponding to the at least one target distance as a first monaural-data set;

determine, among the eight pieces of monaural data, at least one piece of monaural data that fails to be contained in the first monaural-data set as a second monaural-data set;

perform a first processing on the first monaural-data set to obtain a first target monaural-data set; and

perform a second processing on the second monaural-data set to obtain a second target monaural-data set.

10. The electronic device of claim 9 , wherein the preset threshold is selected from the following: an average value of the eight distances, a minimum value among the eight distances, and a second minimum value among the eight distances.

11. The electronic device of claim 9 , wherein the one or more programs operable with the processor to perform the first processing on the first monaural-data set to obtain the first target monaural-data set are operable with the processor to:

perform an audio effect enhancement processing on each piece of monaural data in the first monaural-data set to obtain the first target monaural-data set; and

the one or more programs operable with the processor to perform the second processing on the second monaural-data set to obtain the second target monaural-data set are operable with the processor to:

perform an audio effect reduction processing on at least one piece of monaural data in the second monaural-data set to obtain the second target monaural-data set.

12. The electronic device of claim 11 , wherein the one or more programs operable with the processor to perform the audio effect reduction processing on the at least one piece of monaural data in the second monaural-data set are operable with the processor to:

obtain at least one distance, wherein each of the at least one distance corresponds to one piece of monaural data in the second monaural-data set;

determine, according to a predetermined mapping relation between distances and audio effect reduction coefficients, at least one target audio effect reduction coefficient corresponding to the at least one distance; and

perform, according to the at least one target audio effect reduction coefficient, the audio effect reduction processing on the second monaural-data set.

13. The electronic device of claim 9 , wherein the one or more programs operable with the processor to perform the first processing on the first monaural-data set to obtain the first target monaural-data set are operable with the processor to:

perform an audio effect maintaining processing on at least one piece of monaural data in the first monaural-data set to obtain the first target monaural-data set; and

the one or more programs operable with the processor to perform the second processing on the second monaural-data set to obtain the second target monaural-data set are operable with the processor to:

perform an audio effect reduction processing on at least one piece of monaural data in the second monaural-data set to obtain the second target monaural-data set.

14. The electronic device of claim 9 , wherein the one or more programs operable with the processor to determine the distance between each of the eight first positions and the second position are operable with the processor to:

obtain a first pixel position corresponding to a first position i, wherein the first position i is one of the eight first positions;

obtain a second pixel position corresponding to the second position;

determine a target pixel difference between the first pixel position and the second pixel position; and

determine, according to a predetermined mapping relation between distances and pixel differences, a target distance corresponding to the target pixel difference, wherein the target distance is a distance between the first position i and the second position.

15. The electronic device of claim 9 , wherein the one or more programs operable with the processor to determine the second position of the target object in the VR scenario are operable with the processor to:

obtain a map corresponding to the VR scenario; and

determine a coordinate position of the target object in the map to obtain the second position.

16. The electronic device of claim 9 , wherein the one or more programs are further operable with the processor to:

obtain a target wallpaper corresponding to current environment;

determine, according to a predetermined mapping relation between wallpapers and reverberation effect parameters, a target reverberation effect parameter corresponding to the target wallpaper; and

process, according to the target reverberation effect parameter, the 7.1-channel data to obtain reverberation 7.1-channel data.

17. A non-transitory computer readable storage medium, being configured to store one or more computer programs;

the one or more computer programs, when executed, being operable with a processor to:

obtain, in a virtual reality (VR) scenario, eight first positions of eight monaural sound sources and eight pieces of monaural data corresponding to the eight monaural sound sources, the eight monaural sound sources corresponding to a target object, the eight monaural sound sources being in a one-to-one correspondence relation with the eight pieces of monaural data, and each of the eight monaural sound sources locating at a position with unique 3D coordinates;

obtain a second position of the target object in the VR scenario, the second position having 3D coordinates, and the eight first positions and the second position being based on same coordinate origin;

determine a distance between each of the eight first positions and the second position to obtain eight distances;

adjust the eight pieces of monaural data according to the eight distances; and

synthesize the eight pieces of monaural data adjusted to 7.1-channel data;

wherein the one or more programs operable with the processor to determine the distance between each of the eight first positions and the second position are operable with the processor to:

obtain a first pixel position corresponding to a first position i, wherein the first position i is one of the eight first positions;

obtain a second pixel position corresponding to the second position;

determine a target pixel difference between the first pixel position and the second pixel position; and

determine, according to a predetermined mapping relation between distances and pixel differences, a target distance corresponding to the target pixel difference, wherein the target distance is a distance between the first position i and the second position.

18. The non-transitory computer readable storage medium of claim 17 , wherein the one or more programs operable with the processor to adjust the eight pieces of monaural data according to the eight distances are operable with the processor to:

select, from the eight distances, at least one distance smaller than a preset threshold to obtain at least one target distance;

determine at least one piece of monaural data corresponding to the at least one target distance as a first monaural-data set;

determine, among the eight pieces of monaural data, at least one piece of monaural data that fails to be contained in the first monaural-data set as a second monaural-data set;

perform a first processing on the first monaural-data set to obtain a first target monaural-data set; and

perform a second processing on the second monaural-data set to obtain a second target monaural-data set.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2019
From: YAN, FENGGUI
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 050408/0521 →
Priority Claims (1)
CN 201811115240.0 · Sep 25, 2018 · national
Continuity (1)
Related Publication 20200100044A1 · Mar 26, 2020
Cited By (1)
US 12,425,797