IP Library › Granted Patent US 10,348,264
Granted Patent B2
US 10,348,264 · App. 16/027,745 · Granted Jul 9, 2019

Method and apparatus for audio mixing

Inventors: Xinliang Wang (Shenzhen, CN); Bin Li (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
H03G3/32G10L25/03H03G3/3005H04H60/04H04M3/568H04R3/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,348,264
App. No.
16/027,745
Granted
Jul 9, 2019
Kind
B2
Abstract

The embodiments of the present disclosure provide a method for audio mixing. At least two audio input signals are obtained. Then the at least two audio input signals are linearly superimposed. A mixed signal obtained by linearly superimposing the at least two audio input signals is divided into at least two audio mixing signal-intensity zones according to an audio intensity of the mixed signal. Audio intensity scalability is performed for respective audio mixing signal-intensity zones using corresponding scalability ratios. The at least two audio mixing signal-intensity zones after performing the audio intensity scalability is superimposed and output. The embodiments of the present disclosure further provide an apparatus for audio mixing.

Claims (68)

1. A method for audio mixing, comprising:

obtaining at least two audio input signals;

linearly superimposing the at least two audio input signals;

dividing a mixed signal, obtained by linearly superimposing the at least two audio input signals, into at least two audio mixing signal-intensity zones according to an audio intensity of the mixed signal;

performing audio intensity scalability for respective audio mixing signal-intensity zones using corresponding scalability ratios, wherein a scalability ratio used by an audio mixing signal-intensity zone having a higher audio intensity is smaller than a scalability ratio used by an audio mixing signal-intensity zone having a lower audio intensity; and

superimposing the at least two audio mixing signal-intensity zones after performing the audio intensity scalability, and outputting the superimposed at least two audio mixing signal-intensity zones;

wherein, dividing the mixed signal obtained by linearly superimposing the at least two audio input signals into the at least two audio mixing signal-intensity zones according to the audio intensity of the mixed signal comprises:

according to multiple pre-divided audio intensity distribution zones having an equal length, determining signals of the mixed signal that are located in different audio intensity distribution zones as the at least two audio mixing signal-intensity zones, wherein in the multiple pre-divided audio intensity distribution zones having the equal length, an nth audio intensity distribution zone is:

((n−1)×2 Q-1 , n×2 Q-1 ], where n is a positive integer, n≥1, and Q is a preconfigured constant.

2. The method of claim 1 , wherein, performing the audio intensity scalability for the respective audio mixing signal-intensity zones using the corresponding scalability ratios comprises:

using a scalability ratio [(k−1)/k]*(1/k) n corresponding to an audio mixing signal-intensity zone located in the nth audio intensity distribution zone, where k is a preconfigured scalability coefficient.

3. The method of claim 1 , wherein the method comprises:

detecting audio intensities of the at least two audio input signals to determine that at least one over-small audio input signal is present in the at least two audio input signals;

performing tone-up for an audio intensity of the at least one over-small audio input signal; and

linearly superimposing the at least two audio input signals comprises:

linearly superimposing the at least one over-small audio input signal after the tone-up with other audio input signals in the at least two audio input signals.

4. The method of claim 3 , wherein detecting the audio intensities of the at least two audio input signals to determine that the at least one over-small audio input signal is present in the at least two audio input signals comprises:

determining an audio input signal having the highest audio intensity out of the at least two audio input signals;

in response to that a ratio of an audio intensity of an audio input signal out of the at least two audio input signals to an audio intensity of the audio input signal having the highest audio intensity is smaller than a preconfigured threshold, then determining that the audio input signal is the over-small audio input signal.

5. The method of claim 3 , wherein the at least two audio input signals comprise a first audio input signal and a second audio input signal; and

detecting the audio intensities of the at least two audio input signals comprises:

performing sampling of a preconfigured length of time for the audio intensities of the at least two audio input signals; and

in response to that a ratio of a highest sampling value of the first audio input signal to a lowest sampling value of a valid audio signal of the second audio input signal is not larger than a preconfigured threshold, then determining that the first audio input signal is the over-small audio input signal.

6. The method of claim 3 , wherein performing the tone-up for the audio intensity of the at least one over-small audio input signal comprises:

performing the tone-up for the audio intensity of the at least one over-small audio input signal according to a gain coefficient 2 Q-1 /MSQ(s), where Q is a preconfigured constant, and MSQ(s) is a root-mean-square of an audio intensity sampling value of the over-small audio input signal.

7. An apparatus for audio mixing, comprising: a processor and a memory, wherein the memory stores instruction modules executable by the processor, and the instruction modules comprise:

an audio input module to obtain at least two audio input signals;

an audio mixing superimposition module to linearly superimpose the at least two audio input signals;

an intensity zone dividing module to divide a mixed signal, obtained by linearly superimposing the at least two audio input signals, into at least two audio mixing signal-intensity zones, according to an audio intensity of the mixed signal;

an audio scalability module to perform audio intensity scalability for respective audio mixing signal-intensity zones using corresponding scalability ratios, wherein a scalability ratio used by an audio mixing signal-intensity zone having a higher audio intensity is smaller than a scalability ratio used by an audio mixing signal-intensity zone having a lower audio intensity; and

an audio mixing output module to superimpose the at least two audio mixing signal-intensity zones after performing the audio intensity scalability, and output the superimposed at least two audio mixing signal-intensity zones;

wherein the intensity zone dividing module is to:

according to multiple pre-divided audio intensity distribution zones having an equal length, determine signals of the mixed signal that are located in different audio intensity distribution zones as the at least two audio mixing signal-intensity zones, wherein in the multiple pre-divided audio intensity distribution zones having the equal length, an nth audio intensity distribution zone is: ((n−1)×2 Q-1 , n×2 Q-1 ], where n is a positive integer, n≤1, and Q is a preconfigured constant.

8. The apparatus for audio mixing of claim 7 , wherein the audio scalability module performing the audio intensity scalability for the respective audio mixing signal-intensity zones using the corresponding scalability ratios comprises:

using a scalability ratio [(k−1)/k]*(1/k) n corresponding to an audio mixing signal-intensity zone located in the nth audio intensity distribution zone, where k is a preconfigured scalability coefficient.

9. The apparatus of audio mixing of claim 7 , wherein the method further comprises:

an over-small audio detection module to detect audio intensities of the at least two audio input signals to determine that at least one over-small audio input signal is present in the at least two audio input signals;

an audio tone-up module to perform tone-up for an audio intensity of the at least one over-small audio input signal; and

the audio mixing superimposition module is configured to:

linearly superimposing the at least one over-small audio input signal after the tone-up with other audio input signals in the at least two audio input signals.

10. The apparatus for audio mixing of claim 9 , wherein the over-small audio detection module is configured to:

determine an audio input signal having the highest audio intensity out of the at least two audio input signals;

in response to that a ratio of an audio intensity of an audio input signal out of the at least two audio input signals to an audio intensity of the audio input signal having the highest audio intensity is smaller than a preconfigured threshold, then determine that the audio input signal is the over-small audio input signal.

11. The apparatus for audio mixing of claim 9 , wherein the at least two audio input signals comprise a first audio input signal and a second audio input signal; and

the over-small audio detection module is configured to:

perform sampling of a preconfigured length of time for the audio intensities of the at least two audio input signals; and

in response to that a ratio of a highest sampling value of the first audio input signal to a lowest sampling value of a valid audio signal of the second audio input signal is not larger than a preconfigured threshold, then determine that the first audio input signal is the over-small audio input signal.

12. The apparatus for audio mixing of claim 9 , wherein, the audio tone-up module is configured to:

perform the tone-up for the audio intensity of the at least one over-small audio input signal according to a gain coefficient 2 Q-1 /MSQ(s), where Q is a preconfigured constant, and MSQ(s) is a root-mean-square of an audio intensity sampling value of the over-small audio input signal.

13. A non-transitory storage medium, storing computer instructions, wherein the computer instructions are executable by the processor to perform:

obtaining at least two audio input signals;

linearly superimposing the at least two audio input signals;

dividing a mixed signal, obtained by linearly superimposing the at least two audio input signals, into at least two audio mixing signal-intensity zones according to an audio intensity of the mixed signal;

performing audio intensity scalability for respective audio mixing signal-intensity zones using corresponding scalability ratios, wherein a scalability ratio used by an audio mixing signal-intensity zone having a higher audio intensity is smaller than a scalability ratio used by an audio mixing signal-intensity zone having a lower audio intensity; and

superimposing the at least two audio mixing signal-intensity zones after performing the audio intensity scalability, and outputting the superimposed at least two audio mixing signal-intensity zones;

wherein, dividing the mixed signal obtained by linearly superimposing the at least two audio input signals into the at least two audio mixing signal-intensity zones according to the audio intensity of the mixed signal comprises:

according to multiple pre-divided audio intensity distribution zones having an equal length, determining signals of the mixed signal that are located in different audio intensity distribution zones as the at least two audio mixing signal-intensity zones, wherein in the multiple pre-divided audio intensity distribution zones having the equal length, an nth audio intensity distribution zone is:

((n−1)×2 Q-1 , n×2 Q-1 ], where n is a positive integer, n≥1, and Q is a preconfigured constant.

14. The non-transitory storage medium of claim 13 , wherein dividing the mixed signal obtained by linearly superimposing the at least two audio input signals into the at least two audio mixing signal-intensity zones according to the audio intensity of the mixed signal comprises:

according to multiple pre-divided audio intensity distribution zones having an equal length, determining signals of the mixed signal that are located in different audio intensity distribution zones as the at least two audio mixing signal-intensity zones.

15. The non-transitory storage medium of claim 13 , wherein the computer instructions are executable by the processor further to perform:

detecting audio intensities of the at least two audio input signals to determine that at least one over-small audio input signal is present in the at least two audio input signals;

performing tone-up for an audio intensity of the at least one over-small audio input signal; and

linearly superimposing the at least two audio input signals comprises:

linearly superimposing the at least one over-small audio input signal after the tone-up with other audio input signals in the at least two audio input signals.

16. The non-transitory storage medium of claim 15 , wherein detecting the audio intensities of the at least two audio input signals to determine that the at least one over-small audio input signal is present in the at least two audio input signals comprises:

determining an audio input signal having the highest audio intensity out of the at least two audio input signals;

in response to that a ratio of an audio intensity of an audio input signal out of the at least two audio input signals to an audio intensity of the audio input signal having the highest audio intensity is smaller than a preconfigured threshold, then determining that the audio input signal is the over-small audio input signal.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY PREVIOUSLY RECORDED AT REEL: 046357 FRAME: 0794. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 29, 2018
From: WANG, XINLIANG; LI, BIN
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 047886/0277 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2018
From: WANG, XINLIANG; LI, BIN
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 046357/0794 →
Priority Claims (1)
CN 2016 1 0058634 · Jan 28, 2016 · national
Continuity (2)
Continuation PCTCN2017071479 · Jan 18, 2017
Related Publication 20180316328A1 · Nov 1, 2018
Cited By (1)
US 12,707,197