IP Library Granted Patent US 9,812,139
Granted Patent B2
US 9,812,139 · App. 14/596,753 · Granted Nov 7, 2017

Method, terminal, system for audio encoding/decoding/codec

Inventors: Guoming Chen (Shenzhen, CN); Yuanjiang Peng (Shenzhen, CN); Wenjun Ou (Shenzhen, CN); Hong Liu (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
G10L19/02G10L19/032G10L25/09G10L25/21
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,812,139
App. No.
14/596,753
Granted
Nov 7, 2017
Kind
B2
Abstract

Audio encoding methods/terminals, audio decoding methods/terminals, and audio codec systems are provided. A plurality of audio signals that are continuous is obtained. It is determined whether each audio signal of the plurality of audio signals includes a designated signal type, according to an audio parameter of each audio signal. A marked audio encoding stream is obtained by performing a marking to each audio signal as having or not having the designated signal type. The marking is used, at a decoding terminal, to perform an enhancement-process to one or more audio signals having the designated signal type. The enhancement-process is not performed to audio signals that do not have the designated signal type.

Claims (90)

1. An audio encoding method, comprising:

obtaining a plurality of audio signals that are continuous;

determining a type of each audio signal of the plurality of audio signals, according to an audio parameter of each audio signal, wherein the type of each audio signal is one of a designated signal type, a voice signal type, and a mute signal type; and

obtaining a marked audio encoding stream by performing a marking to each audio signal as having or not having the designated signal type, wherein the marking is used at a decoding terminal to perform an enhancement-process to one or more audio signals having the designated signal type, wherein the enhancement-process is not performed to audio signals that do not have the designated signal type,

wherein the designated signal type is an analogous audio signal, and the step of determining the type of each audio signal comprises:

obtaining the audio parameter of each audio signal, wherein the audio parameter comprises logarithmic energy, a high-zero-crossing-rate-ratio (HZCRR), and a spectral flux (SF);

determining that an audio signal is the mute signal type, when the logarithmic energy of the audio signal is less than a first threshold value;

determining that an audio signal is the voice signal type, when the logarithmic energy of the audio signal is no less than the first threshold value, and the HZCRR is more than a second threshold value; and

determining that an audio signal is the designated signal type, when the logarithmic energy of the audio signal is no less than the first threshold value, the HZCRR is no more than the second threshold value, and the spectral flux is more than a third threshold value.

2. The method according to claim 1 , wherein the designated signal type is an analogous audio signal.

3. The method according to claim 1 , further comprising:

obtaining the marked audio encoding stream;

obtaining the plurality of audio signals from the marked audio encoding stream and obtaining the marking of at least a portion of the plurality of audio signals;

performing the enhancement-process to one or more audio signals having the designated signal type according to the marking, to obtain an enhanced audio signal; and

adding the enhanced audio signal into a decoding stream of the plurality of audio signals to obtain an audio decoding signal.

4. The method according to claim 3 , wherein the designated signal type is an analogous audio signal, and wherein the step of performing the enhancement-process comprises:

performing a frequency-spectrum enhancement and an acoustic-image extension to the analogous audio signal.

5. The method according to claim 4 , wherein the step of processing the frequency-spectrum enhancement to the analogous audio signal comprises:

obtaining a frequency of each audio signal;

determining a frequency-spectrum enhancement coefficient of each audio signal, according to the frequency of each audio signal; and

performing the frequency-spectrum enhancement to each audio signal, according to the frequency-spectrum enhancement coefficient of each audio signal.

6. The method according to claim 4 , wherein performing the acoustic-image extension to the analogous audio signal comprises:

using a delaying parameter to perform the acoustic-image extension to the analogous audio signal.

7. An audio decoding method, comprising:

obtaining an audio encoding stream to be decoded;

obtaining a plurality of audio signals that are continuous and an audio parameter of each audio signal, from the audio encoding stream;

determining whether each audio signal includes a designated signal type, including:

when the audio encoding stream includes a marking for each audio signal representing a type of the audio signal, determining whether each audio signal includes the designated signal type according to the marking; and

when the audio encoding stream does not include the marking for each audio signal representing the type of the audio signal, determining whether each audio signal includes the designated signal type according to the audio parameter of each audio signal;

performing an enhancement-process to one or more audio signals having the designated signal type to obtain one or more enhanced audio signals; and

adding the one or more enhanced audio signals into a decoding stream of the plurality of audio signals to obtain an audio decoding signal,

wherein:

performing the enhancement-process to the one or more audio signals having the designated signal type comprises: performing a frequency-spectrum enhancement and an acoustic-image extension to the analogous audio signal, and

the method further comprises:

for audio signals not having the designated signal type, directly performing a high frequency recovery and a stereo recovery; and

for the one or more audio signals having the designated signal type, performing the high frequency recovery after the frequency spectrum enhancement, and performing the stereo recovery after the acoustic-image extension.

8. The method according to claim 7 , wherein the designated signal type is an analogous audio signal, wherein the audio parameter of each audio signal comprises total frequency-spectrum energy, a spectral flatness measure (SFM), and a spectral flux (SF), and wherein the step of determining whether each audio signal includes the designated signal type comprises:

determining that an audio signal is the analogous audio signal, when the total frequency-spectrum energy of the audio signal is more than a first threshold value, the spectral flatness measure (SFM) is less than a second threshold value, and the spectral flux (SF) is more than a third threshold value.

9. The method according to claim 7 , wherein the step of processing the frequency-spectrum enhancement to the analogous audio signal comprises:

obtaining a frequency of each audio signal;

determining a frequency-spectrum enhancement coefficient of each audio signal, according to the frequency of each audio signal; and

performing the frequency-spectrum enhancement to each audio signal, according to the frequency-spectrum enhancement coefficient of each audio signal.

10. The method according to claim 7 , wherein performing the acoustic-image extension to the analogous audio signal comprises:

using a delaying parameter to perform the acoustic-image extension to the analogous audio signal.

11. The method according to claim 7 , wherein:

one bit is used to encode the marking representing the type for each audio signal in the audio encoding stream;

audio signals having the designated signal type is marked as 1, and

audio signals not having the designated signal type is marked as 0.

12. An audio encoding apparatus, comprising at least one processor configured to:

obtain a plurality of audio signals that are continuous;

determine a type of each audio signal of the plurality of audio signals, according to an audio parameter of each audio signal, wherein the type of each audio signal is one of a designated signal type, a voice signal type, and a mute signal type; and

perform a marking to each audio signal as having or not having the designated signal type to obtain a marked audio encoding stream, wherein the marking is used, when decoding, to perform an enhancement-process to one or more audio signals having the designated signal type,

wherein the designated signal type is an analogous audio signal, and the at least one processor is further configured to:

obtain the audio parameter of each audio signal, wherein the audio parameter comprises logarithmic energy, a high-zero-crossing-rate-ratio (HZCRR), and a spectral flux (SF);

determine that an audio signal is the mute signal type, when the logarithmic energy of the audio signal is less than a first threshold value;

determine that an audio signal is the voice signal type, when the logarithmic energy of the audio signal is no less than the first threshold value, and the HZCRR is more than a second threshold value; and

determine that an audio signal is the analogous audio signal, when the logarithmic energy of the audio signal is no less than the first threshold value, the HZCRR is no more than the second threshold value, and the spectral flux is more than a third threshold value.

13. The apparatus according to claim 12 , wherein the designated signal type is an analogous audio signal.

14. The apparatus according to claim 12 , the at least one processor is further configured to:

obtain the marked audio encoding stream;

obtain the plurality of audio signals from the audio encoding stream;

obtain the marking of at least a portion of the plurality of audio signals;

perform the enhancement-process to one or more audio signals having the designated signal type according to the marking, to obtain an enhanced audio signal; and

add the enhanced audio signal into a decoding stream of the plurality of audio signals to obtain an audio decoding signal.

15. The apparatus according to claim 14 , wherein the designated signal type is an analogous audio signal, and wherein the at least one processor is further configured to perform a frequency-spectrum enhancement and an acoustic-image extension to the analogous audio signal.

16. The apparatus according to claim 15 , wherein the at least one processor is further configured to:

obtain a frequency of each audio signal;

determine a frequency-spectrum enhancement coefficient of each audio signal, according to the frequency of each audio signal; and

perform the frequency-spectrum enhancement to each audio signal, according to the frequency-spectrum enhancement coefficient of each audio signal determined.

17. The apparatus according to claim 15 , wherein the at least one processor is further configured to:

use a time delaying parameter to perform the acoustic-image extension to the analogous audio signal.

18. An audio decoding apparatus, comprising at least one processor configured to:

obtain an audio encoding stream to be decoded;

obtain, a plurality of audio signals that are continuous and an audio parameter of each audio signal, from the audio encoding stream;

determine whether each audio signal includes a designated signal type, including:

when the audio encoding stream includes a marking for each audio signal representing a type of the audio signal, determining whether each audio signal includes the designated signal type according to the marking; and

when the audio encoding stream does not include the marking for each audio signal representing the type of the audio signal, determining whether each audio signal includes the designated signal type according to the audio parameter of each audio signal;

perform an enhancement-process to one or more audio signals having the designated signal type to obtain one or more enhanced audio signals; and

add the one or more enhanced audio signals into a decoding stream of the plurality of audio signals to obtain an audio decoding signal,

wherein the at least one processor is further configured to:

perform a frequency-spectrum enhancement and an acoustic-image extension to the analogous audio signal,

for audio signals not having the designated signal type, directly perform a high frequency recovery and a stereo recovery; and

for the one or more audio signals having the designated signal type, perform the high frequency recovery after the frequency spectrum enhancement, and perform the stereo recovery after the acoustic-image extension.

19. The apparatus according to claim 18 , wherein the designated signal type is an analogous audio signal, wherein the audio parameter of each audio signal comprises total frequency-spectrum energy, a spectral flatness measure (SFM), and a spectral flux (SF), and wherein the at least one processor is further configured to determine that an audio signal is the analogous audio signal, when the total frequency-spectrum energy of the audio signal is more than a first threshold value, the spectral flatness measure (SFM)is less than a second threshold value, and the spectral flux(SF) is more than a third threshold value.

20. The apparatus according to claim 18 , wherein the at least one processor is further configured to:

obtain a frequency of each audio signal;

determine a frequency-spectrum enhancement coefficient of each audio signal, according to the frequency of each audio signal; and

perform the frequency-spectrum enhancement to each audio signal, according to the frequency-spectrum enhancement coefficient of each audio signal.

21. The apparatus according to claim 18 , wherein the at least one processor is further configured to:

use a time delaying parameter to perform the acoustic-image extension to the analogous audio signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2015
From: CHEN, GUOMING; PENG, YUANJIANG; OU, WENJUN; LIU, HONG
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 034709/0700 →
Priority Claims (1)
CN 2013 1 0364530 · Aug 20, 2013 · national
Continuity (2)
Continuation PCTCN2014082888 · Jul 24, 2014
Related Publication 20150127356A1 · May 7, 2015