Artifact reduction in time compression
View Patent ↗Various techniques are disclosed for reducing artifacts generated by time compression. by adapting the time compression based on the state of the received audio. The amount of time compression may be bounded based on audio characteristics. Another feature provides a way of determining the most correlated portions of segments of audio. Voiced speech may be distinguished from unvoiced speech. Another feature provides a way of distinguishing between silence, voiced speech, and unvoiced speech. Time compression may be adapted during periods of lengthy silence. Another feature allows for reducing time compression during sensitive portions of the received audio. One or more of these features may be present in different embodiments.
1. A method of time-compressing audio data, comprising:
receiving audio data and storing the audio data in a frame buffer of an audio-processing apparatus;
selecting a cut point in the audio data by the audio-processing apparatus, separating a first segment of the audio data and a second segment of the audio data,
wherein the cut point is selected to prevent audio data compressed in a first iteration of the method from being compressed in a second iteration of the method, and
wherein the cut point defines the second segment to have a length no greater a maximum overlap length value;
calculating an overlap length of the first segment and the second segment, responsive to characteristics of the audio data; and
overlapping by a time compression logic of the audio-processing apparatus the overlap length of the second segment on the first segment, generating an output audio data,
wherein the overlap length is randomly reduced if the audio data comprises unvoiced speech or silence for more than a threshold number of audio frames.
2. The method of claim 1 , further comprising:
determining the maximum overlap length value responsive to a maximum pitch expected in the audio data.
3. The method of claim 1 , wherein the zero is a valid overlap length value.
4. The method of claim 1 , wherein the act of calculating an overlap length of the first segment and the second segment responsive to characteristics of the audio data comprises:
calculating a number of quiet samples in the audio data; and
calculating the overlap length responsive to the number of quiet samples.
5. The method of claim 4 , wherein the act of calculating the overlap length responsive to the number of quiet samples comprises:
calculating the overlap length by subtracting a random number from the number of quiet samples.
6. The method of claim 1 , wherein the act of calculating an overlap length of the first segment and the second segment responsive to characteristics of the audio data comprises:
distinguishing unvoiced speech from voiced speech in the audio data; and
calculating the overlap length based on the length of the second segment if the audio data contains unvoiced speech.
7. The method of claim 6 , wherein the act of calculating the overlap length based on the length of the second segment comprises:
calculating the overlap length by subtracting a random number from the length of the second segment.
8. The method of claim 1 , wherein the act of calculating an overlap length of the first segment and the second segment responsive to characteristics of the audio data comprises:
calculating a most correlated overlap length, wherein the most correlated overlap length is allowed to exceed the length of the first segment.
9. The method of claim 8 , wherein the act of calculating an overlap length of the first segment and the second segment responsive to characteristics of the audio data further comprises:
calculating the overlap length as 0 if the most correlated overlap length is greater than the length of the first segment.
10. The method of claim 8 , wherein the act of calculating an overlap length of the first segment and the second segment responsive to characteristics of the audio data further comprises:
calculating the overlap length as 0 if the most correlated overlap length is less than a predetermined minimum most correlated overlap length.
11. The method of claim 1 , wherein the act of calculating an overlap length of the first segment and the second segment, responsive to characteristics of the audio data comprises:
calculating a whiteness value of the audio data.
12. The method of claim 1 , wherein the act of calculating an overlap length of the first segment and the second segment, responsive to characteristics of the audio data comprises:
calculating a number of quiet samples in the audio data.
13. The method of claim 1 , wherein the act of calculating an overlap length of the first segment and the second segment, responsive to characteristics of the audio data comprises:
calculating signal-to-noise ratio data for the audio data.
14. An apparatus, comprising:
a decoder logic configured to decode a received audio signal and to generate an audio data;
a hardware frame buffer for storing the audio data; and
a time-compression logic configured to time-compress audio data obtained from the frame buffer, comprising:
logic configured to select a cut point in the audio data separating a first segment of the audio data and a second segment of the audio data,
wherein the cut point is selected to prevent audio data compressed in a first compression iteration from being compressed in a second compression iteration, and
wherein the cut point defines the second segment to have a length no greater a maximum overlap length value;
logic configured to calculate an overlap length of the first segment and the second segment, responsive to characteristics of the audio data; and
logic configured to overlap and add the overlap length of the second segment on the first segment, generating an output audio data,
wherein the overlap length calculation logic randomly reduces the overlap length if the audio data comprises unvoiced speech or silence for more than a threshold number of audio frames.
15. The apparatus of claim 14 , wherein the apparatus is a videoconferencing endpoint.
16. The apparatus of claim 14 , wherein the apparatus is a multipoint control unit of a videoconferencing system.
17. The apparatus of claim 14 , wherein the apparatus is a telephone.
18. The apparatus of claim 14 , wherein the overlap length is allowed to be zero.
19. The apparatus of claim 14 , wherein the overlap length calculation logic calculates the overlap length differently responsive to whether the audio data comprises voiced speech, unvoiced speech, or silence.