Reparation of corrupted audio signals
View Patent ↗Corrupted portions of an audio signal are detected and repaired. An audio signal, including numerous sequential frames, may be received from an audio input device. One or more corrupted frames included in the audio signal may be identified. A frame approximating an uncorrupted frame and corresponding to each corrupted frame may be constructed. Each corrupted frame may be replaced with a corresponding constructed frame to generate a repaired audio signal. The repaired audio signal may be outputted via an audio output device.
1. A method for repairing corrupted audio signals, the method comprising:
receiving an audio signal, the audio signal comprising a plurality of sequential frames;
detecting corruption in a frame in the plurality of sequential frames, the detecting including forming a comparison between a subject frame and one or more frames proximal to the subject frame, the comparison based at least in part on a correlation between the subject frame and the one or more proximal frames;
identifying, using at least one processor, a corrupted frame in response to detecting corruption in the frame;
constructing a frame corresponding to the corrupted frame, the constructed frame approximating an uncorrupted frame; and
replacing the corrupted frame with the corresponding constructed frame to generate a repaired audio signal.
2. The method of claim 1 , further comprising decomposing the audio signal into frequency subbands.
3. The method of claim 1 , wherein one or more corrupted frames are consecutive.
4. The method of claim 2 , wherein detecting corruption in the frame is performed on a per subband basis.
5. The method of claim 1 , wherein the comparison is based, at least partially, on spectral flux between the subject frame and the one or more proximal frames.
6. The method of claim 1 , wherein the constructing is based, at least partially, on one or more frames proximal to the corrupted frame.
7. The method of claim 1 , wherein the constructing comprises extrapolating from at least one frame preceding the corrupted frame.
8. The method of claim 1 , wherein the constructing comprises interpolating between at least one frame preceding the corrupted frame and at least one frame succeeding the corrupted frame.
9. The method of claim 1 , further comprising crossfading the constructed frame and an adjacent uncorrupted frame.
10. The method of claim 1 , wherein detecting corruption in the frame comprises receiving an indication of the corrupted frame.
11. The method of claim 1 , wherein the corrupted frame is a result of packet loss.
12. A system for repairing corrupted audio signals, the system comprising:
a detection module using a processor:
to detect corruption in one or more frames included in a received audio signal, the detecting including forming a comparison between a subject frame and one or more frames proximal to the subject frame, the comparison based at least in part on a correlation between the subject frame and the one or more proximal frames, and
to identify one or more corrupted frames in response to detecting corruption in the one or more frames;
a construction module using a processor to construct one or more frames, each of the one or more constructed frames corresponding to a respective corrupted frame of the one or more corrupted frames, each constructed frame approximating an uncorrupted frame; and
a reparation module using a processor to replace each of the one or more corrupted frames with a corresponding constructed frame to generate a repaired audio signal.
13. The system of claim 12 , further comprising an analysis module using a processor to decompose the audio signal into frequency subbands.
14. The system of claim 12 , further comprising a communications module using a processor to receive the audio signal.
15. The system of claim 12 , wherein the comparison is further based, at least partially, on spectral flux between the subject frame and the one or more proximal frames.
16. The system of claim 12 , wherein constructing the one or more frames by the construction module is based, at least partially, on one or more frames proximal to the one or more corrupted frames.
17. The system of claim 12 , wherein constructing the one or more frames comprises extrapolation from at least one frame preceding the one or more corrupted frames.
18. The system of claim 12 , wherein constructing the one or more frames comprises interpolation between at least one frame preceding the one or more corrupted frames and at least one frame succeeding the one or more corrupted frames.
19. The system of claim 12 , wherein the reparation module is further crossfades a constructed frame and an adjacent uncorrupted frame.
20. A non-transitory computer-readable storage medium having a program embodied thereon, the program executable by a processor to perform a method for repairing corrupted audio signals, the method comprising:
receiving an audio signal, the audio signal comprising a plurality of sequential frames;
detecting corruption in one or more frames included in the audio signal, the detecting including forming a comparison between a subject frame and one or more frames proximal to the subject frame, the comparison based at least in part on a correlation between the subject frame and the one or more proximal frames;
identifying one or more corrupted frames in response to detecting corruption in the one or more frames;
constructing one or more frames, each of the one or more constructed frames corresponding to a respective corrupted frame of the one or more corrupted frames, each constructed frame approximating an uncorrupted frame; and
replacing each of the one or more corrupted frames with a corresponding constructed frame to generate a repaired audio signal.
21. The non-transitory computer-readable storage medium of claim 20 , wherein the constructed frame is constructed based at least in part on one or more frames proximal to the one or more corrupted frames.