Earphone and audio processing method and apparatus therefor, and storage medium
Disclosed in the present disclosure are an earphone and an audio processing method and apparatus therefor, and a storage medium. The audio processing method comprises: acquiring a bone conduction signal and a microphone signal when the earphones are in worn states; performing phase adjustment on the bone conduction signal to obtain an adjusted bone conduction signal; and inputting an audio stream, which contains the adjusted bone conduction signal and the microphone signal, into an audio playing unit of the earphones to play the audio stream, so that co-channel interference is generated between the adjusted bone conduction signal in the audio stream and a sound which is transmitted to an ear canal through a user's skeletons.
1 . An audio processing method for earphones, comprising:
acquiring a bone conduction signal and a microphone signal when the earphones are in worn states;
performing phase adjustment on the bone conduction signal to obtain an adjusted bone conduction signal; and
inputting an audio stream, which includes the adjusted bone conduction signal and the microphone signal, into an audio playing apparatus of the earphones to play the audio stream, so that co-channel interference is generated between the adjusted bone conduction signal in the audio stream and a sound which is transmitted to an ear canal through a user's skeletons,
wherein the acquiring the bone conduction signal when the earphones are in worn states comprises:
collecting the bone conduction signal when the earphones are in worn states by a bone conduction sensor, and
performing noise reduction processing on the bone conduction signal collected by the bone conduction sensor to obtain a noise-reduced bone conduction signal, wherein the performing noise reduction processing on the bone conduction signal collected by the bone conduction sensor comprises acquiring a trained neural network adaptive filter through a cloud server, and
wherein the acquiring the trained neural network adaptive filter comprises:
acquiring a training set, wherein the training set comprises a pre-collected microphone signal and a corresponding bone conduction signal before noise reduction and a bone conduction signal after noise reduction, the bone conduction signal before noise reduction is a bone conduction signal collected by the bone conduction sensor, and the bone conduction signal after noise reduction is a bone conduction signal obtained by reducing a self-voice component transmitted through air in the bone conduction signal before noise reduction, and
training the neural network adaptive filter by using the microphone signal and the bone conduction signal before noise reduction in the training set as input side training data and by using the bone conduction signal after noise reduction in the training set as output side training data, to obtain the trained neural network adaptive filter.
2 . The audio processing method for earphones of claim 1 , wherein the performing phase adjustment on the bone conduction signal comprises performing phase adjustment on the noise-reduced bone conduction signal.
3 . The audio processing method for earphones of claim 2 , wherein the performing noise reduction processing on the bone conduction signal collected by the bone conduction sensor further comprises performing filtering processing on the bone conduction signal collected by the bone conduction sensor by using the trained neural network adaptive filter, to reduce a self-voice component transmitted through air in the bone conduction signal.
4 . The audio processing method for earphones of claim 1 , wherein the performing phase adjustment on the bone conduction signal comprises directly performing phase adjustment on the bone conduction signal collected by the bone conduction sensor.
5 . The audio processing method for earphones of claim 1 , wherein the performing phase adjustment on the bone conduction signal to obtain an adjusted bone conduction signal comprises performing a reversed phase processing on the bone conduction signal to obtain an adjusted bone conduction signal.
6 . The audio processing method for earphones of claim 1 , further comprising,
before the inputting the audio stream, which includes the adjusted bone conduction signal and the microphone signal, into an audio playing apparatus of the earphones to play the audio stream, processing the audio stream based on a hearing impairment compensation algorithm and/or a speech enhancement algorithm.
7 . An earphone, comprising a processor and a memory, wherein the memory is used to store a computer program, and the computer program is loaded and executed by the processor to implement the audio processing method for earphones of claim 1 .
8 . A non-transitory computer-readable storage medium, for storing a computer-executable instruction, wherein when the computer-executable instruction is loaded and executed by a processor, the audio processing method for earphones of claim 1 is implemented.