Systems, methods, apparatus, and storage medium for processing a signal

1. A system for processing a signal, comprising:

at least one microphone configured to collect a sound signal, the sound signal including at least one of user voice and environmental noise;

at least one vibration sensor configured to collect a vibration signal, the vibration signal including at least one of the user voice and the environmental noise; and

a processor configured to:

identify signal segments excluding the user voice within the sound signal and the vibration signal, respectively;

determine, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, a relationship between a noise component in the sound signal and a noise component in the vibration signal;

determine a noise component in the sound signal in signal segments including the user voice;

determine, based on the relationship and the noise component in the sound signal in the signal segments including the user voice, a noise component in the vibration signal in the signal segments including the user voice; and

obtain a target vibration signal by removing the noise component in the vibration signal in the signal segments including the user voice,

wherein the at least one microphone includes a microphone array, the microphone array includes a plurality of microphones, and to determine, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, the relationship between the noise component in the sound signal and the noise component in the vibration signal, the processor is further configured to:

determine a first noise signal from the sound signal based on a relative positional relationship between the plurality of microphones in the microphone array in the identified signal segments excluding the user voice within the sound signal and the vibration signal, respectively, wherein the first noise signal is a noise signal synthesized from noises in all directions except a direction of the user voice in the environment; and

determine a relationship between the first noise signal and the vibration signal.

2. The system of claim 1 , wherein the processor is further configured to obtain the target vibration signal by suppressing steady-state noise in the vibration signal.

3. The system of claim 1 , wherein the processor is further configured to

convert the sound signal and the vibration signal from a time domain signal to a frequency domain signal; and

obtain a noise relationship between the noise component in the sound signal and the noise component in the vibration signal on at least one frequency domain sub-band.

4. The system of claim 1 , wherein the processor is further configured to obtain a target sound signal by performing a noise reduction processing on the sound signal in one of the signal segments including the user voice of the sound signal.

5. The system of claim 4 , wherein the processor is further configured to obtain a target signal by aliasing at least part of components in the target vibration signal with at least part of components in the target sound signal, wherein frequencies of the at least part of the components in the target vibration signal are less than frequencies of the at least part of the components in the target sound signal.

6. The system of claim 1 , wherein the processor is further configured to:

determine a first voice signal from the sound signal based on the relative positional relationship between the plurality of microphones in the microphone array in one of the signal segments including the user voice; and

obtain a target sound signal by performing, based on the first noise signal and the first voice signal, a noise reduction processing on the sound signal, or designate the first voice signal as the target sound signal.

7. The system of claim 1 , including:

a noise mixer, and to generate the sound signal, the processor is configured to perform operations including:

obtaining a microphone signal collected by at least one target microphone in the plurality of microphones; and

generating the sound signal by mixing the first noise signal and the microphone signal via the noise mixer.

8. The system of claim 7 , wherein the noise mixer is configured to:

obtain a noise level along the direction of the user voice; and

determine, based on the noise level, a mixing ratio of the first noise signal to the microphone signal.

9. The system of claim 1 , wherein a signal-to-noise ratio of the at least one vibration sensor is greater than a signal-to-noise ratio of the at least one microphone in at least part of a frequency range.

10. The system of claim 1 , further comprises a noise relationship calculator, the processor configured to:

detect whether the sound signal and the vibration signal include the user voice,

when the sound signal and the vibration signal do not include the user voice, updating the relationship between the noise component in the sound signal and the noise component in the vibration signal by the noise relationship calculator; and

when the sound signal and the vibration signal include the user voice, stop updating the relationship between the noise component in the sound signal and the noise component in the vibration signal, and performing noise reduction processing on the vibration signal to obtain the target vibration signal.

11. A method for processing a signal, comprising:

collecting a sound signal by at least one microphone, the sound signal including at least one of user voice and environmental noise;

collecting a vibration signal by at least one vibration sensor, the vibration signal including at least one of the user voice and the environmental noise;

identifying signal segments excluding the user voice within the sound signal and the vibration signal, respectively;

determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, a relationship between a noise component in the sound signal and a noise component in the vibration signal;

determining a noise component in the sound signal in signal segments including the user voice;

determining, based on the relationship and the noise component in the sound signal in the signal segments including the user voice, a noise component in the vibration the signal in signal segments including the user voice; and

obtaining a target vibration signal by removing the noise component in the vibration signal in the signal segments including the user voice, wherein:

the at least one microphone includes a microphone array, the microphone array includes a plurality of microphones, and the determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, the relationship between the noise component in the sound signal and the noise component in the vibration signal includes:

determining a first noise signal from the sound signal based on a relative positional relationship between the plurality of microphones in the microphone array in the identified signal segments excluding the user voice within the sound signal and the vibration signal, respectively, wherein the first noise signal is a noise signal synthesized from noises in all directions except a direction of the user voice in the environment; and

determining a relationship between the first noise signal and the vibration signal.

12. The method of claim 11 , including:

performing a noise reduction processing on the sound signal in one of the signal segments including the user voice of the sound signal; and

aliasing at least part of components in the target vibration signal with at least part of components in the target sound signal, wherein frequencies of the at least part of the components in the target vibration signal are less than frequencies of the at least part of the components in the target sound signal.

13. The method of claim 11 , including:

determining a first voice signal from the sound signal based on the relative positional relationship between the plurality of microphones in the microphone array in one of the signal segments including the user voice; and

obtaining a target sound signal by performing, based on the first noise signal and the first voice signal, a noise reduction processing on the sound signal, or designate the first voice signal as the target sound signal.

14. The method of claim 11 , further including:

obtaining a microphone signal collected by at least one target microphone in the plurality of microphones; and

generating the sound signal by mixing the first noise signal and the microphone signal.

15. A non-transitory computer readable medium, comprising at least one set of instructions, wherein when read by a computing device, the at least one set of instructions causes the computing device to perform a method, the method comprising:

collecting a sound signal by at least one microphone, the sound signal including at least one of user voice and environmental noise;

collecting a vibration signal by at least one vibration sensor, the vibration signal including at least one of the user voice and the environmental noise;

identifying signal segments excluding the user voice within the sound signal and the vibration signal, respectively;

determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, a relationship between a noise component in the sound signal and a noise component in the vibration signal;

determining a noise component in the sound signal in signal segments including the user voice;

determining, based on the relationship and the noise component in the sound signal in the signal segments including the user voice, a noise component in the vibration signal in the signal segments including the user voice; and

obtaining a target vibration signal by removing the noise component in the vibration signal in the signal segments including the user voice, wherein:

the at least one microphone includes a microphone array, the microphone array includes a plurality of microphones, and the determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, the relationship between the noise component in the sound signal and the noise component in the vibration signal includes:

determining a first noise signal from the sound signal based on a relative positional relationship between the plurality of microphones in the microphone array in the identified signal segments excluding the user voice within the sound signal and the vibration signal, respectively, wherein the first noise signal is a noise signal synthesized from noises in all directions except a direction of the user voice in the environment; and

determining a relationship between the first noise signal and the vibration signal.