Wearable system speech processing
A method of processing an acoustic signal is disclosed. According to one or more embodiments, a first acoustic signal is received via a first microphone. The first acoustic signal is associated with a first speech of a user of a wearable headgear unit. A first sensor input is received via a sensor, a control parameter is determined based on the sensor input. The control parameter is applied to one or more of the first acoustic signal, the wearable headgear unit, and the first microphone. Determining the control parameter comprises determining, based on the first sensor input, a relationship between the first speech and the first acoustic signal.
1. A method of processing an acoustic signal, the method comprising:
receiving, via a microphone, the acoustic signal associated with a user of a wearable device;
receiving, via one or more sensors, one or more sensor inputs, wherein the one or more sensor inputs indicate a location of the user and a material associated with the location of the user;
determining, based on the one or more sensor inputs, the location of the user;
determining, based on the one or more sensor inputs, the material associated with the location;
determining a cutoff frequency of a filter based on the location of the user and further based on the material associated with the location; and
applying the filter to the acoustic signal.
2. The method of claim 1 , wherein the filter is applied to the acoustic signal to generate a second acoustic signal, and the method further comprises providing the second acoustic signal to a speech recognition engine to generate text output associated with the acoustic signal.
3. The method of claim 1 , wherein the filter is applied to the acoustic signal to generate a second acoustic signal, and the method further comprises providing the second acoustic signal to a natural language processing engine to generate natural language data associated with the acoustic signal.
4. The method of claim 1 , further comprising:
determining control parameters based on the one or more sensor inputs; and
applying the control parameters to the acoustic signal.
5. The method of claim 4 , further comprising:
detecting, based on the one or more sensor inputs, a surface; and
determining an effect of the surface on the acoustic signal,
wherein the control parameters cause a reduction of the effect of the surface on the acoustic signal.
6. The method of claim 5 , further comprising determining an acoustic property of the surface, wherein the effect of the surface on the acoustic signal is determined based on the acoustic property.
7. The method of claim 4 , further comprising:
detecting, based on the one or more sensor inputs, a person different from the user; and
determining an effect of the person on the acoustic signal,
wherein the control parameters cause a reduction of the effect of the person on the acoustic signal.
8. The method of claim 4 , wherein the control parameters comprise a control parameter for echo cancellation, and said determining the control parameters based on the one or more sensor inputs comprises:
detecting, based on the one or more sensor inputs, a surface; and
determining a time of flight between the surface and the microphone.
9. The method of claim 4 , wherein the control parameters comprise a control parameter for beamforming, and said determining the control parameters based on the one or more sensor inputs comprises determining a time of flight between the user and the microphone.
10. The method of claim 4 , further comprising determining a three-dimensional representation of an environment of the wearable device; and wherein said determining the control parameters is further based on the three-dimensional representation of the environment of the wearable device.
11. The method of claim 1 , further comprising:
determining a quality of the acoustic signal;
in accordance with a determination that the quality of the acoustic signal is below a quality threshold, presenting a message to the user to move from the location to a new location to improve the quality of the acoustic signal.
12. The method of claim 1 , wherein the wearable device comprises the one or more sensors.
13. The method of claim 12 , wherein:
the one or more sensor inputs comprise an image, and
the material associated with the location is determined based on the image.
14. The method of claim 1 , wherein the filter comprises a high-pass filter.
15. A system comprising:
a wearable device;
a microphone;
one or more sensors; and
one or more processors configured to perform a method comprising:
receiving, via the microphone, an acoustic signal associated with a user of the wearable device;
receiving, via the one or more sensors, one or more sensor inputs, wherein the one or more sensor inputs indicate a location of the user and a material associated with the location of the user;
determining, based on the one or more sensor inputs, the location of the user;
determining, based on the one or more sensor inputs, the material associated with the location;
determining a cutoff frequency of a filter based on the location of the user and further based on the material associated with the location; and
applying the filter to the acoustic signal.
16. The system of claim 14 , wherein the method further comprises:
determining control parameters based on the one or more sensor inputs;
applying the control parameters to the acoustic signal;
detecting, based on the one or more sensor inputs, a surface; and
determining an effect of the surface on the acoustic signal,
wherein the control parameters cause a reduction of the effect of the surface on the acoustic signal.
17. The system of claim 15 , wherein the filter is applied to the acoustic signal to generate a second acoustic signal, and the method further comprises providing the second acoustic signal to a speech recognition engine to generate text output associated with the acoustic signal.
18. The system of claim 15 , wherein the filter is applied to the acoustic signal to generate a second acoustic signal, and the method further comprises providing the second acoustic signal to a natural language processing engine to generate natural language data associated with the acoustic signal.
19. The system of claim 15 , wherein the wearable device comprises the one or more sensors.
20. The system of claim 15 , wherein the filter comprises a high-pass filter.
21. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving, via a microphone, an acoustic signal associated with a user of a wearable device;
receiving, via one or more sensors, one or more sensor inputs, wherein the one or more sensor inputs indicate a location of the user and a material associated with the location of the user;
determining, based on the one or more sensor inputs, the location of the user;
determining, based on the one or more sensor inputs, the material associated with the location;
determining a cutoff frequency of a filter based on the location of the user and further based on the material associated with the location; and
applying the filter to the acoustic signal.