Wearable system speech processing
A method of processing an acoustic signal is disclosed. According to one or more embodiments, a first acoustic signal is received via a first microphone. The first acoustic signal is associated with a first speech of a user of a wearable headgear unit. A first sensor input is received via a sensor, a control parameter is determined based on the sensor input. The control parameter is applied to one or more of the first acoustic signal, the wearable headgear unit, and the first microphone. Determining the control parameter comprises determining, based on the first sensor input, a relationship between the first speech and the first acoustic signal.
1. A method of processing an acoustic signal, the method comprising:
receiving, via a first microphone, a first acoustic signal associated with a first speech of a user of a wearable headgear unit;
receiving, via a sensor, a first sensor input, wherein the first sensor input indicates a location of the user;
determining a characteristic frequency associated with the user based on the first acoustic signal;
determining control parameters based on the sensor input, wherein:
the control parameters comprise a filter having a cutoff frequency, and
the filter cutoff frequency is determined based on the location of the user; and
applying the control parameters to one or more of the first acoustic signal, the wearable headgear unit, and the first microphone.
2. The method of claim 1 , wherein the control parameters are applied to the first acoustic signal to generate a second acoustic signal, and the method further comprises providing the second acoustic signal to a speech recognition engine to generate text output corresponding to the first speech.
3. The method of claim 1 , wherein the control parameters are applied to the first acoustic signal to generate a second acoustic signal, and the method further comprises providing the second acoustic signal to a natural language processing engine to generate natural language data corresponding to the first speech.
4. The method of claim 1 , wherein said determining the control parameters based on the sensor input comprises:
detecting, based on a second sensor input, a surface; and
determining, an effect of the surface on a relationship between the first speech and the first acoustic signal,
wherein the control parameters, when applied to the one or more of the first acoustic signal, the wearable headgear unit, and the first microphone, cause a reduction of the effect of the surface on the relationship between the first speech and the first acoustic signal.
5. The method of claim 4 , further comprising determining an acoustic property of the surface, wherein the effect of the surface on the relationship between the first speech and the first acoustic signal is determined based on the acoustic property.
6. The method of claim 1 , wherein said determining the control parameters comprises:
determining the control parameters based on a second sensor input;
detecting, based on the second sensor input, a person different from the user; and
determining an effect of a speech of the person on a relationship between the first speech and the first acoustic signal,
wherein the control parameters, when applied to the one or more of the first acoustic signal, the wearable headgear unit, and the first microphone, cause a reduction of the effect of the speech on the relationship between the first speech and the first acoustic signal.
7. The method of claim 1 , wherein the control parameters comprise a control parameter for an echo cancellation module, and said determining the control parameter based on the sensor input comprises:
detecting, based on the sensor input, a surface; and
determining a time of flight between the surface and the first microphone.
8. The method of claim 1 , wherein the control parameters comprise a control parameter for a beamforming module, and said determining the control parameters based on the sensor input comprises determining a time of flight between the user and the first microphone.
9. The method of claim 1 , wherein the control parameters comprise a control parameter for a noise reduction module, and said determining the control parameters based on the sensor input comprises determining a frequency to be attenuated in the first acoustic signal.
10. The method of claim 1 , wherein the sensor is coupled to the wearable headgear unit.
11. A system comprising:
a wearable headgear unit including:
a display for displaying a mixed reality environment to a user;
a speaker; and
one or more processors configured to perform a method comprising:
receiving, via a first microphone, a first acoustic signal associated with a first speech of the user;
determining a characteristic frequency associated with the user based on the first acoustic signal;
receiving, via a sensor, a first sensor input, wherein the first sensor input indicates a location of the user;
determining control parameters based on the sensor input, wherein:
the control parameters comprise a filter having a cutoff frequency, and
the filter cutoff frequency is determined based on the location of the user; and
applying the control parameters to one or more of the first acoustic signal, the wearable headgear unit, and the first microphone.
12. The system of claim 11 , wherein the control parameters are applied to the first acoustic signal to generate a second acoustic signal, and the method further comprises providing the second acoustic signal to a speech recognition engine to generate text output corresponding to the first speech.
13. The system of claim 11 , wherein the control parameters are applied to the first acoustic signal to generate a second acoustic signal, and the method further comprises providing the second acoustic signal to a natural language processing engine to generate natural language data corresponding to the first speech.
14. The system of claim 11 , wherein said determining the control parameters based on the sensor input comprises:
detecting, based on a second sensor input, a surface; and
determining, an effect of the surface on a relationship between the first speech and the first acoustic signal,
wherein the control parameters, when applied to the one or more of the first acoustic signal, the wearable headgear unit, and the first microphone, cause a reduction of the effect of the surface on the relationship between the first speech and the first acoustic signal.
15. The system of claim 14 , wherein the method further comprises determining an acoustic property of the surface, and wherein the effect of the surface on the relationship between the first speech and the first acoustic signal is determined based on the acoustic property.
16. The system of claim 11 , wherein said determining the control parameters comprises:
determining the control parameters based on a second sensor input;
detecting, based on the second sensor input, a person different from the user; and
determining an effect of a speech of the person on a relationship between the first speech and the first acoustic signal,
wherein the control parameters, when applied to the one or more of the first acoustic signal, the wearable headgear unit, and the first microphone, cause a reduction of the effect of the speech on the relationship between the first speech and the first acoustic signal.
17. The system of claim 11 , wherein the control parameters comprise a control parameter for an echo cancellation module, and said determining the control parameters based on the sensor input comprises:
detecting, based on the sensor input, a surface; and
determining a time of flight between the surface and the first microphone.
18. The system of claim 11 , wherein the control parameters comprise a control parameter for a beamforming module, and said determining the control parameters based on the sensor input comprises determining a time of flight between the user and the first microphone.
19. The system of claim 11 , wherein the control parameters comprise a control parameter for a noise reduction module, and said determining the control parameters based on the sensor input comprises determining a frequency to be attenuated in the first acoustic signal.
20. The system of claim 11 , wherein the sensor is coupled to the wearable headgear unit.
21. The method of claim 1 , further comprising determining a three-dimensional representation of an environment of the wearable headgear unit; and wherein said determining the control parameters is further based on the three-dimensional representation of the environment of the wearable headgear unit.
22. The method of claim 1 , further comprising:
presenting, based on the control parameters, a message to the user of the wearable headgear unit to move from the location to a new location to improve a quality of the first acoustic signal,
wherein:
said determining the control parameters further comprises determining, based on a second sensor input, a relationship between the first speech and the first acoustic signal.