Neural network-driven frequency translation
Disclosed herein, among other things, are apparatus and methods for neural network-driven frequency translation for hearing assistance devices. Various embodiments include a method of signal processing an input signal in a hearing assistance device, the hearing assistance device including a receiver and a microphone. The method includes performing neural network processing to train a processor to identify acoustic features in a plurality of audio signals and predict target outputs for the plurality of audio signals, and using the trained processor to control frequency translation of the input signal.
1. A method of signal processing an input signal in a hearing assistance device, the hearing assistance device including a receiver and a microphone, the method comprising:
performing neural network processing to train a processor to identify acoustic features in a plurality of audio signals and predict outputs for the plurality of audio signals by mapping input features of the plurality of audio signals to a set of algorithm parameters for producing frequency-lowered speech cues, including incorporating contextual cues to enable identification and extraction of acoustic features from the input signal; and
using the trained processor and the set of algorithm parameters to automatically recognize and translate speech sounds from the input signal to control frequency translation of the input signal.
2. The method of claim 1 , wherein training the processor to identify acoustic features in a plurality of audio signals and predict outputs for the plurality of audio signals includes performing training offline from normal use of the hearing assistance device.
3. The method of claim 1 , wherein the training is performed on an external device.
4. The method of claim 3 , wherein the training is performed on a server in a cloud.
5. The method of claim 4 , wherein neural network processing runs on the server and updates parameters of frequency translation on the hearing assistance device.
6. The method of claim 3 , wherein the training is performed on a smart phone.
7. The method of claim 6 , wherein neural network processing runs on the smart phone and updates parameters of frequency translation on the hearing assistance device.
8. The method of claim 1 , wherein training the processor to identify acoustic features in a plurality of audio signals and predict outputs for the plurality of audio signals includes training the processor to identify relationships between noisy speech input and frequency lowered cues.
9. The method of claim 1 , wherein training the processor to identify acoustic features in a plurality of audio signals and predict outputs for the plurality of audio signals includes training the processor to detect consonants in speech that are masked by background noise.
10. The method of claim 1 , wherein training the processor to identify acoustic features in a plurality of audio signals and predict outputs for the plurality of audio signals includes using a recurrent network to provide context.
11. The method of claim 1 , wherein training the processor to identify acoustic features in a plurality of audio signals and predict outputs for the plurality of audio signals includes using a decimated sequence of features to provide context.
12. A hearing assistance device, comprising:
a microphone configured to receive audio signals;
a processor configured to process the audio signals to correct for a hearing impairment of a wearer, the processor further configured to:
perform neural network processing to train the processor to identify acoustic features in a plurality of audio signals and predict outputs for the plurality of audio signals by mapping input features of the plurality of audio signals to a set of algorithm parameters for producing frequency-lowered speech cues, including incorporating contextual cues to enable identification and extraction of acoustic features from the input signal; and
control frequency translation of the input signal using the results of the neural network processing, including using the set of algorithm parameters to automatically recognize and translate speech sounds from the input signal; and
a receiver configured to play processed audio signals for the wearer.
13. The hearing assistance device of claim 12 , wherein the hearing assistance device is a hearing aid.
14. The hearing assistance device of claim 13 , wherein the hearing aid is a behind-the-ear (BTE) hearing aid.
15. The hearing assistance device of claim 13 , wherein the hearing aid is an in-the-ear (ITE) hearing aid.
16. The hearing assistance device of claim 13 , wherein the hearing aid is an in-the-canal (ITC) hearing aid.
17. The hearing assistance device of claim 13 , wherein the hearing aid is a completely-in-the-canal (CIC) hearing aid.
18. The hearing assistance device of claim 13 , wherein the hearing aid is a receiver-in-canal (RIC) hearing aid.
19. The hearing assistance device of claim 13 , wherein the hearing aid is a receiver-in-the-ear (RITE) hearing aid.
20. The hearing assistance device of claim 13 , wherein the hearing aid is an invisible-in-canal (IIC) hearing aid.