Enhanced dynamics processing of streaming audio by source separation and remixing
View Patent ↗This application relates to a systems and methods for enhanced dynamics processing of streaming audio by source separation and remixing for hearing assistance devices, according to one example. In one embodiment, an external streaming audio device processes sources isolated from an audio signal using source separation, and mixes the resulting signals back into the unprocessed audio signal to enhance individual sources while minimizing audible artifacts. Variations of the present system use source separation in a side chain to guide processing of a composite audio signal.
1. A system, comprising:
at least one hearing assistance device adapted to receive a streaming input; and
an external device, including:
a processor configured to:
process an audio signal to isolate individual sound source components, including automatically isolating the components based on individual sound source;
compress the individual sound source components; and
mix the compressed sound source components with the audio signal to produce a mixed audio signal; and
a wireless transmitter connected to the processor, the wireless transmitter configured to stream the mixed audio signal to the at least one hearing assistance device.
2. The system of claim 1 , wherein the hearing assistance device includes a microphone.
3. The system of claim 1 , wherein the hearing assistance device includes a signal processor.
4. The system of claim 3 , wherein the signal processor includes a digital signal processor (DSP).
5. The system of claim 1 , wherein the hearing assistance device includes a receiver.
6. The system of claim 1 , wherein the processor includes a digital signal processor.
7. The system of claim 1 , wherein the at least one hearing assistance device includes a cochlear implant.
8. The system of claim 1 , wherein the at least one hearing assistance device includes a hearing aid.
9. The system of claim 8 , wherein the hearing aid includes an in-the-ear (ITE) hearing aid.
10. The system of claim 8 , wherein the hearing aid includes a behind-the-ear (BTE) hearing aid.
11. The system of claim 8 , wherein the hearing aid includes an in-the-canal (ITC) hearing aid.
12. The system of claim 8 , wherein the hearing aid includes a receiver-in-canal (RIC) hearing aid.
13. The system of claim 8 , wherein the hearing aid includes a completely-in-the-canal (CIC) hearing aid.
14. The system of claim 8 , wherein the hearing aid includes a receiver-in-the-ear (RITE) hearing aid.
15. The system of claim 1 , wherein isolating individual sound source components from an audio signal includes using non-negative matrix factorization.
16. The system of claim 1 , further comprising processing the audio signal in parallel with compressing the isolated individual source components before mixing.
17. The system of claim 16 , wherein processing the audio signal includes delaying the audio signal to compensate for latency in source separation.
18. The system of claim 1 , wherein isolating individual sound source components from an audio signal includes processing to isolate voice and instrument components from musical signals.
19. The system of claim 1 , wherein mixing the compressed sound source components includes providing a mix that is customized to compensate for the wearer's hearing loss.
20. The system of claim 1 , wherein streaming the mixed audio signal to the at least one hearing assistance device includes using radio frequency communications.