IP Library › Granted Patent US 12,323,768
Granted Patent B2
US 12,323,768 · App. 18/089,093 · Granted Jun 3, 2025

Method for audio signal processing on a hearing system, hearing system and neural network for audio signal processing

Inventors: Paul Wagner (Portland, OR); Sebastian Kroedel (Erlenbach, CH); Claudio Santelli (Staefa, CH); Markus Hofbauer (Hombrechtikon, CH); Manon Barbier (Soultzmatt, FR)
Assignee: Sonova AG
H04R25/507H04R25/606
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,323,768
App. No.
18/089,093
Granted
Jun 3, 2025
Kind
B2
Abstract

Methods, hearing systems and neural networks for audio signal processing are described. A hearing system comprises a neural network. An input audio signal is processed into an output audio signal at least partially by means of a processing unit of the hearing system. The audio signal processing of the input audio signal includes executing audio signal processing by the neural network for performing a step of the audio signal processing, determining a confidence parameter resembling the reliability of the audio signal processing by the neural network and steering the audio signal processing in dependence of the confidence parameter. A particularly suitable neural network is configured to solve a regression-based acoustic processing task and additionally determining the confidence parameter.

Claims (31)

1. A method for audio signal processing on a hearing system, the hearing system having an audio input unit, a processing unit for audio signal processing, an audio output unit, and a neural network for audio signal processing, the method comprising:

receiving an input audio signal by means of the audio input unit,

audio signal processing the input audio signal into an output audio signal at least partially by means of the processing unit, the audio signal processing including

executing audio signal processing by the neural network for performing a step of the audio signal processing,

determining a confidence parameter resembling a reliability of the audio signal processing by the neural network, and

steering the audio signal processing in dependence of the confidence parameter,

outputting the output audio signal by means of the audio output unit.

2. The method according to claim 1 , wherein the confidence parameter determines whether a network output of the neural network is used in further processing steps of the audio signal processing.

3. The method according to any claim 1 , wherein the confidence parameter is determined by the neural network.

4. The method according to claim 1 , wherein the neural network performs a classification task, in particular performs audio scene classification.

5. The method according to claim 1 , wherein the neural network performs regression-based acoustic processing to obtain network output audio data.

6. The method according to claim 5 , wherein the neural network outputs the confidence parameter additionally to the network output audio data.

7. The method according to claim 5 , wherein the regression-based acoustic processing by the neural network is modified in dependence of the confidence parameter.

8. The method according to claim 1 , wherein the output audio signal comprises a mixture of a primary audio signal, which is obtained using audio signal processing by the neural network, and a secondary audio signal, which is obtained without using audio signal processing by the neural network, and wherein a mixing ratio of primary audio signal and secondary audio signal is determined based on the confidence parameter.

9. The method according to claim 1 , wherein the input audio signal is processed by a secondary processing routine to obtain a secondary audio signal.

10. The method according to claim 1 , wherein an audio signal to be processed by the neural network is based on a transformation of the input audio signal received over a time interval, wherein a length of the time interval depends on the confidence parameter.

11. The method according to claim 1 , wherein a sample of the input audio signal is recorded in situations, when the confidence parameter indicates a low reliability of the audio signal processing by the neural network.

12. A hearing system, comprising:

an audio input unit for receiving an input audio signal,

a processing unit for audio signal processing the input audio signal into an output audio signal,

an audio output unit for outputting the output audio signal, and

a neural network for audio signal processing which, when executed, contributes to the audio signal processing,

wherein the hearing system is configured to

determine a confidence parameter resembling a reliability of the audio signal processing by the neural network, and

steer the audio signal processing by the neural network based on the confidence parameter.

13. The hearing system according to claim 12 , further comprising a mixing unit for mixing a primary audio signal, which is obtained using audio signal processing by the neural network, with a secondary audio signal, which is obtained without using audio signal processing by the neural network.

14. The hearing system according to claim 12 , wherein the hearing system is implemented by one or more of a hearing aid, a cochlear implant, or a bone-anchored hearing aid.

15. A neural network for audio signal processing, wherein the neural network is configured to:

perform a regression-based acoustic processing of an audio signal to obtain network output audio data,

determine a confidence parameter resembling a reliability of regression-based acoustic processing, and

output the confidence parameter and/or to modify the regression-based acoustic processing in dependence of the confidence parameter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2023
From: WAGNER, PAUL; KROEDEL, SEBASTIAN; SANTELLI, CLAUDIO; HOFBAUER, MARKUS; BARBIER, MANON
To: SONOVA AG
Reel/Frame 063372/0309 →
Priority Claims (1)
EP 21218086 · Dec 29, 2021 · regional
Continuity (1)
Related Publication 20230209283A1 · Jun 29, 2023
References Cited (19)
US 9886954B1 · Meacham · 2018 [cited by examiner]
US 10003895B2 · Fung · 2018 [cited by examiner]
US 10142745B2 · Petersen · 2018 [cited by examiner]
US 10332537B2 · Shih · 2019 [cited by examiner]
US 10535362B2 · Bryan · 2020 [cited by examiner]
US 10681459B1 · Breitenmoser · 2020 [cited by examiner]
US 11356783B2 · Pedersen · 2022 [cited by examiner]
US 11375322B2 · Lunner · 2022 [cited by examiner]
US 11457320B2 · Breitenmoser · 2022 [cited by examiner]
US 11817114B2 · Port · 2023 [cited by examiner]
US 12089005B2 · Guo · 2024 [cited by examiner]
US 20170278513A1 · Li et al. · 2017 [cited by applicant]
US 20210304736A1 · Kothari et al. · 2021 [cited by applicant]
US 20220312126A1 · Rosenthal · 2022 [cited by examiner]
US 20240216179A1 · Herfort · 2024 [cited by examiner]
“Extended European Search Report received in EP Application No. 21218086 on Aug. 23, 2022”. [cited by applicant]
“Partial European Search Report received in International Application No. 21218086.3, dated Jun. 20, 2022”. [cited by applicant]
Braun, et al., “Towards Efficient Models for Real-Time Deep Noise Suppression”, ICASSP 2021, Jun. 2021, pp. 656 to 660, doi: 10.1109/ICASSP39728.2021.9413580. [cited by applicant]
Yong Xu, et al., “A Regression Approach to Speech Enhancement Based on Deep Neural Networks”, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 23, No. 1, Jan. 1, 2015, pp. 7-19, USA, ISSN: 2329-9290… [cited by applicant]