IP Library › Granted Patent US 12,236,942
Granted Patent B2
US 12,236,942 · App. 17/416,450 · Granted Feb 25, 2025

Prediction and identification techniques used with a hearing prosthesis

Inventors: Paul Michael Carter (Macquarie University, AU); Adam Hersbach (Macquarie University, AU); Richard Bruce Murphy (Macquarie University, AU); Kenneth Oplinger (Macquarie University, AU)
Assignee: Cochlear Limited
G10L15/10H04R25/505H04R2225/43
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,942
App. No.
17/416,450
Granted
Feb 25, 2025
Kind
B2
Abstract

A method, including receiving a signal which includes speech data, processing the received signal to identify and/or predict one or more words in the speech data, and evoking a hearing percept based on the received signal, wherein the evoked hearing percept includes one or more modified words based on the identification and/or prediction of the one or more words.

Claims (73)

1. A method, comprising:

receiving a signal which includes speech data;

processing the received signal to identify and/or predict one or more words in the speech data; and

evoking a hearing percept based in the received signal, wherein the evoked hearing percept includes one or more modified words based on the identification and/or prediction of the one or more words, wherein

the processing introduces a delay between receiving the signal and evoking the hearing percept.

2. The method of claim 1 , wherein at least one of:

the signal is modified to produce a word that sounds differently relative to that which would have been the case in the absence of the modification; or

a new signal is produced that is provided to a device that evokes the hearing percept, which new signal results in the production of a word that sounds differently relative to that which would have been the case if the signal was used by the device.

3. The method of claim 2 , wherein at least one of:

the signal is modified to produce a word with a different accent relative to that which would have been the case in the absence of the modification; or

a new signal is produced that is provided to a device that evokes the hearing percept, which new signal results in the production of a word with a different accent relative to that which would have been the case if the signal was used by the device.

4. The method of claim 1 , wherein:

the evoked hearing percept includes a totally synthesized word based on the identification and/or prediction of the one or more words in place of a word that would have been presented based on the signal.

5. The method of claim 1 , wherein:

the evoked hearing percept includes only speech, which speech is intentionally different from that which would have been the case in the absence of the identification and/or prediction.

6. The method of claim 1 , wherein:

the processing of the received signal predicts one or more words in the speech data; and

the one or more modified words includes one or more predicted words from the prediction of one or more words.

7. A method, comprising:

receiving a signal which includes speech data;

processing the received signal to identify and/or predict one or more words in the speech data; and

evoking a hearing percept based in the received signal, wherein the evoked hearing percept includes one or more modified words based on the identification and/or prediction of the one or more words, wherein

the processing is not correlated with a noticeable delay in a device used to execute the evoking of the hearing percept noticed by the person in which the hearing percept is evoked.

8. The method of claim 7 , wherein the device used to execute the evoking of the hearing percept is a hearing prosthesis.

9. A method, comprising:

receiving a signal which includes speech data;

processing the received signal to identify and/or predict one or more words in the speech data; and

evoking a hearing percept based in the received signal, wherein the evoked hearing percept is a different hearing percept relative to that which would have been the case in the absence of the identification and/or prediction; and

at least one of:

the method includes automatically adjusting a noise control system of a hearing prosthesis that is evoking the hearing percept based on the identified and/or predicted one or more words;

the method includes automatically adjusting a volume and/or a gain of a hearing prosthesis that is evoking the hearing percept based on the identified and/or predicted one or more words;

the action of evoking the hearing percept is executed using a hearing prosthesis that is configured to evoke the hearing percept such that a hybrid word is provided to the recipient based on the results of the identification; or

the action of evoking the hearing percept is executed using a hearing prosthesis that is configured to evaluate a level of certainty of the identification and generate a hearing percept based on the evaluation of the level of certainty, wherein the generated hearing percept is different depending on the level of certainty.

10. The method of claim 9 , further comprising:

automatically adjusting a noise control system of a hearing prosthesis that is evoking the hearing percept based on the identified and/or predicted one or more words.

11. The method of claim 9 , further comprising:

automatically adjusting a volume and/or a gain of a hearing prosthesis that is evoking the hearing percept based on the identified and/or predicted one or more words.

12. The method of claim 9 , wherein at least one of:

signal is modified to produce a word that is a different word than that which would have likely been perceived by the recipient relative to that which would have been the case in the absence of the modification; or

a new signal is produced that is provided to a device that evokes the hearing percept, which new signal results in the production of a word that is a different word than that which would have likely been perceived by the recipient relative to that which would have been the case if the signal was used by the device.

13. The method of claim 9 :

wherein the action of evoking the hearing percept is executed using a hearing prosthesis that is configured to evoke a hearing percept such that a hybrid word is provided to the recipient based on the results of the identification.

14. The method of claim 9 :

wherein the action of evoking the hearing percept is executed using a hearing prosthesis that is configured to evaluate a level of certainty of the identification and generate a hearing percept based on the evaluation of the level of certainty, wherein the generated hearing percept is different depending on the level of certainty.

15. The method of claim 9 , further comprising:

the evoked hearing percept is a totally synthesized hearing percept that maximizes comprehension of speech at the expense of tone, uniqueness and/or emphasis.

16. The method of claim 9 , wherein at least one of:

signal is modified to produce a meaning that is a different than that which would have likely been comprehended by the recipient relative to that which would have been the case in the absence of the modification; or

a new signal is produced that is provided to a device that evokes the hearing percept, which new signal produces a meaning that is a different from that which would have likely been comprehended by the recipient relative to that which would have been the case if the signal was used by the device.

17. A system, comprising:

a device including a sound capture device and a processing system, wherein the device is configured to convert sound captured by the system and process a signal based on the captured sound with the processing system and evoke a hearing percept based on output from the processing system based on the signal, wherein

the system includes a sound prediction and/or word identification functionality such that the system is configured to predict sound that is captured by the sound capture device.

18. The system of claim 17 , wherein:

wherein the system has the sound prediction functionality which is a word prediction functionality.

19. The system of claim 18 , wherein:

wherein the system is configured to evoke a hearing percept based on a result of the word prediction functionality that is different from that which would be the case in the absence of the result.

20. The system of claim 17 , wherein:

the sound prediction functionality is a word prediction functionality, and the system has such, and wherein the word prediction functionality is the ability to predict a word after one or more next words that have yet to be received by the processing system.

21. The system of claim 17 , wherein:

the device is configured to increase an aggressiveness of a noise reduction algorithm based on prediction of sound.

22. The system of claim 17 , wherein:

the system includes a speech presence probability estimator; and

the system is configured to use the sound prediction functionality to enhance functionality of the speech presence probability estimator.

23. The system of claim 17 , wherein:

the system is configured to introduce a variable delay between sound capture and the evocation of the hearing percept; and

the system is configured to use the prediction functionality to predict words and then compare the predicted word to what is then received and then adjust the operation of the system to evoke a hearing percept based on this comparison.

24. The system of claim 17 , wherein:

the system is configured to introduce a delay between the temporal locations of the sound capture and the evocation of the hearing percept that is delta to the normal processing delay; and

the system is configured to identify a sound environment, and vary the delay based on the identified sound environment.

25. The system of claim 17 , wherein:

wherein the device is a hearing prosthesis.

26. The system of claim 17 , wherein:

wherein the device is a hearing device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 3, 2024
From: CARTER, PAUL MICHAEL; HERSBACH, ADAM; MURPHY, RICHARD BRUCE; OPLINGER, KENNETH
To: COCHLEAR LIMITED
Reel/Frame 067904/0190 →
Continuity (2)
Provisional Application 62865536 · Jun 24, 2019
Related Publication 20220076663A1 · Mar 10, 2022
References Cited (24)
US 8107657B2 · Hansen · 2012 [cited by applicant]
US 8589166B2 · Zopf · 2013 [cited by applicant]
US 8745683B1 · Maeng · 2014 [cited by applicant]
US 8781836B2 · Foo et al. · 2014 [cited by applicant]
US 9162069B2 · Hemmert · 2015 [cited by applicant]
US 9772681B2 · Koga · 2017 [cited by applicant]
US 9814879B2 · Banna et al. · 2017 [cited by applicant]
US 9905240B2 · Levitt · 2018 [cited by applicant]
US 9916842B2 · Levitt · 2018 [cited by applicant]
US 9961441B2 · Chen · 2018 [cited by applicant]
US 11238857B2 · Skobeltsyn et al. · 2022 [cited by applicant]
US 20100030012A1 · Meskens · 2010 [cited by applicant]
US 20120013721A1 · Nishio et al. · 2012 [cited by applicant]
US 20150119635A1 · Gustafsson et al. · 2015 [cited by applicant]
US 20160027437A1 · Hong · 2016 [cited by examiner]
US 20180275956A1 · Reed et al. · 2018 [cited by applicant]
US 20200193972A1 · Feinauer · 2020 [cited by examiner]
EP 3367382A1 · 2018 [cited by applicant]
KR 1020170071585A · 2017 [cited by applicant]
WO 2007019307A2 · 2007 [cited by applicant]
Oldooz Hazrati et al., “Leveraging Automatic Speech Recognition in Cochlear Implants for Improved Speech Intelligibility Under Reverberation,” 2015 IEEE International Conference on Acoustics, Speech and Signal Processin… [cited by applicant]
Timo Gerkmann et al., “Improved a posteriori Speech Presence Probability Estimation Based on a Likelihood Ratio with Fixed Priors,” IEEE Transactions on Audio, Speech, and Language Processing, Jul. 2008, pp. 910-919, vo… [cited by applicant]
International Search Report & Written Opinion for PCT/IB2020/055982, mailed Sep. 29, 2020. [cited by applicant]
Office action for China Application No. 202080007174.4, mailed Jan. 8, 2024. [cited by applicant]