IP Library › Granted Patent US 12,231,857
Granted Patent B2
US 12,231,857 · App. 17/738,264 · Granted Feb 18, 2025

System and method for personalized sound modification

Inventor: King Chung (Lisle, IL)
Assignee: Board of Trustees of Northern Illinois University
H04R25/70H04R25/502H04R2225/39H04R2430/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,231,857
App. No.
17/738,264
Granted
Feb 18, 2025
Kind
B2
Abstract

A method for personalized sound modification, with a personal sound system having a microphone; a user device which includes a processor, computer readable medium, and optionally the microphone; and a sound output device; is provided. The method includes: providing a user hearing profile including lower and upper limits of the user's auditory dynamic range at a plurality of sound frequencies, prepared with the personal sound system; receiving a sound signal from the microphone; optionally separating the sound signal into a plurality of frequency channels; amplifying or attenuating sound frequencies in the sound signal which have a volume level outside the lower or upper limits of the user's auditory dynamic range, respectively, and forming a modified sound signal with which the sound output device will produce sounds within the user's auditory dynamic range; and providing the modified sound signal to the sound output device.

Claims (23)

1. A method for personalized sound modification, with a personal sound system having; (i) a user device which includes a processor, and computer readable medium; (ii) a microphone, connected to the user device; and (iii) a sound output device, connected to the user device; the method for personalized sound modification comprising: providing a user hearing profile including lower and upper limits of the user's auditory dynamic range at a plurality of sound frequencies, wherein the user hearing profile was prepared with the user device and the sound output device of the personal sound system; receiving a sound signal from the microphone of the personal sound system; separating the sound signal into a plurality of frequency channels with the user device of the personal sound system; amplifying or attenuating sound at frequencies in the sound signal which have a volume level outside the lower or upper limits of the user's auditory dynamic range from the user hearing profile, respectively, and forming with the user device of the personal sound system a modified sound signal with which the sound output device will produce sounds within the user's auditory dynamic range; and providing the modified sound signal to the sound output device of the personal sound system.

2. The method of claim 1 , further comprising testing the user to determine the lower and upper limits of the user's auditory dynamic range at a plurality of frequencies with the user device and the sound output device of the personal sound system, to prepare the user hearing profile.

3. The method of claim 2 , wherein the user has tinnitus, and the testing further comprises estimating a tinnitus frequency and a tinnitus loudness level, with the user device and the sound output device of the personal sound system.

4. The method of claim 3 , further comprising providing masking sounds in the modified sound signal at a loudness level higher than the tinnitus loudness level at the tinnitus frequency.

5. The method of claim 3 , wherein the lower limit of the user's auditory dynamic range in the user hearing profile is set higher than the tinnitus loudness level at the tinnitus frequency.

6. The method of claim 2 , wherein the user has misophonia, and the testing further comprises recording a sound which triggers the user's misophonia.

7. The method of claim 6 , wherein the modified sound signal is adjusted to mask, alter or eliminate the sound which triggers the user's misophonia.

8. The method of claim 1 , wherein the user device is a smartphone, the smartphone comprises the microphone, and the sound output device is earbuds or headphones.

9. A computer program product, comprising a non-transitory computer readable medium having a computer readable program code embodied therein, the computer readable program code adapted to be executed to implement a method for personalize d sound modification with a personal sound system, the method comprising: providing a user hearing profile including lower and upper limits of the user's auditory dynamic range at a plurality of sound frequencies, wherein the user hearing profile was prepared with the user device and the sound output device of the personal sound system; receiving a sound signal from the microphone of the personal sound system; separating the sound signal into a plurality of frequency channels with the user device of the personal sound system; amplifying or attenuating sound at frequencies in the sound signal which have a volume level outside the lower or upper limits of the user's auditory dynamic range from the user hearing profile, respectively, and forming with the user device of the personal sound system a modified sound signal with which the sound output device will produce sounds within the user's auditory dynamic range; and providing the modified sound signal to the sound output device of the personal sound system; wherein the personal sound system comprise: (i) a user device which includes a processor, and the non-transitory computer readable medium; (ii) a microphone, connected to the user device; and (iii) a sound output device, connected to the user device.

10. The computer program product of claim 9 , wherein the method further comprises testing the user to determine the lower and upper limits of the user's auditory dynamic range at a plurality of frequencies with the user device and the sound output device of the personal sound system, to prepare the user hearing profile.

11. The computer program product of claim 10 , wherein the user has tinnitus, and the testing further comprises estimating a tinnitus frequency and a tinnitus loudness level, with the user device and the sound output device of the personal sound system.

12. The computer program product of claim 11 , wherein the method further comprises providing masking sounds in the modified sound signal at a loudness level higher than the tinnitus loudness level at the tinnitus frequency.

13. The computer program product of claim 11 , wherein the lower limit of the user's auditory dynamic range in the user hearing profile is set higher than the tinnitus loudness level at the tinnitus frequency.

14. The computer program product of claim 10 , wherein the user has misophonia, and the testing further comprises recording a sound which triggers the user's misophonia.

15. The computer program product of claim 14 , wherein the modified sound signal is adjusted to mask or eliminate the sound which triggers the user's misophonia.

16. A system for personalized sound modification, comprising: (1) a personal sound system, having (i) a user device which includes a processor, and non-transitory computer readable medium, (ii) a microphone, connected to the user device, and (iii) a sound output device, connected to the user device, and (2) a computer program product, comprising the non-transitory computer readable medium having a computer readable program code embodied therein, the computer readable program code adapted to be executed to implement a method for personalized sound modification with the personal sound system, the method comprising: providing a user hearing profile including lower and upper limits of the user's auditory dynamic range at a plurality of sound frequencies, wherein the user hearing profile was prepared with the user device and the sound output device of the personal sound system; receiving a sound signal from the microphone of the personal sound system; separating the sound signal into a plurality of frequency channels with the user device of the personal sound system; amplifying or attenuating sound at frequencies in the sound signal which have a volume level outside the lower or upper limits of the user's auditory dynamic range from the user hearing profile, respectively, and forming with the user device of the personal sound system a modified sound signal with which the sound output device will produce sounds within the user's auditory dynamic range; and providing the modified sound signal to the sound output device of the personal sound system.

17. The system of claim 16 , wherein the method further comprises testing the user to determine the lower and upper limits of the user's auditory dynamic range at a plurality of frequencies with the user device and the sound output device of the personal sound system, to prepare the user hearing profile.

18. The system of claim 17 , wherein the user has tinnitus, and the testing further comprises estimating a tinnitus frequency and a tinnitus loudness level, with the user device and the sound output device of the personal sound system.

19. A method for personalized sound modification for user having tinnitus, with a personal sound system having: (i) a user device which includes a processor, and computer readable medium; (ii) a microphone, connected to the user device; and (iii) a sound output device, connected to the user device; the method for personalized sound modification comprising:

testing the user to estimate a tinnitus frequency and a tinnitus loudness level, with the user device and the sound output device of the personal sound system:

receiving a sound signal from the microphone of the personal sound system:

providing masking sounds in the sound signal at a loudness level higher than the tinnitus loudness level at the tinnitus frequency, and forming with the user device of the personal sound system a modified sound signal with which the sound output device will produce sounds; and

providing the modified sound signal to the output device of the personal sound system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: CHUNG, KING
To: BOARD OF TRUSTEES OF NORTHERN ILLINOIS UNIVERSITY
Reel/Frame 061173/0750 →
Continuity (2)
Provisional Application 63201643 · May 7, 2021
Related Publication 20220369054A1 · Nov 17, 2022
References Cited (43)
US 8081780B2 · Goldstein et al. · 2011 [cited by applicant]
US 8285344B2 · Kahn et al. · 2012 [cited by applicant]
US 10820121B2 · Lunner et al. · 2020 [cited by applicant]
US 20020076073A1 · Taenzer et al. · 2002 [cited by applicant]
US 20110135129A1 · Neal · 2011 [cited by examiner]
US 20130337796A1 · Suhami · 2013 [cited by examiner]
US 20160241972A1 · Gobeli et al. · 2016 [cited by applicant]
US 20170042739A1 · O'Neill · 2017 [cited by examiner]
US 20210329389A1 · Pandey et al. · 2021 [cited by applicant]
CN 101862195 · 2010 [cited by applicant]
CN 202998462 · 2013 [cited by applicant]
CN 210927977 · 2020 [cited by applicant]
JP 2000295696 · 2000 [cited by applicant]
KR 101482420 · 2015 [cited by applicant]
WO 2009001559 · 2007 [cited by applicant]
Wilson, B.S. et al., “Global hearing healthcare: new findings and perspectives”, Lancet, vol. 390, pp. 2503-2515, (2017). [cited by applicant]
Ching, T.Y.C. et al., “Outcomes of early- and late-identified children at 3 years of age: Findings from a prospective population-based study”, Ear and Hearing, vol. 34, No. 5, pp. 535-552, (2013). [cited by applicant]
Ronner, E.A. et al., “Quality of life in children with sensorineural hearing loss”, Otolaryngology—Head and Neck Surgery, vol. 162, No. 1, pp. 129-136, (2020). [cited by applicant]
Punch, J.L. et al., “Hearing loss and quality of life”, Journal of Communication Disorders, vol. 78, pp. 33-45, (2019). [cited by applicant]
Bott, A. et al., “A scoping review of studies investigating hearing loss, social isolation and/or loneliness in adults”, International Journal of Audiology, vol. 60, sup. 2, pp. s30-s46, (2021). [cited by applicant]
Chen, D.S. et al., “Association between hearing impairment and self-reported difficulty in physical functioning”, Journal of the American Geriatrics Society, vol. 62, No. 5, pp. 850-856, (2014). [cited by applicant]
Davis, A. et al., “Aging and hearing health: The life-course approach”, The Gerontologist, vol. 56, No. 62, S256-S267, (2016). [cited by applicant]
Dawes, P. et al., “Hearing loss and cognition: The role of hearing aids, social isolation and depression”, PLoS ONE, vol. 10, No. 3, e0119616, pp. 1-9, (2015). [cited by applicant]
Lin, F.R. et al., “Hearing loss and incident dementia”, Archives of Neurology, vol. 68, No. 2, pp. 214-220, (2011). [cited by applicant]
Lin. F.R. et al., “Association of hearing impairment with brain vol. changes in older adults”, Neuroimage, vol. 90, pp. 84-92, (2014). [cited by applicant]
Lin. F.R. et al., “Hearing loss and falls among older adults in the United States”, Archives of Internal Medicine, vol. 172, No. 4, pp. 369-371, (2012). [cited by applicant]
Coverstone, J.A. “Prevalence of hearing difficulty and tinnitus with normal hearing thresholds”, Science and Research News, Tinnitus Today Summer 2018, pp. 36-37, found at www.ata.org/sites/default/files/Summer-2018-36.… [cited by applicant]
American Tinnitus Association, “Impact of tinnitus”, pp. 1-6, found at www.ata.org/understanding-facts/impact-tinnitus, (2022). [cited by applicant]
Cassoobhoy, A. “What is misophonia?”, WebMD, 4 pages, found at www.webmd.com/mental-health/what-is-misophonia, (2020). [cited by applicant]
Blamey, P. J. “Adaptive dynamic range optimization (ADRO): A digital amplification strategy for hearing aids and cochlear implants”, Trends in Amplification, vol. 9, No. 2, pp. 77-98, (2005). [cited by applicant]
Schuab, A., “Enhancing temporal resolution and sound quality: A novel approach to compression”, The Hearing Review, vol. 16, No. 8, pp. 28-33, (2008). [cited by applicant]
Chung. K. “Challenges and recent developments in hearing aids: Part I speech understanding in noise, microphone technologies and noise reduction algorithms”, Trends In Amplification, vol. 8, No. 3, pp. 83-124 (2004). [cited by applicant]
Lentz, J.J. “Estimating threshold in quiet”, Psychoacoustics: Perception of Normal and Impaired Hearing with Audiology Applications, chapter 2, pp. 13-44, (2020). [cited by applicant]
Lentz, J.J. “Loudness and the perception of intensity”, Psychoacoustics: Perception of Normal and Impaired Hearing with Audiology Applications, chapter 4, pp. 79-108, (2020). [cited by applicant]
Amlani, A.M. “Apps for the ears”, The ASHA Leader, vol. 19, No. 34-35, pp. 1-3, (2014). [cited by applicant]
Valente, M. et al., “The independent hearing aid fitting forum (IHAFF) protocol”, Trends in Amplification, vol. 2, No. 1, pp. 6-35, (1997). [cited by applicant]
Definition of “Pure-tone audiometry” printed from Wikipedia, the free encyclopedia on Feb. 28, 2022 found at http://en.wikipedia.org/wiki/Pure-tone_audiometry. [cited by applicant]
Definition of “Digital audio” printed from Wikipedia, the free encyclopedia on Apr. 29, 2022 found at http://en.wikipedia.org/wiki/Digital_audio. [cited by applicant]
Lentz, J.J. “Pitch perception”, Psychoacoustics: Perception of Normal and Impaired Hearing with Audiology Applications, chapter 6, pp. 141-172, (2020). [cited by applicant]
“Turn your smartphone into a fully functional hearing aid with Petralex application!”, Petralex, pp. 1-3, found at https://petralex.pro/en/page/press, (2022). [cited by applicant]
“Phone-based hearing aid Technology”, Petralex, pp. 1-3, found at https://petralex.pro/en/page/about, (2022). [cited by applicant]
Dahlquist, L.H. “Classroom amplification: not just for the hearing impaired anymore”, Audio Enhancement, pp. 1-3, found at https://audioenhancement.com/wp-content/uploads/2018/06/Classroom-Amp-Not-Just-for-Hearing-Impai… [cited by applicant]
Masalski, M. et al., “Hearing tests on mobile devices: Evaluation of the reference sound level by means of biological calibration”, Journal of Medical Internet Research, vol. 18, issue 5, e130, pp. 1-12, (2016). [cited by applicant]