IP Library Granted Patent US 12,225,371
Granted Patent B2
US 12,225,371 · App. 18/334,096 · Granted Feb 11, 2025

System and a processing method for customizing audio experience

Inventors: Teck Chee Lee (Singapore, SG); Christopher Hummersone (Surrey, GB); Toh Onn Desmond Hii (Singapore, SG)
Assignee: CREATIVE TECHNOLOGY LTD
H04S7/305G06F16/636G06V40/10G06V40/103H04R5/04H04S7/301H04S7/40H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,225,371
App. No.
18/334,096
Granted
Feb 11, 2025
Kind
B2
Abstract

The present disclosure relates to a system and a processing method in association with the system for customizing audio experience. Customization of audio experience can be based on derivation of at least one customized audio response characteristic which can be applied to an audio device used by a person. The customized audio response characteristic(s) can be unique to the person.

Claims (48)

1. A method comprising:

generating, by one or more processors, image-related input audio signals from processing a captured image of a subject;

applying, by the one or more processors, an output signal to the image-related input audio signals; and

generating, by the one or more processors and based on the applying, output audio signals audibly perceivable by the subject.

2. The method of claim 1 , further comprising:

processing, by the one or more processors, the image-related input audio signal based on a database signal; and

generating, by the one or more processors, a plurality of intermediate processor datasets based on the processing.

3. The method of claim 2 , wherein the plurality of intermediate processor datasets corresponds to biometric data for at least two different biometric feature types.

4. The method of claim 1 , wherein the processing the captured image of the subject further comprises implementing at least one of a multiple-match processing based strategy, a multiple-recognizer based processing strategy, or a cluster based processing strategy.

5. The method of claim 1 , wherein the output audio signals provide the subject with a customized audio experience.

6. The method of claim 1 , further comprising combining, by the one or more processors, a plurality of intermediate processor datasets to produce the output signal.

7. The method of claim 6 , wherein the plurality of intermediate processor datasets includes at least one of a binaural room impulse response (BRIR) dataset, a binaural room transfer function (BRTF) dataset, a head related impulse response (HRIR) dataset or a head related transfer function (HRTF) dataset.

8. The method of claim 6 , further comprising generating, by the one or more processors, a plurality of intermediate processor datasets by processing an image-related input audio signal based on a database signal.

9. The method of claim 1 , wherein the output signal corresponds to an audio response characteristic associated with the subject.

10. The method of claim 9 , wherein the audio response characteristic is unique to the subject under a given environment and is one of an HRIR or BRIR.

11. The method of claim 1 , further comprising operating, by the one or more processors, as at least one of a type of recognizer of a plurality of recognizers or a multi-recognizer corresponding to a first type recognizer and a second type recognizer.

12. The method of claim 1 ,

wherein the image-related input audio signals correspond to biometric data associated with the subject, and

wherein the biometric data comprises a first biometric feature type and a second biometric feature type.

13. The method of claim 12 , further comprising:

generating, by the one or more processors as a first type recognizer, a first set of intermediate processor datasets based on the first biometric feature type, and

generating, by the one or more processors as a second type recognizer, a second set of intermediate processor datasets based on the second biometric feature type.

14. The method of claim 13 , further comprising combining, by the one or more processors using weighted sums, the first set of intermediate processor datasets and the second set of intermediate processor datasets.

15. The method of claim 1 , further comprising:

grouping, by the one or more processors, a plurality of datasets of a database into a plurality of cluster groups, each cluster group corresponding to a cluster comprising a dataset, and

associating, by the one or more processors, a biometric feature type retrieved from the captured image with the cluster.

16. The method of claim 1 , further comprising:

operating, by the one or more processors, as a multi-recognizer corresponding to a first type recognizer and a second type recognizer,

wherein the image-related input audio signals correspond to biometric data associated with the subject, and

wherein the biometric data comprises a first biometric feature type and a second biometric feature type;

associating, by the one or more processors, the second biometric feature type that is the biometric feature type with a cluster;

generating, by the one or more processors as the first type recognizer, a first set of intermediate processor datasets based on the first biometric feature type, and

generating, by the one or more processors as the second type recognizer, a second set of intermediate processor datasets based on the second biometric feature type.

17. A system comprising:

one or more processors; and

one or more tangible, non-transitory memories memory configured to communicate with the one or more processors;

the one or more tangible, non-transitory memories having instructions stored thereon that, in response to execution by the one or more processors, cause the one or more processors to perform operations comprising:

generating, by the one or more processors, image-related input audio signals from processing a captured image of a subject;

applying, by the one or more processors, an output signal to the image-related input audio signals; and

generating, by the one or more processors and based on the applying, output audio signals audibly perceivable by the subject.

18. The system of claim 17 , further comprising:

processing, by the one or more processors, the image-related input audio signal based on a database signal; and

generating, by the one or more processors, a plurality of intermediate processor datasets based on the processing.

19. The system of claim 18 , wherein the plurality of intermediate processor datasets corresponds to biometric data for at least two different biometric feature types.

20. An article of manufacture including one or more non-transitory, tangible computer readable storage mediums having instructions stored thereon that, in response to execution by one or more processors, cause the one or more processors to perform operations comprising:

generating, by the one or more processors, image-related input audio signals from processing a captured image of a subject;

applying, by the one or more processors, an output signal to the image-related input audio signals; and

generating, by the one or more processors and based on the applying, output audio signals audibly perceivable by the subject.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2026
From: CREATIVE TECHNOLOGY LTD
To: ZEICA LABS PTE. LTD.
Reel/Frame 074063/0943 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2023
From: CREATIVE TECH (UK) LIMITED
To: CREATIVE TECHNOLOGY LTD
Reel/Frame 063944/0614 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2023
From: LEE, TECK CHEE; HUMMERSONE, CHRISTOPHER; HII, TOH ONN DESMOND
To: CREATIVE TECHNOLOGY LTD
Reel/Frame 063944/0728 →
Priority Claims (1)
SG 10201800147X · Jan 5, 2018 · national
Continuity (5)
Continuation 17360708 · Jun 28, 2021
Continuation 16927680 · Jul 13, 2020
Continuation 16279929 · Feb 19, 2019
Continuation 15969767 · May 2, 2018
Related Publication 20230328474A1 · Oct 12, 2023
References Cited (66)
US 7555354B2 · Walsh et al. · 2009 [cited by applicant]
US 7840019B2 · Slaney et al. · 2010 [cited by applicant]
US 7936887B2 · Smyth · 2011 [cited by applicant]
US 9030545B2 · Pedersen · 2015 [cited by applicant]
US 9544706B1 · Hirst · 2017 [cited by applicant]
US 9584946B1 · Lyren et al. · 2017 [cited by applicant]
US 9602947B2 · Oh et al. · 2017 [cited by applicant]
US 10063990B1 · Lyren · 2018 [cited by applicant]
US 10390171B2 · Lee et al. · 2019 [cited by applicant]
US 10433095B2 · Jain · 2019 [cited by applicant]
US 10659908B2 · Jain · 2020 [cited by applicant]
US 10701506B2 · Badhwar et al. · 2020 [cited by applicant]
US 10715946B2 · Lee et al. · 2020 [cited by applicant]
US 11051122B2 · Lee · 2021 [cited by applicant]
US 11716587B2 · Lee · 2023 [cited by examiner]
US 20060067548A1 · Slaney · 2006 [cited by applicant]
US 20070195963A1 · Ko · 2007 [cited by applicant]
US 20070270988A1 · Goldstein et al. · 2007 [cited by applicant]
US 20080170703A1 · Zivney · 2008 [cited by applicant]
US 20120008806A1 · Hess · 2012 [cited by applicant]
US 20120093320A1 · Flaks · 2012 [cited by examiner]
US 20120183161A1 · Agevik et al. · 2012 [cited by applicant]
US 20130169779A1 · Pedersen · 2013 [cited by applicant]
US 20150073262A1 · Roth et al. · 2015 [cited by applicant]
US 20150124975A1 · Pontoppidan · 2015 [cited by applicant]
US 20150312694A1 · Bilinski et al. · 2015 [cited by applicant]
US 20150358754A1 · Koppens · 2015 [cited by examiner]
US 20150373477A1 · Norris et al. · 2015 [cited by applicant]
US 20150382127A1 · Sun et al. · 2015 [cited by applicant]
US 20160227338A1 · Oh · 2016 [cited by applicant]
US 20160379041A1 · Rhee et al. · 2016 [cited by applicant]
US 20170048641A1 · Franck · 2017 [cited by applicant]
US 20170245081A1 · Lyren · 2017 [cited by examiner]
US 20170257723A1 · Morishita et al. · 2017 [cited by applicant]
US 20180091920A1 · Family · 2018 [cited by applicant]
US 20180218507A1 · Hyllus et al. · 2018 [cited by applicant]
US 20180249275A1 · Ghorbal · 2018 [cited by examiner]
US 20180249279A1 · Karapetyan et al. · 2018 [cited by applicant]
US 20180295463A1 · Eronen · 2018 [cited by examiner]
US 20180373957A1 · Lee et al. · 2018 [cited by applicant]
US 20190014431A1 · Lee et al. · 2019 [cited by applicant]
US 20190379995A1 · Lee et al. · 2019 [cited by applicant]
US 20200137508A1 · Lee et al. · 2020 [cited by applicant]
US 20200186954A1 · Sim et al. · 2020 [cited by applicant]
US 20200344565A1 · Lee et al. · 2020 [cited by applicant]
CN 101847268 · 2010 [cited by applicant]
EP 3595336 · 2020 [cited by applicant]
FR 3051951 · 2018 [cited by applicant]
WO 2017041922 · 2017 [cited by applicant]
WO 2017117293 · 2017 [cited by applicant]
WO 2017202634 · 2017 [cited by applicant]
USPTO, Non-Final Office Action dated Sep. 29, 2022 in U.S. Appl. No. 17/360,708. [cited by applicant]
USPTO, Final Office Action dated Feb. 9, 2023 in U.S. Appl. No. 17/360,708. [cited by applicant]
USPTO, Advisory Action dated Apr. 4, 2023 in U.S. Appl. No. 17/360,708. [cited by applicant]
USPTO, Notice of Allowance dated Jun. 7, 2023 in U.S. Appl. No. 17/360,708. [cited by applicant]
Japanese Intellectual Prpoerty Office, Japanese Office Action dated Jan. 18, 2023 in Application No. 2019-000097. [cited by applicant]
John C. Middlebrooks, “Virtual localization improved by scaling nonindividualized external-ear transfer functions in frequency,” Journal of the Acoustical Society of America, Sep. 1999, pp. 1493-1510, vol. 106, No. 3, P… [cited by applicant]
Yukio Iwaya, “Individualization of head-related transfer functions with tournament-style listening test: Listening with other's ears,” Acoustical Science and Technology, 2006, vol. 27, Issue 6, Japan. [cited by applicant]
Slim Ghorbal, Theo Auclair, Catherine Soladie, & Renaud Segui Er, “Pinna Morphological Parameters influencing HRTF Sets,” Proceedings of the 20th International Conference on Digital Audio Effects (DAFx-17), Sep. 5-9, 20… [cited by applicant]
Slim Ghorbal, Renaud Seguier, & Xavier Bonjour, “Process of HRTF individualization by 3D statistical ear model,” Audio Engineering Society's 141st Convention e-Brief 283, Sep. 29, 2016-Oct. 2, 2016, Los Angeles, CA. [cited by applicant]
Robert P. Tame, Daniele Barchiesi, & Anssi Klapuri, “Headphone Virtualisation: Improved Localisation and Extemalisation of Non-individualised HRTFs by Cluster Analysis,” Audio Engineering Society's 133rd Convention Pape… [cited by applicant]
Meshram et al., “P-HRTF: Efficient Personalized HRTF Computation for High-Fidelity Spatial Sound,” 2014 EEE International Symposium on Mixed and Augmented Reality (ISMAR), 2014, pp. 53-61, Munich, Germany. [cited by applicant]
Dalena, Marco. “Selection of Head-Related Transfer Function through Ear Contour Matching for Personalized S, inaural Rendering,” Politecnico Di Milano Master thesis for Master of Science in Computer Engineering, 2013, M… [cited by applicant]
Cootes et al, “Active Shape Models—Their Training and Application,” Computer Vision And Image Understanding, Jan. 1995, pp. 38-59, vol. 61, No. 1, Manchester, England. [cited by applicant]
Zotkin, Dmitry et al., HRTF Personalization Using Anthropometric Measurements, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acouistics, Oct. 19-22, 2003, p. 157-160, New Paltz, NY. [cited by applicant]
Karapetyan et al., Elevation Control in Binaural Rendering, Jun. 4-7, 2016, pp. 1-4, Audio Engineering Society, 140th Convention e-Brief 270, Paris, France. [cited by applicant]