IP Library Granted Patent US 12,284,509
Granted Patent B2
US 12,284,509 · App. 18/666,002 · Granted Apr 22, 2025

Method for generating customized spatial audio with head tracking

Inventors: Teck Chee Lee (Singapore, SG); Geith Mark Benjamin Leslie (London, GB); Mark Anthony Davies (Middlesex, GB); Edwin Tomboza (London, GB); Toh Onn Desmond Hii (Singapore, SG)
Assignee: CREATIVE TECHNOLOGY LTD
H04S7/304G06F3/012G06V10/752G10L21/0208H04R3/00H04R5/033H04R5/04H04S7/30H04S2400/11H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,284,509
App. No.
18/666,002
Granted
Apr 22, 2025
Kind
B2
Abstract

A headphone for spatial audio rendering includes a first database having an impulse response pair corresponding to a reference speaker location. A head sensor provides head orientation information to a second database having rotation filters, the filters corresponding to different azimuth and elevation positions relative to the reference speaker location. A digital signal processor combines the rotation filters with the impulse response pair to generate an output binaural audio signal to transducers of the headphone. Efficiencies in creating impulse response or HRTF databases are achieved by sampling the impulse response less frequently than in conventional methods. This sampling at coarser intervals reduces the number of data measurements required to generate a spherical grid and reduces the time involved in capturing the impulse responses. Impulse responses for data points falling between the sampled data points are generated by interpolating in the frequency domain.

Claims (28)

1. A system comprising:

at least one room impulse that includes one of Binaural Room Impulse Response (BRIR) data or Binaural Room Transfer Function (BRTF) data for a target room; and

filters comprising transfer functions to convert a BRIR for a first reference position to a BRIR for a second reference position,

wherein the filters are combined with the at least one room impulse to generate a BRIR for a second group of virtual speaker locations.

2. The system of claim 1 , wherein the second group of virtual speaker locations are outside of the target room.

3. The system of claim 1 , wherein the filters comprise rotation filters.

4. The system of claim 1 , wherein the filters are derived by a division operation.

5. The system of claim 1 , wherein the filters are in a second database, and wherein a plurality of entries in the second database are derived by interpolation.

6. The system of claim 1 , further comprising audio rendering circuitry configured for rendering an output binaural signal.

7. The system of claim 1 , further comprising a head sensor configured to measure head orientation data relative to a reference position.

8. A method comprising:

receiving an input spatial audio direction comprising at least one second spatial audio position; and

accessing, using a deviation of the input spatial audio direction relative to a reference position, transfer functions representing a conversion of a BRIR from a first reference position to the at least one second spatial audio position.

9. The method as recited in claim 8 , wherein the deviation includes a change in head orientation to include at least one of rotation, inclination, or tilt.

10. The method as recited in claim 8 , further comprising creating, using interpolation, a portion of a second database.

11. The method as recited in claim 10 , further comprising performing the interpolation in a frequency domain.

12. The method as recited in claim 8 , wherein the BRIR is a Binaural Acoustic Impulse Response (BAIR).

13. The method as recited in claim 8 , further comprising generating a personalized BRIR for a listener by mapping audio related physical properties for the listener to similar metadata for a group of individuals.

14. A method comprising:

measuring at least one room impulse that includes one of Binaural Room Impulse Response (BRIR) data or Binaural Room Transfer Function (BRTF) data for a target room;

converting, by filters comprising transfer functions, a BRIR for a first reference position to a BRIR for a second reference position; and

combining the filters with impulse responses to generate a BRIR for a second group of virtual speaker locations.

15. The method of claim 14 , further comprising using a division operation to derive the filters.

16. The method of claim 14 , further comprising deriving by interpolating a plurality of entries.

17. The method of claim 14 , further comprising rendering, using audio rendering circuitry, an output binaural signal.

18. The method of claim 14 , further comprising measuring, using a head sensor, head orientation data relative to a reference position.

19. The method of claim 14 , wherein the second group of virtual speaker locations is outside the target room.

20. The method of claim 14 , wherein the filters comprise rotation filters.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2026
From: CREATIVE TECHNOLOGY LTD
To: ZEICA LABS PTE. LTD.
Reel/Frame 074063/0943 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2024
From: CREATIVE TECH (UK) LIMITED
To: CREATIVE TECHNOLOGY LTD
Reel/Frame 067436/0163 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2024
From: LEE, TECK CHEE; LESLIE, GEITH MARK BENJAMIN; DAVIES, MARK ANTHONY; TOMBOZA, EDWIN; HII, TOH ONN DESMOND
To: CREATIVE TECHNOLOGY LTD
Reel/Frame 067436/0280 →
Continuity (7)
Continuation 18364261 · Aug 2, 2023
Continuation 17943106 · Sep 12, 2022
Continuation 17316559 · May 10, 2021
Continuation 16544746 · Aug 19, 2019
Continuation 16136211 · Sep 19, 2018
Provisional Application 62614482 · Jan 7, 2018
Related Publication 20240305949A1 · Sep 12, 2024
References Cited (66)
US 7555354B2 · Walsh et al. · 2009 [cited by applicant]
US 7840019B2 · Slaney et al. · 2010 [cited by applicant]
US 7936887B2 · Smyth · 2011 [cited by applicant]
US 9030545B2 · Pedersen · 2015 [cited by applicant]
US 9544706B1 · Hirst · 2017 [cited by applicant]
US 9584946B1 · Lyren et al. · 2017 [cited by applicant]
US 9602947B2 · Oh et al. · 2017 [cited by applicant]
US 10225682B1 · Lee et al. · 2019 [cited by applicant]
US 10966046B2 · Sim et al. · 2021 [cited by applicant]
US 20080170703A1 · Zivney · 2008 [cited by applicant]
US 20120008806A1 · Hess · 2012 [cited by applicant]
US 20120183161A1 · Agevik et al. · 2012 [cited by applicant]
US 20130202117A1 · Brungart et al. · 2013 [cited by applicant]
US 20150073262A1 · Roth et al. · 2015 [cited by applicant]
US 20150124975A1 · Pontoppidan · 2015 [cited by applicant]
US 20150312694A1 · Bilinski et al. · 2015 [cited by applicant]
US 20150373477A1 · Norris et al. · 2015 [cited by applicant]
US 20150382127A1 · Sun et al. · 2015 [cited by applicant]
US 20160379041A1 · Rhee et al. · 2016 [cited by applicant]
US 20170048641A1 · Franck · 2017 [cited by applicant]
US 20170078820A1 · Brandenburg et al. · 2017 [cited by applicant]
US 20170094440A1 · Brown et al. · 2017 [cited by applicant]
US 20170203011A1 · Neilan et al. · 2017 [cited by applicant]
US 20170245081A1 · Lyren et al. · 2017 [cited by applicant]
US 20170257723A1 · Morishita et al. · 2017 [cited by applicant]
US 20170359666A1 · Lyren et al. · 2017 [cited by applicant]
US 20180218507A1 · Hyllus et al. · 2018 [cited by applicant]
US 20180249275A1 · Ghorbal · 2018 [cited by examiner]
US 20180373957A1 · Lee et al. · 2018 [cited by applicant]
CN 101133679 · 2008 [cited by applicant]
CN 101847268 · 2010 [cited by applicant]
CN 102665156 · 2012 [cited by applicant]
CN 107094277 · 2017 [cited by applicant]
EP 2822301 · 2015 [cited by applicant]
EP 3595336 · 2020 [cited by applicant]
FR 3051951 · 2018 [cited by applicant]
JP 20160507986 · 2016 [cited by applicant]
JP 20170522771 · 2017 [cited by applicant]
JP 2018509864 · 2018 [cited by applicant]
WO 2017041922 · 2017 [cited by applicant]
WO 2017116308 · 2017 [cited by applicant]
WO 2017117293 · 2017 [cited by applicant]
WO 2017202634 · 2017 [cited by applicant]
WO 20170203011 · 2017 [cited by applicant]
Xie Bo-Sun, “Recovery of individual head-related transfer functions from a small set of measurements”, The Journal of the Acoustical Society of America, American Institute of Physics for the Acoustical Society of Americ… [cited by applicant]
EPO; European Search Report dated May 24, 2019 in European Application 18214729.8. [cited by applicant]
CNIPA; First Office Action and Search Report dated Dec. 2, 2022 in Chinese Application 201910007403.1. [cited by applicant]
J. Sheaffer and B. Rafaely, “Equalization strategies for binaural room impulse response rendering using spherical arrays,” 2014 IEEE 28th Convention of Electrical & Electronics Engineers in Israel (IEEEI), Eilat, Israel… [cited by applicant]
JPO; Decision to Grant a Patent dated Apr. 4, 2022 in Japanese Application 2019000508. [cited by applicant]
TIPO, Taiwan Office Action dated Aug. 23, 2022 in Application No. 108100316. [cited by applicant]
USPTO; Notice of Allowance dated Apr. 8, 2019 in U.S. Appl. No. 16/136,211. [cited by applicant]
USPTO; Non-Final Office Action dated Aug. 4, 2020 in U.S. Appl. No. 16/544,746. [cited by applicant]
USPTO; Notice of Allowance dated Jan. 14, 2021 in U.S. Appl. No. 16/544,746. [cited by applicant]
USPTO; Notice of Allowance dated May 9, 2022 in U.S. Appl. No. 17/316,559. [cited by applicant]
John C. Middlebrooks, “Virtual localization improved by scaling nonindividualized external-ear transfer functions n frequency,” Journal of the Acoustical Society of America, Sep. 1999, pp. 1493-1510, vol. 106, No. 3, Pt… [cited by applicant]
V'ukio Iwaya, “Individualization of head-related transfer functions with tournament-style listening test: Listening with Jthe⋅ s ears,” Acoustical Science and Technology, 2006, vol. 27, Issue 6, Japan, pp. 340-343. [cited by applicant]
Slim Ghorbal, Theo Auclair, Catherine Soladie, & Renaud Seguier, “Pinna Morphological Parameters nfluencing HRTF Sets,” Proceedings of the 20th International Conference on Digital Audio Effects {DAFx-17), Sep. 5-9, 2017… [cited by applicant]
Slim Ghorbal, Renaud Seguier, & Xavier Bonjour, “Process of HRTF individualization by 3D statistical ear model,” Audio Engineering Society's 141 st Convention e-Brief 283, Sep. 29, 2016-Oct. 2, 2016, Los l \ngeles, CA, … [cited by applicant]
Robert P. Tame, Daniele Barchiesi, & Anssi Klapuri, “Headphone Virtualisation: Improved Localisation and Externalisation of Non-individualised HRTFs by Cluster Analysis,” Audio Engineering Society's 133rd Convention Pap… [cited by applicant]
Mesh Ram et al., “P-HRTF: Efficient Personalized HRTF Computation for High-Fidelity Spatial Sound,” 2014 IEEE International Symposium on Mixed and Augmented Reality {ISMAR), 2014, pp. 53-61, Munich, Germany. [cited by applicant]
Dalena, Marco. “Selection of Head-Related Transfer Function through Ear Contour Matching for Personalized Binaural Rendering,” Politecnico Di Milano Master thesis for Master of Science in Computer Engineering, 2013, Mil… [cited by applicant]
Cootes et al., “Active Shape Models—Their Training and Application,” Computer Vision And Image Understanding, Jan. 1995, pp. 38-59, vol. 61, No. 1, Manchester, England. [cited by applicant]
Zotkin, Dmitry et al., HRTF Personalization Using Anthropometric Measurements, 2003 IEEE Workshop on l \pplications of Signal Processing to Audio and Acouistics, Oct. 19-22, 2003, p. 157-160, New Paltz, NY. [cited by applicant]
USPTO; Notice of Allowance dated Aug. 9, 2023 in U.S. Appl. No. 17/943,106. [cited by applicant]
USPTO; Corrected Notice of Allowance dated Aug. 30, 2023 in U.S. Appl. No. 17/943,106. [cited by applicant]
USPTO; Notice of Allowance dated Apr. 19, 2024 in U.S. Appl. No. 18/364,261. [cited by applicant]