IP Library Granted Patent US 9,681,250
Granted Patent B2
US 9,681,250 · App. 14/120,522 · Granted Jun 13, 2017

Statistical modelling, interpolation, measurement and anthropometry based prediction of head-related transfer functions

Inventors: Yuancheng Luo (College Park, MD); Ramani Duraiswami (Highland, MD); Dmitry N. Zotkin (Greenbelt, MD)
Assignee: University of Maryland, College Park
H04S7/303H04S5/00H04S7/304H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,681,250
App. No.
14/120,522
Granted
Jun 13, 2017
Kind
B2
Abstract

A system for generating and outputting three-dimensional audio data using head-related transfer functions (HRTFs) includes a processor configured to perform operations comprising: using a collection of previously measured HRTFs for audio signals corresponding to multiple directions for at least one subject; performing non-parametric Gaussian process hyper-parameter training on the collection of previously measured HRTFs to generate one or more predicted HRTFs that are different from the previously measured HRTFs; and generating and outputting three-dimensional audio data based on at least the one or more predicted HRTFs.

Claims (53)

1. A system for generating and outputting three-dimensional audio data using head-related transfer functions (HRTFs), the system comprising:

a tangible, non-transitory memory communicating with a processor, the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations comprising:

using a collection of previously measured HRTFs for audio signals corresponding to multiple directions for at least one subject;

performing non-parametric Gaussian process hyper-parameter training on the collection of previously measured HRTFs to generate one or more predicted HRTFs that are different from the previously measured HRTFs; and

generating and outputting three-dimensional audio data based on at least the one or more predicted HRTFs.

2. The system according to claim 1 , wherein the operation of performing Gaussian process hyper-parameter training on the collection of HRTFs further comprises causing the processor to perform operations that include:

applying sparse Gaussian process regression to perform the Gaussian process hyper-parameter training on the collection of HRTFs.

3. The system of claim 2 ,

wherein the one or more predicted HRTFs are HRTFs for test directions not part of an original set of said multiple directions, and

the method further comprises causing the processor to calculate a confidence interval for the one or more predicted HRTFs.

4. The system of claim 3 , further comprising causing the processor to perform an operation that includes:

extracting extrema data from the one or more predicted HRTFs.

5. The system according to claim 1 , further comprising causing the processor to perform an operation that includes:

accessing the collection of HRTFs to provide a data base of HRTF for autoencoder (AE) neural network (NN) learning; and

learning an AE NN based on the collection of HRTFs accessed; and

generating low-dimensional bottleneck AE features.

6. The system of claim 5 , further comprising causing the processor to perform an operation that includes:

generating target directions;

computing sound-source localization errors reflecting an argument; and

accounting for the sound-source localization errors in a global minimization of the argument of the sound-source localization errors (SSLE).

7. The system of claim 6 , further comprising causing the processor to perform an operation that includes:

decoding the argument of the sound-source localization errors to the one or more predicted HRTFs.

8. The system of claim 7 , further comprising causing the processor to perform an operation that includes:

performing a listening test utilizing the one or more predicted HRTFs;

reporting a localized direction as feedback input;

recomputing the SSLE; and

re-performing the global minimization of the argument of the SSLE.

9. The system of claim 8 , further comprising causing the processor to perform an operation that includes:

generating a Gaussian process listener inference based upon the steps of decoding of the argument of the SSLE to the one or more predicted HRTFs, performing the listening test utilizing the one or more predicted HRTFs, and reporting the localized direction as feedback input.

10. The system of claim 1 , wherein the method further comprises causing the processor to perform operations that include:

receiving HRTF measurements from different sources, and creating the one or more predicted HRTFs based on said HRTF measurement from different sources.

11. The system of claim 10 , further comprising causing the processor to perform an operation that includes:

accessing a database HRTFs for the same individual in multiple directions; and

accessing a database of HRTF test directions.

12. The system of claim 11 , further comprising causing the processor to perform an operation that includes:

based on the accessing steps, implementing Gaussian process inference.

13. The system of claim 12 , further comprising causing the processor to perform an operation that includes:

calculating confidence intervals for the one or more predicted HRTFs.

14. A method for generating and outputting three-dimensional audio data using head-related transfer functions (HRTF), the method comprising:

collecting audio signals in a transform domain for at least one subject;

applying head related transfer functions in multiple directions to the collected audio signals;

performing non-parametric Gaussian hyper-parameter training on the collection of HRTFs to generate one or more predicted HRTFs; and

generating and outputting three dimensional audio data based at least on the one or more predicted HRTFs.

15. The method according to claim 14 , further comprising causing the processor to perform an operation that includes:

identifying an individual associated with the one or more predicted HRTFs.

16. The method according to claim 15 , wherein the step of performing Gaussian hyper-parameter training on the collection of HRTFs further comprises applying sparse Gaussian process regression to perform the Gaussian hyper-parameter training on the collection of HRTFs.

17. The method according to claim 16 , further comprising:

applying HRTF test directions; and

inferring Gaussian progression virtual listener measurements.

18. The method according to claim 17 , further comprising:

calculating a confidence interval for the one or more predicted HRTFs.

19. The method according to claim 18 , further comprising:

extracting extrema data from the predicted HRTFs.

Assignments (2)
CONFIRMATORY LICENSE Recorded Feb 27, 2017
From: MARYLAND, UNIVERSITY OF
To: NAVY, SECRETARY OF THE UNITED STATES OF AMERICA
Reel/Frame 041842/0121 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2015
From: LUO, YUANCHENG; DURAISWAMI, RAMANI; ZOTKIN, DMITRY
To: UNIVERSITY OF MARYLAND, COLLEGE PARK
Reel/Frame 035240/0877 →
Continuity (2)
Provisional Application 61827071 · May 24, 2013
Related Publication 20150055783A1 · Feb 26, 2015