IP Library › Granted Patent US 10,750,306
Granted Patent B2
US 10,750,306 · App. 16/510,849 · Granted Aug 18, 2020

Reverberation generation for headphone virtualization

Inventors: Louis D. Fielder (Milbrae, CA); Zhiwei Shuang (Beijing, CN); Grant A. Davidson (Burlingame, CA); Xiguang Zheng (Beijing, CN); Mark S. Vinton (Alameda, CA)
Assignee: Dolby Laboratories Licensing Corporation
H04S3/004G10K15/08H04S5/005H04S7/302H04S7/304H04S2400/01H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,750,306
App. No.
16/510,849
Granted
Aug 18, 2020
Kind
B2
Abstract

The present disclosure relates to reverberation generation for headphone virtualization. A method of generating one or more components of a binaural room impulse response (BRIR) for headphone virtualization is described. In the method, directionally-controlled reflections are generated, wherein directionally-controlled reflections impart a desired perceptual cue to an audio input signal corresponding to a sound source location. Then at least the generated reflections are combined to obtain the one or more components of the BRIR. Corresponding system and computer program products are described as well.

Claims (25)

1. A system for headphone virtualization, comprising:

a filtering unit configured to convolve a binaural room impulse response (BRIR) containing directionally controlled reflections that impart a desired perceptual cue with an audio input signal corresponding to a sound source location to produce a set of left-ear and right-ear intermediate signals, wherein the directionally controlled reflections have a directional pattern in which a direction of arrival changes as a function of time to provide the BRIR with an interaural cross-correlation (IACC) that varies as a function of time and frequency;

a stochastic echo generator configured to generate coefficients for the filtering unit for adding a diffuse component to the audio input signal; and

a combining unit configured to receive the intermediate signals and combine them to form a binaural output signal.

2. The system of claim 1 , wherein the directional pattern describes how directions of arrival of the directionally-controlled reflections change in relation to a direction of the sound source location as a function of time.

3. The system of claim 1 , wherein the directional pattern is a wobble function.

4. The system of claim 3 , wherein the wobble function causes the directions of arrival of the directionally-controlled reflections to change away from the direction of a corresponding virtual sound source location and oscillates back and forth therearound as a function of time.

5. The system of claim 1 , wherein the coefficients generated by the stochastic echo generator are derived from a Head-Related Transfer Function (HRTF) data set, where each filter of the filtering unit provides perceptual cues corresponding to one reflection from a predetermined direction for both a left ear and a right ear.

6. The system of claim 5 , wherein the stochastic echo generator performs a time-based process comprising:

making an independent stochastic binary decision as to whether a reflection should be generated at a given time instant, wherein the probability of a positive decision increases with time; and

generating, if a reflection is determined to be generated, an impulse responses pair for the left ear and right ear according to a desired direction, and wherein the impulse responses pair comprises a generated BRIR at the given time instant.

7. The system of claim 6 , wherein the desired direction is determined based on directions of arrival as a function of time comprising a wobbling function.

8. The system of claim 1 , wherein the combining unit comprises a left summer and a right summer, wherein all left ear intermediate signals are mixed in the left summer to produce a left binaural output signal, and all right ear intermediate signals are mixed in the right summer to produce a right binaural output signal.

9. A method for headphone virtualization, comprising:

convolving, using a filtering unit, a binaural room impulse response (BRIR) containing directionally controlled reflections that impart a desired perceptual cue with an audio input signal corresponding to a sound source location to produce a set of left-ear and right-ear intermediate signals, wherein the directionally controlled reflections have a directional pattern in which a direction of arrival changes as a function of time to provide the BRIR with an interaural cross-correlation (IACC) that varies as a function of time and frequency;

generating coefficients for the filtering unit for adding a diffuse component to the audio input signal; and

combining the intermediate signals to form a binaural output signal.

10. The method of claim 9 , wherein the directional pattern describes how directions of arrival of the directionally-controlled reflections change in relation to a direction of the sound source location as a function of time.

11. The method of claim 9 , wherein the function is a wobble function.

12. The method of claim 9 , wherein the wobble function causes the directions of arrival of the directionally-controlled reflections to change away from the direction of a corresponding virtual sound source location and oscillates back and forth therearound as a function of time.

13. The method of claim 9 , wherein the coefficients are derived from a Head-Related Transfer Function (HRTF) data set, where each filter of the filtering unit provides perceptual cues corresponding to one reflection from a predetermined direction for both a left ear and a right ear.

14. The method of claim 13 , further comprising performing a time-based process of:

making an independent stochastic binary decision as to whether a reflection should be generated at a given time instant, wherein the probability of a positive decision increases with time; and

generating, if a reflection is determined to be generated, an impulse responses pair for the left ear and right ear according to a desired direction, and wherein the impulse responses pair comprises a generated BRIR at the given time instant.

15. A non-transitory computer program product storing instructions which, when executed by a computing device or system, cause said computing device or system to perform the method according to claim 9 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2019
From: FIELDER, LOUIS D.; SHUANG, ZHIWEI; DAVIDSON, GRANT A.; ZHENG, XIGUANG; VINTON, MARK S.
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 050804/0363 →
Priority Claims (2)
CN 2015 1 0077020 · Feb 12, 2015 · national
CN 2016 1 0081281 · Feb 5, 2016 · national
Continuity (4)
Continuation 16163863 · Oct 18, 2018
Continuation 15550424
Provisional Application 62117206 · Feb 17, 2015
Related Publication 20190342685A1 · Nov 7, 2019