IP Library Granted Patent US 11,269,586
Granted Patent B2
US 11,269,586 · App. 17/098,268 · Granted Mar 8, 2022

Binaural rendering for headphones using metadata processing

Inventors: Nicolas R. Tsingos (San Francisco, CA); Rhonda Wilson (San Francisco, CA); Sunil Bharitkar (Scotts Valley, CA); C. Phillip Brown (Castro Valley, CA); Alan J. Seefeldt (Alameda, CA); Remi Audfray (San Francisco, CA)
Assignee: Dolby Laboratories Licensing Corporation
G06F3/162G06F3/165H04R5/04H04S1/007H04S7/304H04S7/306G06F3/04842H04S2400/03H04S2400/13H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,269,586
App. No.
17/098,268
Granted
Mar 8, 2022
Kind
B2
Abstract

Embodiments are described for a method of rendering audio for playback through headphones comprising receiving digital audio content, receiving binaural rendering metadata generated by an authoring tool processing the received digital audio content, receiving playback metadata generated by a playback device, and combining the binaural rendering metadata and playback metadata to optimize playback of the digital audio content through the headphones.

Claims (24)

1. A method, performed by an audio signal processing device, for generating a binaural rendering of digital audio content for playback through headphones, the method comprising:

receiving an encoded signal comprising the digital audio content and rendering metadata, wherein the digital audio content comprises a plurality of audio object signals and channel audio signals;

receiving playback control metadata comprising room model metadata, wherein the room model metadata comprises a frequency dependent reverberation time;

decoding the encoded signal to obtain the plurality of audio object signals and channel audio signals; and

generating the binaural rendering of the digital audio content in response to the plurality of audio object signals and channel audio signals, the rendering metadata, and the playback control metadata;

wherein the rendering metadata indicates, for each audio object signal, position and gain, and, for each channel audio signal, whether to use stereo instead of binaural rendering for the channel audio signal;

wherein, when the rendering metadata indicates, for a channel audio signal, to use stereo rendering for the channel audio signal, generating the binaural rendering of the digital audio content comprises, for the channel audio signal, generating a stereo rendering of the channel audio signal; and

wherein, when the rendering metadata indicates, for a channel audio signal, to use binaural rendering for the channel audio signal, generating the binaural rendering of the digital audio content comprises, for the channel audio signal, generating a binaural rendering of the channel audio signal.

2. An audio signal processing device for generating a binaural rendering of digital audio content for playback through headphones, the audio signal processing device comprising one or more processors to:

receive an encoded signal comprising the digital audio content and rendering metadata, wherein the digital audio content comprises a plurality of audio object signals and channel audio signals;

receive playback control metadata comprising room model metadata, wherein the room model metadata comprises a frequency dependent reverberation time;

decode the encoded signal to obtain the plurality of audio object signals and channel audio signals; and

generate the binaural rendering of the digital audio content in response to the plurality of audio object signals and channel audio signals, the rendering metadata, and the playback control metadata;

wherein the rendering metadata indicates, for each audio object signal, position and gain, and, for each channel audio signal, whether to use stereo instead of binaural rendering for the channel audio signal;

wherein, when the rendering metadata indicates, for a channel audio signal, to use stereo rendering for the channel audio signal, generating the binaural rendering of the digital audio content comprises, for the channel audio signal, generating a stereo rendering of the channel audio signal; and

wherein, when the rendering metadata indicates, for a channel audio signal, to use binaural rendering for the channel audio signal, generating the binaural rendering of the digital audio content comprises, for the channel audio signal, generating a binaural rendering of the channel audio signal.

3. A non-transitory computer readable storage medium comprising a sequence of instructions, which, when executed by an audio signal processing device, cause the audio signal processing device to perform a method for generating a binaural rendering of digital audio content for playback through headphones, the method comprising:

receiving an encoded signal comprising the digital audio content and rendering metadata, wherein the digital audio content comprises a plurality of audio object signals and channel audio signals;

receiving playback control metadata comprising room model metadata, wherein the room model metadata comprises a frequency dependent reverberation time;

decoding the encoded signal to obtain the plurality of audio object signals and channel audio signals; and

generating the binaural rendering of the digital audio content in response to the plurality of audio object signals and channel audio signals, the rendering metadata, and the playback control metadata;

wherein the rendering metadata indicates, for each audio object signal, position and gain, and, for each channel audio signal, whether to use stereo instead of binaural rendering for the channel audio signal;

wherein, when the rendering metadata indicates, for a channel audio signal, to use stereo rendering for the channel audio signal, generating the binaural rendering of the digital audio content comprises, for the channel audio signal, generating a stereo rendering of the channel audio signal; and

wherein, when the rendering metadata indicates, for a channel audio signal, to use binaural rendering for the channel audio signal, generating the binaural rendering of the digital audio content comprises, for the channel audio signal, generating a binaural rendering of the channel audio signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2020
From: TSINGOS, NICOLAS R.; BHARITKAR, SUNIL; WILSON, RHONDA; BROWN, C. PHILLIP; SEEFELDT, ALAN J.; AUDFRAY, REMI
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 054571/0913 →
Continuity (6)
Continuation 16673849 · Nov 4, 2019
Continuation 16352607 · Mar 13, 2019
Continuation 15934849 · Mar 23, 2018
Continuation 15031953
Provisional Application 61898365 · Oct 31, 2013
Related Publication 20210132894A1 · May 6, 2021
Cited By (1)
US 12,604,152