IP Library Granted Patent US 12,604,152
Granted Patent B2
US 12,604,152 · App. 18/436,010 · Granted Apr 14, 2026

Binarual rendering

Inventors: Rishabh Tyagi (Sydney, AU); Stefan Bruhn (Sollentuna, SE); Juan Felix Torres (Redfern, AU)
Assignees: Dolby Laboratories Licensing Corporation; DOLBY INTERNATIONAL AB
H04S7/304G10L19/008H04S3/008H04S2400/01H04S2400/03H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,604,152
App. No.
18/436,010
Granted
Apr 14, 2026
Kind
B2
Abstract

An aspect of the present disclosure relates to processing audio comprising decoding a first bitstream (b 1 ) to obtain decoded immersive audio content (A), decoding a second bitstream (b p ) to obtain pose information (P, V, V′) associated with a user of a lightweight processing device, determining a first head-pose (P′) based on the pose information, providing a downmix representation (Dmx) of the immersive audio content (A) corresponding to the first head pose (P′), rendering a set of binaural representations (BIN n ) of the immersive audio content (A), wherein the binaural representations correspond to a second set of head poses (P n ), computing reconstruction metadata (M) to enable reconstruction of the set of binaural representations from the downmix representation (Dmx), the metadata (M) including the first head pose (P′), and encoding the downmix representation (Dmx) and the reconstruction metadata (M) in a third bitstream (b 2 ).

Claims (12)

1 . A method of processing audio in a main device, the method comprising:

receiving a first bitstream (b 1 );

decoding the first bitstream (b 1 ) to obtain decoded immersive audio content (A);

receiving a second bitstream (b p );

decoding the second bitstream (b p ) to obtain pose information (P; P″; P, V) associated with a user of a lightweight processing device;

determining a first head-pose (P′) based on the pose information (P; P″; P, V);

generating a downmix representation (Dmx) of the immersive audio content (A) corresponding to the first head pose (P′);

rendering a set of binaural representations (BIN n ) of the immersive audio content (A), wherein the binaural representations correspond to a second set of head poses (P n );

computing reconstruction metadata (M) to enable reconstruction of the set of binaural representations from the downmix representation (Dmx), the metadata (M) including the first head pose (P′);

encoding the downmix representation (Dmx) and the reconstruction metadata (M) in a third bitstream (b 2 ); and

outputting the third bitstream (b 2 ).

2 . A non-transitory computer-readable storage medium storing a program comprising instructions that, when executed by a processor, cause the processor to carry out the method according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2025
From: TYAGI, RISHABH; BRUHN, STEFAN; TORRES, JUAN FELIX
To: DOLBY LABORATORIES LICENSING CORPORATION; DOLBY INTERNATIONAL AB
Reel/Frame 072526/0001 →
Continuity (2)
Provisional Application 63386465 · Dec 7, 2022
Related Publication 20240196156A1 · Jun 13, 2024
References Cited (100)
US 6259795B1 · McGrath · 2001 [cited by applicant]
US 6331851B1 · Suzuki · 2001 [cited by applicant]
US 9396588B1 · Li · 2016 [cited by applicant]
US 9648438B1 · Petrov · 2017 [cited by applicant]
US 10419865B2 · Briand · 2019 [cited by applicant]
US 10770080B2 · Dick · 2020 [cited by applicant]
US 10819953B1 · Lovitt · 2020 [cited by examiner]
US 10924875B2 · Settel · 2021 [cited by applicant]
US 10953327B2 · Fersch · 2021 [cited by applicant]
US 11102604B2 · Eronen · 2021 [cited by applicant]
US 11269586B2 · Tsingos · 2022 [cited by applicant]
US 11303875B2 · Malaika · 2022 [cited by applicant]
US 11321906B2 · Melkote Krishnaprasad · 2022 [cited by applicant]
US 11455705B2 · Banerjee · 2022 [cited by applicant]
US 20040098462A1 · Horvitz · 2004 [cited by applicant]
US 20080144794A1 · Gardner · 2008 [cited by applicant]
US 20110066262A1 · Kelly · 2011 [cited by applicant]
US 20110210982A1 · Sylvan · 2011 [cited by applicant]
US 20140222439A1 · Jung · 2014 [cited by applicant]
US 20140355766A1 · Morrell · 2014 [cited by examiner]
US 20140355825A1 · Kim · 2014 [cited by applicant]
US 20150012466A1 · Sapiro · 2015 [cited by applicant]
US 20150029218A1 · Williams · 2015 [cited by applicant]
US 20150109415A1 · Son · 2015 [cited by applicant]
US 20150304634A1 · Karvounis · 2015 [cited by applicant]
US 20150350846A1 · Chen · 2015 [cited by applicant]
US 20160361658A1 · Osman · 2016 [cited by applicant]
US 20170018121A1 · Lawson · 2017 [cited by applicant]
US 20170115488A1 · Ambrus · 2017 [cited by applicant]
US 20170295446A1 · Thagadur Shivappa · 2017 [cited by applicant]
US 20180357038A1 · Olivieri · 2018 [cited by applicant]
US 20190215632A1 · Chung · 2019 [cited by applicant]
US 20190295558A1 · Purnhagen et al. · 2019 [cited by applicant]
US 20200162833A1 · Lee · 2020 [cited by applicant]
US 20200236489A1 · Merimaa et al. · 2020 [cited by applicant]
US 20200250466A1 · Lee · 2020 [cited by applicant]
US 20210056978A1 · Mehta · 2021 [cited by applicant]
US 20210120360A1 · Terentiv · 2021 [cited by applicant]
US 20210168553A1 · Brown · 2021 [cited by applicant]
US 20210243546A1 · Audfray · 2021 [cited by applicant]
US 20210258690A1 · Josephus · 2021 [cited by applicant]
US 20210287651A1 · Eronen · 2021 [cited by applicant]
US 20210409886A1 · Schevciw · 2021 [cited by applicant]
US 20210409887A1 · Munoz · 2021 [cited by applicant]
US 20220014868A1 · Binn · 2022 [cited by applicant]
US 20220021996A1 · Brimijoin, II · 2022 [cited by applicant]
US 20220028172A1 · Yip · 2022 [cited by applicant]
US 20220070606A1 · Falk · 2022 [cited by applicant]
US 20220086590A1 · Norris · 2022 [cited by applicant]
US 20220103965A1 · Tu · 2022 [cited by applicant]
US 20220174444A1 · Vilkamo · 2022 [cited by applicant]
US 20220182772A1 · Dodds · 2022 [cited by applicant]
US 20220269471A1 · Tsingos · 2022 [cited by applicant]
US 20220321628A1 · Rhyu · 2022 [cited by applicant]
US 20230065644A1 · Terentiv · 2023 [cited by applicant]
CA 3044260A1 · 2020 [cited by applicant]
GB 2601805A · 2022 [cited by applicant]
GB 2636868A · 2025 [cited by examiner]
JP 2012518313A · 2012 [cited by applicant]
JP 2014513367A · 2014 [cited by applicant]
JP 2015233252A · 2015 [cited by applicant]
JP 2017079457A · 2017 [cited by applicant]
RU 2560340C2 · 2015 [cited by applicant]
RU 2575690C2 · 2016 [cited by applicant]
RU 2605370C2 · 2016 [cited by applicant]
WO 200155833W · 2001 [cited by applicant]
WO 2013064914A1 · 2013 [cited by applicant]
WO WO2019067445A1 · 2019 [cited by examiner]
WO 2020043539A1 · 2020 [cited by applicant]
WO 2021170900A1 · 2021 [cited by applicant]
WO 2022015020A1 · 2022 [cited by applicant]
WO 2022022876A1 · 2022 [cited by applicant]
WO 2022072242A1 · 2022 [cited by applicant]
WO 2022089713A1 · 2022 [cited by applicant]
WO 2022136725A1 · 2022 [cited by applicant]
WO 2023285732A1 · 2023 [cited by applicant]
WO 2023187208A1 · 2023 [cited by applicant]
WO 2023220024A1 · 2023 [cited by applicant]
WO 2024059505A1 · 2024 [cited by applicant]
WO 2024123936A2 · 2024 [cited by applicant]
WO 2024182457A1 · 2024 [cited by applicant]
WO WO2024208956A1 · 2024 [cited by examiner]
WO 2025136874A1 · 2025 [cited by applicant]
3GPP TR 26.928 V17.0.0 (Apr. 2022). 3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Extended Reality (XR) in 5G (Release 17). 131 pages. [cited by applicant]
Breebaart Jet al: “Multi-channel goes mobile: MPEG surround binaural rendering”, AES International Conference. Audio for Mobile and Handhelddevices, XX, XX, Sep. 2, 2006 (Sep. 2, 2006), pp. 1-13. 13 pages. [cited by applicant]
Chan, K. et al “Distributed Sound Rendering for Interactive Virtual Environments” IEEE International Conference on Multimedia and Expo ,Jun. 27-30, 2004, pp. 1-4. [cited by applicant]
D22117 to be cross-cited with D22091 and D17029 Both Ways D22040WO01 is to be cited in D22117 only. [cited by applicant]
Immersive audio, capture, transport, and rendering: a review. Published online by Cambridge University Press: Sep. 16, 2021. Xuejing Sun. 24 pages. [cited by applicant]
J Breebaart et al: “Binaural Cues for Multiple Sound Sources” In: “Spatial Audio Processing: MPEG Surround and Other Applications”, Jan. 1, 2007 (Jan. 1, 2007), John Wiley & Sons. 16 pages. [cited by applicant]
Mariette, N. et al “SoundDelta a Study of Audio Augmented Reality using WIFI-distributed Ambisonic Cell Rendering” AES, presented at the 128th Convention, May 22-25, 2010, London, UK, pp. 1-15. [cited by applicant]
Minnaar Pauli et al: “The importance of head movements for binaural room synthesis—a pilot experiment”, Jan. 1, 2000 (Jan. 1, 2000). 6 pages. [cited by applicant]
Natural listening over headphones in augmented reality using adaptive filtering techniques. Rishabh Ranjan, Woon-Seng Gan. IEEE/ACM Transactions on Audio, Speech and Language Processing, vol. 23, Issue 11, Nov. 2015 htt… [cited by applicant]
Personalizing head related transfer functions for earables.Zhijian Yang, Romit Roy Choudhury. SIGCOMM '21: Proceedings of the 2021 ACM SIGCOMM 2021 Conference, Aug. 2021 https://dl.acm.org/doi/abs/10.1145/3452296.347290… [cited by applicant]
Warusfel, O. et al “Listen Augmenting Everyday Environments Through Interactive Soundscapes” Cordis EU Research, start date Jan. 1, 2001. [cited by applicant]
XR over 5G, 3GPP latest developments around immersive media. Gilles Teniou—(Tencent) 3GPP SA4 Vice-Chair—Video SWG chair VRIF Second VRIF Online Event—Apr. 22, 2021. https://www.vr-if.org/wp-content/uploads/VRIF-April-2… [cited by applicant]
3GPP TS 26.253 V18.3.0 Release 18, ETSI, Jan. 2025, pp. 1-860, 861 pages. [cited by applicant]
Breebaart, J., van de Par, S., Kohlrausch, A., & de Vries, L. (2005). Parametric coding of stereo audio. EURASIP Journal on Applied Signal Processing, 2005(9), 1309-1316. https://doi.org/10.1155/ASP.2005.1305. 20 pages. [cited by applicant]
Herre, J., Plogsties, J., Disch, S., & Breebaart, J. (Oct. 2004). Spatial audio coding: Next-generation efficient and compatible coding of multi-channel audio (AES Convention Paper No. 6186). Audio Engineering Society 1… [cited by applicant]
Chan, K. et al “Distributed Sound Rendering for Interactive Virtual Environments” IEEE International Conference on Multimedia and Expo , Jun. 27-30, 2004, pp. 1-4. 4 pages. [cited by applicant]
Mariette, N. et al “SoundDelta a Study of Audio Augmented Reality using WIFI-distributed Ambisonic Cell Rendering” AES, presented at the 128th Convention, May 22-25, 2010, London, UK, pp. 1-15. 15 pages. [cited by applicant]