IP Library › Granted Patent US 12,432,520
Granted Patent B2
US 12,432,520 · App. 17/859,791 · Granted Sep 30, 2025

Colorless generation of elevation perceptual cues using all-pass filter networks

Inventors: Joseph Anthony Mariglio, III (Encinitas, CA); Zachary Seldess (San Diego, CA)
Assignee: Boomcloud 360 Inc.
H04S7/307G10L19/008G10L19/16G10L19/26G10L21/028H04R3/04H04S1/007H04S3/008H04S2400/01H04S2400/05H04S2400/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,432,520
App. No.
17/859,791
Granted
Sep 30, 2025
Kind
B2
Abstract

A system includes one or more computing devices that encode spatial perceptual cues into a monaural channel to generate a plurality of output channels. A computing device determines a target amplitude response for the mid and side channels of the plurality of output channels, defining a spatial perceptual associated with one or more frequency-dependent phase shifts. The computing device determines a transfer function of a single-input, multi-output allpass filter based on the target amplitude response and determines coefficients of the allpass filter based on the transfer function, and processes the monaural channel with the coefficients of the allpass filter to generate the plurality of channels having the encoded spatial perceptual cues. The allpass filter is configured to be colorless with respect to the individual output channels, allowing for the placement of spatial cues into the audio stream to be decoupled from the overall coloration of the audio.

Claims (50)

1. A method for encoding spatial cues along a sagittal plane into a monaural signal to generate a plurality of resulting channels, comprising, by a processing circuitry:

determining a target amplitude response for either mid- or side-components of the plurality of resulting channels based upon a spatial cue and corresponding to a coloration change in mid/side space, wherein the target amplitude response corresponds to a frequency-dependent phase shift that preserves coloration in left/right space;

converting the target amplitude response for either the mid or side components into a transfer function for a single-input, multi-output allpass filter; and

processing the monaural signal using the single-input, multi-output allpass filter, wherein the allpass filter is configured based upon the transfer function.

2. The method of claim 1 , wherein the target amplitude response for the mid- or side-component of the plurality of resulting channels is determined in terms of a notch.

3. The method of claim 2 , wherein the notch is in the range of 8 kHz to 16 kHz, for the purpose of encoding vertical spatial cues.

4. The method of claim 1 , wherein:

the target amplitude response for the mid- or side-component of the plurality of resulting channels is determined in terms of amplitude over frequency; and

further comprising converting the target amplitude response into coefficients for the single-input, multi-output allpass filter using an inverse discrete fourier transform (idft).

5. The method of claim 1 , wherein:

the target amplitude response for the mid- or side-component of the plurality of resulting channels is determined in terms of amplitude over frequency; and

further comprising converting the target amplitude response into coefficients for the single-input, multi-output allpass filter using a phase-vocoder.

6. The method of claim 1 , wherein the target amplitude response defines one or more parametric spatial cues, including one or more of a target broadband attenuation, a critical point, a filter characteristic, and a soundstage location.

7. The method of claim 6 , wherein the filter characteristic includes one of:

a high-pass filter characteristic;

a low-pass filter characteristic;

a band-pass filter characteristic; or

a band-reject filter characteristic.

8. A system for encoding spatial cues along a sagittal plane into a monaural signal to generate a plurality of resulting channels, comprising:

one or more computing devices configured to:

determine a target amplitude response for either mid- and side-components of the plurality of resulting channels based upon a spatial cue and corresponding to a coloration change in mid/side space, wherein the target amplitude response corresponds to a frequency-dependent phase shift that preserves coloration in left/right space;

convert the target amplitude response for either the mid or side components into a transfer function for a single-input, multi-output allpass filter; and

process the monaural signal using the single-input, multi-output allpass filter, wherein the allpass filter is configured based upon the transfer function.

9. The system of claim 8 , wherein the target amplitude response for the mid- or side-component of the plurality of resulting channels is determined in terms of a notch.

10. The system of claim 9 , wherein the notch is in the range of 8 kHz to 12 kHz, for the purpose of encoding vertical spatial cues.

11. The system of claim 8 , wherein:

the target amplitude response for the mid- or side-component of the plurality of resulting channels is determined in terms of amplitude over frequency; and

the one or more computing devices are further configured to convert the target amplitude response into coefficients for the single-input, multi-output allpass filter using an inverse discrete fourier transform (idft).

12. The system of claim 8 , wherein:

the target amplitude response for the mid- or side-component of the plurality of resulting channels is determined in terms of amplitude over frequency; and

the one or more computing devices are further configured to convert the target amplitude response into coefficients for the single-input, multi-output allpass filter using a phase-vocoder.

13. The system of claim 8 , wherein the target amplitude response defines one or more parametric spatial cues, including one or more of a target broadband attenuation, a critical point, a filter characteristic, and a soundstage location.

14. The system of claim 13 , wherein the filter characteristic includes one of:

a high-pass filter characteristic;

a low-pass filter characteristic;

a band-pass filter characteristic; or

a band-reject filter characteristic.

15. A non-transitory computer readable medium comprising stored instructions for encoding spatial cues along a sagittal plane into a monaural signal to generate a plurality of resulting channels, the instructions that, when executed by at least one processor, configure the at least one processor to:

determine a target amplitude response for either mid- and side-components of the plurality of resulting channels based upon a spatial cue and corresponding to a coloration change in mid/side space, wherein the target amplitude response corresponds to a frequency-dependent phase shift that preserves coloration in left/right space;

convert the target amplitude response for either the mid or side components into a transfer function for a single-input, multi-output allpass filter; and

process the monaural signal using the single-input, multi-output allpass filter, wherein the allpass filter is configured based upon the transfer function.

16. The non-transitory computer readable medium of claim 15 , wherein the target amplitude response for the mid- or side-component of the resulting channels is determined in terms of a notch.

17. The non-transitory computer readable medium of claim 16 , wherein the notch is in the range of 8 kHz to 12 kHz, for the purpose of encoding vertical spatial cues.

18. The non-transitory computer readable medium of claim 15 , wherein:

the target amplitude response for the mid- or side-component of the plurality of resulting channels is determined in terms of amplitude over frequency; and

the one or more processors are further configured to convert the target amplitude response into coefficients for the single-input, multi-output allpass filter using an inverse discrete fourier transform (idft).

19. The non-transitory computer readable medium of claim 15 , wherein:

the target amplitude response for the mid- or side-component of the plurality of resulting channels is determined in terms of amplitude over frequency; and

the one or more processors are further configured to convert the target amplitude response into coefficients for the single-input, multi-output allpass filter using a phase-vocoder.

20. The non-transitory computer readable medium of claim 15 , wherein the target amplitude response defines one or more constraints on a summation of the plurality of resulting channels, including one or more of a target broadband attenuation, a critical point, and a filter characteristic.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2024
From: MARIGLIO, JOSEPH ANTHONY, III; SELDESS, ZACHARY
To: BOOMCLOUD 360 INC.
Reel/Frame 066092/0602 →
Continuity (3)
Provisional Application 63284993 · Dec 1, 2021
Provisional Application 63219698 · Jul 8, 2021
Related Publication 20230022072A1 · Jan 26, 2023
References Cited (70)
US 4188667A · Graupe · 1980 [cited by examiner]
US 5500900A · Chen · 1996 [cited by examiner]
US 5699404A · Satyamurti et al. · 1997 [cited by applicant]
US 5796842A · Hanna · 1998 [cited by examiner]
US 7103187B1 · Neuman · 2006 [cited by examiner]
US 8867750B2 · Brown · 2014 [cited by applicant]
US 9269360B2 · McGrath · 2016 [cited by applicant]
US 20050177360A1 · Schuijers et al. · 2005 [cited by applicant]
US 20060093152A1 · Thompson et al. · 2006 [cited by applicant]
US 20070168183A1 · Van De Kerkhof · 2007 [cited by applicant]
US 20080137874A1 · Christoph · 2008 [cited by examiner]
US 20090060204A1 · Reams et al. · 2009 [cited by applicant]
US 20090222261A1 · Jung · 2009 [cited by examiner]
US 20090299734A1 · Zhou · 2009 [cited by examiner]
US 20100303246A1 · Walsh et al. · 2010 [cited by applicant]
US 20110115987A1 · Kubo · 2011 [cited by applicant]
US 20120170757A1 · Kraemer · 2012 [cited by examiner]
US 20130094654A1 · Breebaart et al. · 2013 [cited by applicant]
US 20130322636A1 · Vickers · 2013 [cited by applicant]
US 20160005417A1 · Van Hoesel et al. · 2016 [cited by applicant]
US 20160203822A1 · Purnhagen et al. · 2016 [cited by applicant]
US 20170142528A1 · Edwards · 2017 [cited by applicant]
US 20190108846A1 · Chebiyyam et al. · 2019 [cited by applicant]
US 20190285673A1 · Skovenborg · 2019 [cited by applicant]
US 20200021923A1 · Elmedyb · 2020 [cited by examiner]
US 20210044898A1 · Mariglio, III · 2021 [cited by applicant]
US 20210112339A1 · Seldess · 2021 [cited by applicant]
US 20220021996A1 · Brimijoin, II · 2022 [cited by examiner]
US 20220030369A1 · Faundez Hoffmann · 2022 [cited by examiner]
CN 108476367A · 2018 [cited by applicant]
CN 111418219A · 2020 [cited by applicant]
EP 3340660A1 · 2018 [cited by applicant]
JP S4942723Y1 · 1974 [cited by applicant]
JP H11289598A · 1999 [cited by applicant]
JP 2000504526A · 2000 [cited by applicant]
JP 2006005414A · 2006 [cited by applicant]
JP 2009276268A · 2009 [cited by applicant]
JP 2010016625A · 2010 [cited by applicant]
JP 2010529780A · 2010 [cited by applicant]
JP 2019506780A · 2019 [cited by applicant]
JP 2020528580A · 2020 [cited by applicant]
JP 2024507219A · 2024 [cited by applicant]
KR 1020070091518A · 2007 [cited by applicant]
WO WO199823131A1 · 1998 [cited by applicant]
WO WO2007095298A2 · 2007 [cited by applicant]
WO WO2008016097A1 · 2008 [cited by applicant]
WO WO2020044362A2 · 2020 [cited by applicant]
WO WO2021026314A1 · 2021 [cited by applicant]
WO WO2021071576A1 · 2021 [cited by applicant]
Hooks, S. “Powerful Dolby Atmos Sound Coming to Xbox One and Windows 10,” Xbox.com, Dec. 14, 2016, 6 pages, Retrieved from the internet <URL:https://news.xbox.com/en-us/2016/12/14/dolby-atmos-xbox-one-windows-10/>. [cited by applicant]
Dolby, “Dolby Virtual Speaker,” Dolby Technologies, Jan. 29, 2009, 1 page, Retrieved from the internet <URL:https://web.archive.org/web/20090129084314/http:/www.dolby.com/consumer/technology/virtual_speaker.html>. [cited by applicant]
Dolby, “Dolby Virtual Speaker Technology: Fundamental Principles,” Dolby Technologies, Feb. 4, 2009, 5 pages, Retrieved from the internet <URL:https://web.archive.org/web/20090204003955/http:/www.dolby.com/consumer/tech… [cited by applicant]
Dolby, “Dolby PC Entertainment Experience,” Dolby Personal Computer, Feb. 10, 2009, 1 page, Retrieved from the internet <URL:https://web.archive.org/web/20090210195032/http:/www.dolby.com/consumer/pc/pcee/index.html>. [cited by applicant]
Deboer, C. “Dolby Updates PC Entertainment Experience Program,” Audioholics.com, Mar. 12, 2008, 2 pages, Retrieved from the internet <URL:https://www.audioholics.com/news/dolby-pc-entertainment-experience>. [cited by applicant]
PCT International Search Report and Written Opinion, PCT Application No. PCT/US2022/036412, Oct. 21, 2022, 9 pages. [cited by applicant]
PCT International Search Report and Written Opinion, PCT Application No. PCT/US2022/016836, Jun. 2, 2022, nine pages. [cited by applicant]
Pei, S-C. et al. “Closed-Form Design of All-Pass Fractional Delay Filters.” IEEE Signal Processing Letters, vol. 11, No. 10, Oct. 2004, pp. 788-791. [cited by applicant]
China National Intellectual Property Administration, Office Action, CN Patent Application No. 202280047861.8, Jun. 29, 2024, 10 pages. [cited by applicant]
Hu, Z. et al. “Generalized Cross-Correlation Time Delay Estimation Algorithm Based on Frequency Division in Reverberation Environment.” Computer Engineering, vol. 44, No. 9, Sep. 2018, pp. 269-273, (with English abstrac… [cited by applicant]
Taiwan Intellectual Property Office, Office Action, Taiwanese Patent Application No. 112142963, Sep. 20, 2024, 14 pages. [cited by applicant]
Breebaart, J. et al. “High-quality parametric spatial audio coding at low bitrates,” Audio Engineering Society Convention, vol. 116, Audio Engineering Society, May 1, 2004, 13 pages. [cited by applicant]
Japan Patent Office, Office Action with English Translation, Japanese Patent Application No. 2023-575530, May 7, 2024, 6 pages. [cited by applicant]
Korean Intellectual Property Office, Office Action with English Translation, Korean Patent Application No. 10-2024-7004637, Jun. 17, 2024, 9 pages. [cited by applicant]
European Patent Office, Extended European Search Report, European Patent Application No. 22756945.6, Nov. 25, 2024, nine pages. [cited by applicant]
Jakka, J. “Binaural to Multichannel Audio Upmix.” Master's Thesis, Helsinki University of Technology, Jun. 6, 2005, pp. i-52. [cited by applicant]
Orban, R. “A Rational Technique for Synthesizing Pseudo-Stereo from Monophonic Sources.” Journal of the Audio Engineering Society, vol. 18, No. 2. Apr. 1970, pp. 157-164. [cited by applicant]
The Japan Patent Office, Office Action, Japanese Patent Application No. 2023-550040, Dec. 3, 2024, five pages. [cited by applicant]
European Patent Office, Partial Supplementary European Search Report with Provisional Opinion, European Patent Application No. 22838430.1, Mar. 18, 2025, 14 pages. [cited by applicant]
European Patent Office, Extended European Search Report, European Patent Application No. 22838430.1, May 28, 2025, 14 pages. [cited by applicant]
Japan Patent Office, Office Action, Japanese Patent Application No. 2024-166285, Jul. 22, 2025, six pages. [cited by applicant]