IP Library › Granted Patent US 12,587,787
Granted Patent B2
US 12,587,787 · App. 18/644,745 · Granted Mar 24, 2026

System for dynamically adjusting the gain structure of sound sources contained within one or more inclusion and exclusion zones

Inventor: Kael Blais (Broomfield, CO)
Assignee: NUREVA, INC.
H04R3/04H04R3/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,587,787
App. No.
18/644,745
Granted
Mar 24, 2026
Kind
B2
Abstract

A system is provided for intelligent and optimized zone gain management of sound sources within priority (inclusion) zones and adjacent to the priority (inclusion) zone boundaries of the 3D space by using sound source location and signal level information of sound sources from both inside the inclusion zone and outside the inclusion zone in the exclusion zone for the purpose of optimizing the audio gain structure of desired sound sources located in priority (inclusion) zones and minimizing the gain structure of undesired sound sources in low priority (exclusion) zones. The system utilizes all virtual microphones in the 3D space by preferably assigning all available virtual microphones to either an inclusion zone or exclusion zone configuration for the purpose of tracking and monitoring all sound sources in the space regardless of their position in the 3D space.

Claims (59)

1 . A system for dynamically adjusting gain structures of sound sources in a shared 3D space including one or more inclusion zones and one or more exclusion zones, comprising:

a combined microphone array comprising one or more of individual microphones and/or microphone arrays each including a plurality of microphones; and

one or more system processors communicating with the combined microphone array, wherein the one or more system processors comprise one or more audio channel profiles (ACPs) and are configured to perform operations comprising:

obtaining predetermined coverage zone dimensions based on the locations of the microphones of the combined microphone array;

populating the coverage zone dimensions with one or more virtual microphones;

obtaining a combined microphone signal, for each audio channel profile (ACP), by combining microphone signals into desired channel audio signals by applying positional based gain control (PBGC) parameters to adjust microphones to control positional based microphone gains based on location information of the sound sources;

performing processes to obtain a zoning gain for each ACP, comprising:

receiving a list of sound sources obtained by utilizing the virtual microphones;

receiving zone parameters for one or more inclusion zones (IZ) and one or more exclusion zones (EZ);

identifying a gain source (GS) and a list of one or more attenuation sources (AS);

determining a zoning ratio based on the gain source, the list of the one or more attenuation sources and active zone configuration parameters; and

calculating zoning gain based on the zoning ratio, maximum gain of the one or more inclusion zones and minimum gain of the one or more exclusion zones; and

generating an output channel for each ACP by multiplying the zoning gain with the combined microphone signal.

2 . The system of claim 1 wherein the zone parameters for the one or more inclusion zones and the one or more exclusion zones comprise physical boundaries of the active zone configuration parameters, weights of the inclusion zones, and a maximum number of the attenuation sources that are allocated for the ACP.

3 . The system of claim 1 wherein the active zone configuration parameters includes a minimum power threshold (P min ), a first threshold for P GS /P AS , and a second threshold for P AS /P GS , where P GS is a power of the gain source and P AS is a power of the attenuation source.

4 . The system of claim 1 wherein the ACP contains zoning parameters of the output channel including locations and gains of the one or more inclusion zones and the one or more exclusion zones for the output channel.

5 . The system of claim 1 wherein a location of the gain source represents a physical location for which the individual microphone signals are aligned to produce the output signal of an ACP.

6 . The system of claim 1 wherein each ACP is configured to track or identify a single gain source among gain sources in the one or more inclusion zones.

7 . The system of claim 1 wherein each ACP is configured to support multiple attenuation sources.

8 . The system of claim 1 wherein the shared 3D space is entirely filled or partially filled with the virtual microphones for monitoring and tracking the sound sources.

9 . The system of claim 1 wherein each output channel is configured independently for different needs.

10 . The system of claim 1 wherein the one or more inclusion zones and the one or more exclusion zones are configured by grouping all the available virtual microphones into either the one or more inclusion zones or the one or more exclusion zones based on the locations of the virtual microphones in the shared 3D space.

11 . The system of claim 1 wherein the one or more system processors are configured to apply a positive gain structure to targeted sound sources in the one or more inclusion zones and to apply a negative gain structure to targeted sound sources in the one or more exclusion zones.

12 . The system of claim 1 wherein the one or more inclusion zones and the one or more exclusion zones are configured by grouping at least one virtual microphone or more than one virtual microphones into either the one or more inclusion zones or the one or more exclusion zones based on the locations of the virtual microphones in the shared 3D space.

13 . The system of claim 1 wherein the one or more inclusion zones and the one or more exclusion zones are configured to support any dimensioned 3D or 2D shape that contains the one or more virtual microphones in the shared 3D space.

14 . A method for dynamically adjusting gain structures of sound sources in a shared 3D space including one or more inclusion zones and one or more exclusion zones, comprising:

obtaining predetermined coverage zone dimensions, via one or more system processors, based on locations of microphones of a combined microphone array, wherein the combined microphone array comprises one or more of individual microphones and/or microphone arrays each including a plurality of microphones, and the system processors communicate with the combined microphone array and comprise one or more audio channel profiles (ACPs);

populating the coverage zone dimensions with one or more virtual microphones;

obtaining a combined microphone signal, for each audio channel profile (ACP), by combining microphone signals into desired channel audio signals by applying positional based gain control (PBGC) parameters to adjust microphones to control positional based microphone gains based on location information of the sound sources;

performing processes to obtain a zoning gain for each ACP, comprising:

receiving a list of sound sources obtained by utilizing the virtual microphones;

receiving zone parameters for one or more inclusion zones (IZ) and one or more exclusion zones (EZ);

identifying a gain source (GS) and a list of one or more attenuation sources (AS);

determining a zoning ratio based on the gain source, the list of the one or more attenuation sources and active zone configuration parameters; and

calculating zoning gain based on the zoning ratio, maximum gain of the one or more inclusion zones and minimum gain of the one or more exclusion zones; and

generating an output channel for each ACP by multiplying the zoning gain with the combined microphone signal.

15 . The method of claim 14 wherein the zone parameters for the one or more inclusion zones and the one or more exclusion zones comprise physical boundaries of the active zone configuration parameters, weights of the inclusion zones, and a maximum number of the attenuation sources that are allocated for the ACP.

16 . The method of claim 14 wherein the active zone configuration parameters includes a minimum power threshold (P min ), a first threshold for P GS /P AS , and a second threshold for P AS /P GS , where P GS is a power of the gain source and P AS is a power of the attenuation source.

17 . The method of claim 14 wherein the ACP contains zoning parameters of the output channel including locations and gains of the inclusion zones and exclusion zones for the output channel.

18 . The method of claim 14 wherein a location of the gain source represents a physical location for which the individual microphone signals are aligned to produce the output signal of an ACP.

19 . The method of claim 14 wherein each ACP is configured to track or identify a single gain source among gain sources in the one or more inclusion zones.

20 . The method of claim 14 wherein the ACP is configured to support multiple attenuation sources.

21 . The method of claim 14 wherein the shared 3D space is entirely filled or partially filled with the virtual microphones for monitoring and tracking the sound sources.

22 . The method of claim 14 wherein each output channel is configured independently for different needs.

23 . The method of claim 14 wherein the one or more inclusion zones and the one or more exclusion zones are configured by grouping all the available virtual microphones into either the one or more inclusion zones or the one or more exclusion zones based on the locations of the virtual microphones in the shared 3D space.

24 . The method of claim 14 wherein a positive gain structure is applied to targeted sound sources in the inclusion zone and a negative gain structure is applied to targeted sound sources in the exclusion zone.

25 . The method of claim 14 wherein the one or more inclusion zones and the one or more exclusion zones are configured by grouping at least one virtual microphone or more than one virtual microphones into either the one or more inclusion zones or the one or more exclusion zones based on the locations of the virtual microphones in the shared 3D space.

26 . The method of claim 14 wherein the one or more inclusion zones and the one or more exclusion zones are configured to support any dimensioned 3D or 2D shape that contains the one or more virtual microphones in the shared 3D space.

27 . One or more non-transitory computer-readable media for dynamically adjusting gain structures of sound sources in a shared 3D space including one or more inclusion zones and one or more exclusion zones, the computer-readable media comprising instructions configured to cause a system processor to perform operations comprising:

obtaining predetermined coverage zone dimensions, via one or more system processors, based on locations of microphones of a combined microphone array, wherein the combined microphone array comprises one or more of individual microphones and/or microphone arrays each including a plurality of microphones, and the system processors communicate with the combined microphone array and comprise one or more audio channel profiles (ACPs);

populating the coverage zone dimensions with one or more virtual microphones;

obtaining a combined microphone signal, for each audio channel profile (ACP), by combining microphone signals into desired channel audio signals by applying positional based gain control (PBGC) parameters to adjust microphones to control positional based microphone gains based on location information of the sound sources;

performing processes to obtain a zoning gain for each ACP, comprising:

receiving a list of sound sources obtained by utilizing the virtual microphones;

receiving zone parameters for one or more inclusion zones (IZ) and one or more exclusion zones (EZ);

identifying a gain source (GS) and a list of one or more attenuation sources (AS);

determining a zoning ratio based on the gain source, the list of the one or more attenuation sources and active zone configuration parameters; and

calculating zoning gain based on the zoning ratio, maximum gain of the one or more inclusion zones and minimum gain of the one or more exclusion zones; and

generating an output channel for each ACP by multiplying the zoning gain with the combined microphone signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2024
From: BLAIS, KAEL
To: NUREVA, INC.
Reel/Frame 067213/0547 →
Continuity (2)
Provisional Application 63465087 · May 9, 2023
Related Publication 20240381026A1 · Nov 14, 2024
References Cited (136)
US 4499578A · Marouf et al. · 1985 [cited by applicant]
US 4536887A · Kaneda et al. · 1985 [cited by applicant]
US 5477270A · Park · 1995 [cited by applicant]
US 5699437A · Finn · 1997 [cited by applicant]
US 6469732B1 · Chang et al. · 2002 [cited by applicant]
US 6593956B1 · Potts et al. · 2003 [cited by applicant]
US 6912178B2 · Chu et al. · 2005 [cited by applicant]
US 6912718B1 · Chang et al. · 2005 [cited by applicant]
US 7130705B2 · Amir et al. · 2006 [cited by applicant]
US 7254241B2 · Rui et al. · 2007 [cited by applicant]
US 7489788B2 · Leung et al. · 2009 [cited by applicant]
US 7720232B2 · Oxford et al. · 2010 [cited by applicant]
US 7848531B1 · Vickers et al. · 2010 [cited by applicant]
US 7995768B2 · Miki et al. · 2011 [cited by applicant]
US 8185387B1 · Lachapelle · 2012 [cited by applicant]
US 8861537B1 · Braithwaite et al. · 2014 [cited by applicant]
US 8953819B2 · Ko et al. · 2015 [cited by applicant]
US 9706292B2 · Duraiswami et al. · 2017 [cited by applicant]
US 9800964B2 · McIntosh et al. · 2017 [cited by applicant]
US 10003900B2 · Cartwright et al. · 2018 [cited by applicant]
US 10042038B1 · Lord et al. · 2018 [cited by applicant]
US 10063987B2 · McGibney · 2018 [cited by applicant]
US 10229697B2 · Bastyr et al. · 2019 [cited by applicant]
US 10237639B2 · McIntosh et al. · 2019 [cited by applicant]
US 10387108B2 · McGibney · 2019 [cited by applicant]
US 10397726B2 · McGibney · 2019 [cited by applicant]
US 10848896B2 · McGibney · 2020 [cited by applicant]
US 10972835B2 · Rollow, IV · 2021 [cited by applicant]
US 11127415B2 · Magnusson et al. · 2021 [cited by applicant]
US 11190871B2 · Yorga et al. · 2021 [cited by applicant]
US 20050280701A1 · Wardell · 2005 [cited by applicant]
US 20060034469A1 · Tamiya et al. · 2006 [cited by applicant]
US 20060165242A1 · Miki et al. · 2006 [cited by applicant]
US 20080085014A1 · Chen et al. · 2008 [cited by applicant]
US 20080107277A1 · Somasundaram et al. · 2008 [cited by applicant]
US 20080285771A1 · Tanaka et al. · 2008 [cited by applicant]
US 20090129609A1 · Oh et al. · 2009 [cited by applicant]
US 20100034397A1 · Nakadai et al. · 2010 [cited by applicant]
US 20100135118A1 · Van Leest et al. · 2010 [cited by applicant]
US 20110135125A1 · Zhan et al. · 2011 [cited by applicant]
US 20120093344A1 · Sun et al. · 2012 [cited by applicant]
US 20120245933A1 · Flaks et al. · 2012 [cited by applicant]
US 20130083934A1 · Ahgren · 2013 [cited by applicant]
US 20130101134A1 · Betts-Lacroix · 2013 [cited by applicant]
US 20130142342A1 · Del Galdo et al. · 2013 [cited by applicant]
US 20130258813A1 · Herre et al. · 2013 [cited by applicant]
US 20140050328A1 · Fischer · 2014 [cited by applicant]
US 20140098964A1 · Rosca · 2014 [cited by examiner]
US 20140119552A1 · Beaucoup · 2014 [cited by applicant]
US 20140133666A1 · Tanaka et al. · 2014 [cited by applicant]
US 20140185824A1 · Burnett · 2014 [cited by applicant]
US 20140314251A1 · Rosca et al. · 2014 [cited by applicant]
US 20140348342A1 · Laaksonen et al. · 2014 [cited by applicant]
US 20150185312A1 · Gaubitch et al. · 2015 [cited by applicant]
US 20150222996A1 · Chu et al. · 2015 [cited by applicant]
US 20150230026A1 · Eichfeld et al. · 2015 [cited by applicant]
US 20160071526A1 · Wingate et al. · 2016 [cited by applicant]
US 20160112469A1 · Liu · 2016 [cited by applicant]
US 20160173976A1 · Podhradsky · 2016 [cited by applicant]
US 20170178628A1 · Macours et al. · 2017 [cited by applicant]
US 20170347217A1 · McGibney · 2017 [cited by applicant]
US 20170366896A1 · Adsumilli et al. · 2017 [cited by applicant]
US 20170374454A1 · Bernardini et al. · 2017 [cited by applicant]
US 20180074782A1 · McGibney · 2018 [cited by applicant]
US 20180098174A1 · Goodwin et al. · 2018 [cited by applicant]
US 20180249267A1 · Klingler et al. · 2018 [cited by applicant]
US 20190349471A1 · Ferguson et al. · 2019 [cited by applicant]
US 20210035563A1 · Cartwright et al. · 2021 [cited by applicant]
US 20220004355A1 · Mcgibney · 2022 [cited by examiner]
EP 0903055B1 · 2007 [cited by applicant]
EP 2975609A1 · 2016 [cited by applicant]
JP 3154468B2 · 2001 [cited by applicant]
JP 2018026701A · 2018 [cited by applicant]
WO 03010995A2 · 2003 [cited by applicant]
WO 2022118072A1 · 2022 [cited by applicant]
WO 2023164773A1 · 2023 [cited by applicant]
International Search Report and Written Opinion mailed Aug. 9, 2024, for International Patent Application No. PCT/CA2024/050615, 9 sheets. [cited by applicant]
Final Office Action dated Dec. 5, 2024, from U.S. Appl. No. 17/739,926, 29 sheets. [cited by applicant]
International Search Report and Written Opinion mailed Sep. 15, 2017, from International Application No. PCT/CA2017/050642, 12 sheets. [cited by applicant]
Joseph Hector Dibiase, Thesis entitled, “A High-Accuracy, Low-Latency Technique for Talker Localization in Reverberant Environments Using Microphone Arrays”, Brown University, May 2000. [cited by applicant]
Notice of Allowance dated Apr. 30, 2018, from U.S. Appl. No. 15/597,646, 18 sheets. [cited by applicant]
International Search Report and Written Opinion mailed Jun. 7, 2023, from International Application No. PCT/CA2023/50412, 11 sheets. [cited by applicant]
Extended European Search Report mailed May 7, 2019, from European Patent Application No. 17805437.5, 23 sheets. [cited by applicant]
Notice of Allowance dated May 24, 2019, from U.S. Appl. No. 16/110,393, 6 sheets. [cited by applicant]
Non-Final Rejection dated Sep. 17, 2018, from U.S. Appl. No. 16/110,393, 14 sheets. [cited by applicant]
International Search Report and Written Opinion mailed Oct. 12, 2017, from International Application No. PCT/CA2017/050676, 8 sheets. [cited by applicant]
Notice of Allowance dated Apr. 2, 2019, from U.S. Appl. No. 15/603,986, 42 sheets. [cited by applicant]
Final Rejection dated May 25, 2018, from U.S. Appl. No. 15/603,986, 13 sheets. [cited by applicant]
Non-Final Rejection dated Jan. 24, 2018, from U.S. Appl. No. 15/603,986, 26 sheets. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Feb. 17, 2020, from European Patent Application No. 17805437.5, 6 sheets. [cited by applicant]
Notice of Allowance dated Jul. 16, 2020, from U.S. Appl. No. 16/518,013, 19 sheets. [cited by applicant]
Non-Final Rejection dated Feb. 28, 2020, from U.S. Appl. No. 16/518,013, 21 sheets. [cited by applicant]
Notice of Allowance dated Apr. 11, 2019, from U.S. Appl. No. 16/110,393, 18 sheets. [cited by applicant]
Notice of Allowance dated Jan. 19, 2018, from U.S. Appl. No. 15/597,646, 22 sheets. [cited by applicant]
Notice of Allowance dated Aug. 16, 2021, from U.S. Appl. No. 17/097,560, 33 sheets. [cited by applicant]
Extended European search report from European Application No. 20194651.4 with a mailing date of Jan. 21, 2021, 11 sheets. [cited by applicant]
Extended European search report from European Application No. 17847841.8 with a mailing date of Jun. 28, 2019, 12 sheets. [cited by applicant]
Communication pursuant to Rules 70(2) and 70a(2) EPC from European Application No. 17847841.8 with a mailing date of Jul. 16, 2019, 1 sheet. [cited by applicant]
U.S. Appl. No. 62/343,512, filed May 31, 2016, 41 sheets. [cited by applicant]
U.S. Appl. No. 62/162,091, filed May 15, 2015, 52 sheets. [cited by applicant]
U.S. Appl. No. 62/345,208, filed Jun. 3, 2016, 44 sheets. [cited by applicant]
Non-Final Rejection dated Feb. 9, 2021, from U.S. Appl. No. 16/434,725, 72 sheets. [cited by applicant]
Notice of Allowance dated Jan. 25, 2023, from U.S. Appl. No. 17/374,585, 11 sheets. [cited by applicant]
Notice of Allowance dated Jan. 19, 2023, from U.S. Appl. No. 17/374,585, 41 sheets. [cited by applicant]
Non-Final Rejection dated Aug. 8, 2022, from U.S. Appl. No. 17/374,585, 57 sheets. [cited by applicant]
The extended European search report completed Feb. 2, 2022 (dated Feb. 10, 2022), from European Application No. 19808293.5, 8 sheets. [cited by applicant]
Emanuel A. P. Habets and Jacob Benesty, “A Two-Stage Beamforming Approach for Noise Reduction and Dereverberation”, IEEE Transactions on Audio, Speeach, and Language Processing, vol. 21, No. 5, May 2013, pp. 945-958. [cited by applicant]
Gerhard Doblinger, “An Adaptive Microphone Array for Optimum Beamforming and Noise Reduction”, 14th European Signal Processing Conference (EUSIPCO 2006), Florence, Italy, Sep. 4-8, 2006, 5 sheets. [cited by applicant]
Taylor B. Spalt, Christopher R. Fuller, Thomas F. Brooks, William M. Humphreys, Jr., “A Background Noise Reduction Technique using Adaptive Noise Cancellation for Microphone Arrays”, p. 1-16, available at: https://ntrs.… [cited by applicant]
International Search Report and Written Opinion dated Oct. 3, 2019, from PCT/CA2019/050708, 9 sheets. [cited by applicant]
Notice of Allowance dated Feb. 10, 2023, from U.S. Appl. No. 16/421,908, 24 sheets. [cited by applicant]
Final Rejection dated Oct. 11, 2022, from U.S. Appl. No. 16/421,908, 26 sheets. [cited by applicant]
Non-Final Rejection dated Apr. 20, 2022, from U.S. Appl. No. 16/421,908, 38 sheets. [cited by applicant]
International Search Report and Written Opinion dated Jun. 15, 2023, from International Application No. PCT/CA2023/050371, 7 sheets. [cited by applicant]
International Search Report and Written Opinion dated May 30, 2023, from International Application No. PCT/CA2023/050277, 7 sheets. [cited by applicant]
The extended European search report dated Sep. 27, 2022, from European Patent Application No. 20749339.6, 15 sheets. [cited by applicant]
International Search Report and Written Opinion mailed May 22, 2020, from International Application No. PCT/CA2020/050100, 11 sheets. [cited by applicant]
Non-Final Rejection dated Dec. 10, 2020, from U.S. Appl. No. 16/774,258, 28 sheets. [cited by applicant]
Notice of Allowance dated Jul. 26, 2021, from U.S. Appl. No. 16/774,258, 21 sheets. [cited by applicant]
Lightspeed Technologies, “Audio Solutions for Classroom Reopening Challenges”, Duplicom Presentation Systems, https://www.duplicom.com/products/lightspeed-audio-solutions/, Aug. 27, 2020, 7 sheets. [cited by applicant]
Luis Guerra, Troy Jensen, “How to Use The Shure MXA910 Ceiling Array Microphone for Voice Lift”, Shure Incorporated, USA, Created Sep. 2016, upated Jul. 2018, Shure Incorporated, 11 sheets. [cited by applicant]
Alberta Infrastructure, “Sound-Field Systems Guide for Classrooms”, published in May 2004, 19 sheets. [cited by applicant]
The extended European Search Report dated Feb. 11, 2022, from European Patent Application No. 21204322.8, 7 sheets. [cited by applicant]
International Search and Written Opinion dated Jul. 18, 2022, from PCT/CA2022/050731, 8 sheets. [cited by applicant]
Non-Final Office Action dated Apr. 25, 2024, from U.S. Appl. No. 17/739,926, 57 sheets. [cited by applicant]
Non-Final Office Action dated Oct. 11, 2023, from U.S. Appl. No. 17/516,480, 40 sheets. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Oct. 14, 2024, from European Patent Application No. 20749339.6-1207, 10 sheets. [cited by applicant]
Notice of Allowance dated Feb. 7, 2024, from U.S. Appl. No. 17/516,480, 10 sheets. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Feb. 29, 2024, from European Patent Application No. 21204322.8, 9 sheets. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Mar. 12, 2024, from European Patent Application No. 19808293.5, 6 sheets. [cited by applicant]
Theodoropoulos D et al.: “A reconfigurable beamformer for audio applications”, 7th Symposium on Application Specific Processors, 2009. SASP '09. IEEE,, Jul. 27, 2009, pp. 80-87, XP031522047, ISBN: 978-1-4244-4939-2. [cited by applicant]
The extended European search report dated Dec. 17, 2025, from European Patent Application No. 23762644.5, 9 sheets. [cited by applicant]
Kozintsev I et al.: “Position Calibration of Microphones and Loudspeakers in Distributed Computing Platforms”, IEEE Transactions On Speech and Audio Processing, IEEE Service Center, New York, NY, US, vol. 13, No. 1, Jan… [cited by applicant]
Pasi Pertila et al.: “Closed-form self-localization of asynchronous microphone arrays”, Hands-Free Speech Communication and Microphone Arrays (HSCMA), 2011 Joint Workshop On, IEEE, May 30, 2011 (May 30, 2011), pp. 139-1… [cited by applicant]
Kovalyov Anton et al.: “Joint Calibration and Synchronization of Two Arrays of Microphones and Loudspeakers Using Particle Swarm Optimization”, IEEE Open Journal of Signal Processing, IEEE, vol. 2, Oct. 11, 2021 (Oct. 1… [cited by applicant]
The extended European search report dated Feb. 10, 2026, from European Patent Application No. 23773395.1, 10 sheets. [cited by applicant]