IP Library Granted Patent US 12,457,465
Granted Patent B2
US 12,457,465 · App. 18/126,739 · Granted Oct 28, 2025

System for dynamically deriving and using positional based gain output parameters across one or more microphone element locations

Inventors: Aleksander Radisavljevic (Victoria, CA); Linshan Li (Calgary, CA); Kael Blais (Englewood, CO)
Assignee: NUREVA, INC.
H04S7/30H04R1/406H04R3/005H04R2201/401H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,457,465
App. No.
18/126,739
Granted
Oct 28, 2025
Kind
B2
Abstract

A system is provided for positional based automatic gain control to adjust one or more dynamically configured combined microphone array in a shared 3D space. The system includes a combined microphone array including one or more of individual microphones and/or microphone arrays and a system processor communicating with the combined microphone array. The system processor is configured to obtain predetermined locations of the microphones throughout the shared 3D space, obtain predetermined coverage zone dimensions based on the locations of the microphones, populate the coverage zone dimensions with virtual microphones, identify locations of sound sources in the shared 3D space based on the virtual microphones, compute positional based gain control (PBGC) parameter values for virtual microphones based on the locations of the virtual microphones, and combine microphone signals into desired channel audio signals by applying the PBGC parameters to adjust microphones to control positional based microphone gains based on the location information of the sound sources.

Claims (56)

1. A system for sound source positional based automatic gain control to dynamically adjust individual microphone elements of a cohesive microphone element in a shared 3D space for optimum audio signal and ambient sound level performance, comprising:

one or more of individual microphones and/or microphone arrays each including a plurality of microphones, wherein the microphones in each microphone array are arranged along a microphone axis; and

a system processor communicating with the one or more of individual microphones and/or microphone arrays, wherein the system processor is configured to perform operations comprising:

obtaining, in real-time, locations of microphone elements of the one or more of individual microphones and/or microphone arrays throughout the shared 3D space and integrating, in real-time, the one or more of individual microphones and/or microphone arrays, by measuring delays to each microphone element of the one or more of individual microphones and/or microphone arrays, to build a single cohesive microphone element comprising the microphones elements of the one or more of individual microphones and/or microphone arrays;

obtaining, in real-time, a consolidated coverage zone dimension based on the single cohesive microphone element;

populating, in real-time, the consolidated coverage zone dimension with virtual microphones;

identifying locations of sound sources in the shared 3D space based on one or more of the virtual microphones receiving targeting focus;

computing one or more positional based gain control (PBGC) parameter values at locations of the one or more of the virtual microphones receiving the targeting focus based on the locations of the sound sources and the locations of the individual microphone elements of the single cohesive microphone element; and

combining individual microphone element signals into desired one or more channel audio signals by applying the PBGC parameters to the individual microphone element signals to adjust the individual microphone elements of the single cohesive microphone element based on the location information of the sound sources.

2. The system of claim 1 wherein the PBGC parameter values are stored in one or more computer-readable media.

3. The system of claim 1 wherein the PBGC parameter values comprise gains for the individual microphone elements of the single cohesive microphone element and the virtual microphones.

4. The system of claim 1 wherein the adjusting the individual microphone elements comprises adjusting a gain value for each individual microphone element.

5. The system of claim 1 wherein the PBGC parameters are pre-computed based on the locations of the virtual microphones.

6. The system of claim 1 wherein the PBGC parameters are computed in real-time when a new sound source location is determined and corresponding virtual microphone receives focus.

7. The system of claim 1 wherein the operations further comprise:

creating processed audio signals from raw individual microphone element signals; and

applying gain values to processed audio signals by using the PBGC parameters.

8. The system of claim 1 wherein the PBGC parameter values are derived on a per individual microphone element basis.

9. The system of claim 1 wherein the microphone elements of the single cohesive microphone element are configured to form a 2D plane in the shared 3D space.

10. The system of claim 1 wherein the microphone elements of the single cohesive microphone element are configured to form a hyperplane in the shared 3D space.

11. A method for sound source positional based automatic gain control to dynamically adjust individual microphone elements of a cohesive microphone element in a shared 3D space for optimum audio signal and ambient sound level performance, comprising:

obtaining, in real-time, locations of microphone elements of one or more of individual microphones and/or microphone arrays each including a plurality of microphones arranged along a microphone axis throughout the shared 3D space and integrating, in real-time, the one or more of individual microphones and/or microphone arrays, by measuring delays to each microphone element of the one or more of individual microphones and/or microphone arrays, to build a single cohesive microphone element comprising the microphones elements of the one or more of individual microphones and/or microphone arrays;

obtaining, in real-time, a consolidated coverage zone dimension based on the single cohesive microphone element;

populating, in real-time, the consolidated coverage zone dimension with virtual microphones;

identifying locations of sound sources in the shared 3D space based on one or more of the virtual microphones receiving targeting focus;

computing one or more positional based gain control (PBGC) parameter values at locations of the one or more of the virtual microphones receiving the targeting focus based on the locations of the sound sources and the locations of the individual microphone elements of the single cohesive microphone element; and

combining individual microphone element signals into one or more channel audio signals by applying the PBGC parameters to the individual microphone element signals to adjust the individual microphone elements of the single cohesive microphone element based on the location information of the sound sources.

12. The method of claim 11 wherein the PBGC parameter values are stored in one or more computer-readable media.

13. The method of claim 11 wherein the PBGC parameter values comprise gains for the individual microphone elements of the single cohesive microphone element and the virtual microphones.

14. The method of claim 11 wherein the adjusting the individual microphone elements comprises adjusting a gain value for each individual microphone element.

15. The method of claim 11 wherein the PBGC parameters are pre-computed based on the locations of the virtual microphones.

16. The method of claim 11 wherein the PBGC parameters are computed in real-time when a new sound source location is determined and corresponding virtual microphone receives focus.

17. The method of claim 11 further comprising:

creating processed audio signals from raw individual microphone element signals; and

applying gain values to processed audio signals by using the PBGC parameters.

18. The method of claim 11 wherein the PBGC parameter values are derived on a per individual microphone element basis.

19. The method of claim 11 wherein the microphone elements of the single cohesive microphone element are configured to form a 2D plane in the shared 3D space.

20. The method of claim 11 wherein the microphone elements of the single cohesive microphone element are configured to form a hyperplane in the shared 3D space.

21. One or more non-transitory computer-readable media for sound source positional based automatic gain control to dynamically adjust individual microphone elements of a cohesive microphone element in a shared 3D space for optimum audio signal and ambient sound level performance, the computer-readable media comprising instructions configured to cause a system processor to perform operations comprising:

obtaining, in real-time, locations of microphone elements of one or more of individual microphones and/or microphone arrays each including a plurality of microphones arranged along a microphone axis throughout the shared 3D space and integrating, in real-time, the one or more of individual microphones and/or microphone arrays, by measuring delays to each microphone element of the one or more of individual microphones and/or microphone arrays, to build a single cohesive microphone element comprising the microphones elements of the one or more of individual microphones and/or microphone arrays;

obtaining, in real-time, a consolidated coverage zone dimension based on the single cohesive microphone element;

populating, in real-time, the consolidated coverage zone dimension with virtual microphones;

identifying locations of sound sources in the shared 3D space based on one or more of the virtual microphones receiving targeting focus;

computing one or more positional based gain control (PBGC) parameter values at locations of the one or more of the virtual microphones receiving targeting focus based on the locations of the sound sources and the locations of the individual microphone elements of the single cohesive microphone element; and

combining individual microphone element signals into one or more channel audio signals by applying the PBGC parameters to the individual microphone signals to adjust the individual microphone elements of the single cohesive microphone element based on the location information of the sound sources.

22. The one or more non-transitory computer-readable media of claim 21 wherein the PBGC parameter values are stored in one or more computer-readable media.

23. The one or more non-transitory computer-readable media of claim 21 wherein the PBGC parameter values comprise gains for the individual microphone elements of the single cohesive microphone element and the virtual microphones.

24. The one or more non-transitory computer-readable media of claim 21 wherein the adjusting the individual microphone elements comprises adjusting a gain value for each individual microphone element.

25. The one or more non-transitory computer-readable media of claim 21 wherein the PBGC parameters are pre-computed based on the locations of the virtual microphones.

26. The one or more non-transitory computer-readable media of claim 21 wherein the PBGC parameters are computed in real-time when a new sound source location is determined and corresponding virtual microphone receives focus.

27. The one or more non-transitory computer-readable media of claim 21 wherein the operations further comprise:

creating processed audio signals from raw individual microphone element signals; and

applying gain values to processed audio signals by using the PBGC parameters.

28. The one or more non-transitory computer-readable media of claim 21 wherein the PBGC parameter values are derived on a per individual microphone element basis.

29. The one or more non-transitory computer-readable media of claim 21 wherein the microphone elements of the single cohesive microphone element are configured to form a 2D plane in the shared 3D space.

30. The one or more non-transitory computer-readable media of claim 21 wherein the microphone elements of the single cohesive microphone element are configured to form a hyperplane in the shared 3D space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2023
From: RADISAVLJEVIC, ALEKSANDER; LI, LINSHAN; BLAIS, KAEL
To: NUREVA, INC.
Reel/Frame 065106/0289 →
Continuity (2)
Provisional Application 63324452 · Mar 28, 2022
Related Publication 20230308822A1 · Sep 28, 2023
References Cited (132)
US 4499578A · Marouf et al. · 1985 [cited by applicant]
US 4536887A · Kaneda et al. · 1985 [cited by applicant]
US 5477270A · Park · 1995 [cited by applicant]
US 5699437A · Finn · 1997 [cited by applicant]
US 6469732B1 · Chang et al. · 2002 [cited by applicant]
US 6593956B1 · Potts et al. · 2003 [cited by applicant]
US 6912178B2 · Chu et al. · 2005 [cited by applicant]
US 6912718B1 · Chang et al. · 2005 [cited by applicant]
US 7130705B2 · Amir et al. · 2006 [cited by applicant]
US 7254241B2 · Rui et al. · 2007 [cited by applicant]
US 7489788B2 · Leung et al. · 2009 [cited by applicant]
US 7720232B2 · Oxford et al. · 2010 [cited by applicant]
US 7848531B1 · Vickers et al. · 2010 [cited by applicant]
US 7995768B2 · Miki et al. · 2011 [cited by applicant]
US 8185387B1 · Lachapelle · 2012 [cited by applicant]
US 8861537B1 · Braithwaite et al. · 2014 [cited by applicant]
US 8953819B2 · Ko et al. · 2015 [cited by applicant]
US 9706292B2 · Duraiswami et al. · 2017 [cited by applicant]
US 9800964B2 · McIntosh et al. · 2017 [cited by applicant]
US 10003900B2 · Cartwright et al. · 2018 [cited by applicant]
US 10042038B1 · Lord et al. · 2018 [cited by applicant]
US 10063987B2 · McGibney · 2018 [cited by applicant]
US 10229697B2 · Bastyr et al. · 2019 [cited by applicant]
US 10237639B2 · McIntosh et al. · 2019 [cited by applicant]
US 10387108B2 · McGibney · 2019 [cited by applicant]
US 10397726B2 · McGibney · 2019 [cited by applicant]
US 10848896B2 · McGibney · 2020 [cited by applicant]
US 10972835B2 · Rollow, IV · 2021 [cited by applicant]
US 11127415B2 · Magnusson et al. · 2021 [cited by applicant]
US 11190871B2 · Yorga et al. · 2021 [cited by applicant]
US 20050280701A1 · Wardell · 2005 [cited by applicant]
US 20060034469A1 · Tamiya et al. · 2006 [cited by applicant]
US 20060165242A1 · Miki et al. · 2006 [cited by applicant]
US 20080085014A1 · Chen et al. · 2008 [cited by applicant]
US 20080107277A1 · Somasundaram et al. · 2008 [cited by applicant]
US 20080285771A1 · Tanaka et al. · 2008 [cited by applicant]
US 20090129609A1 · Oh et al. · 2009 [cited by applicant]
US 20100034397A1 · Nakadai et al. · 2010 [cited by applicant]
US 20100135118A1 · Van Leest et al. · 2010 [cited by applicant]
US 20110135125A1 · Zhan et al. · 2011 [cited by applicant]
US 20120093344A1 · Sun et al. · 2012 [cited by applicant]
US 20120245933A1 · Flaks et al. · 2012 [cited by applicant]
US 20130083934A1 · Ahgren · 2013 [cited by applicant]
US 20130101134A1 · Betts-Lacroix · 2013 [cited by applicant]
US 20130142342A1 · Del Galdo et al. · 2013 [cited by applicant]
US 20130258813A1 · Herre et al. · 2013 [cited by applicant]
US 20140050328A1 · Fischer · 2014 [cited by applicant]
US 20140098964A1 · Rosca et al. · 2014 [cited by applicant]
US 20140119552A1 · Beaucoup · 2014 [cited by applicant]
US 20140133666A1 · Tanaka et al. · 2014 [cited by applicant]
US 20140185824A1 · Burnett · 2014 [cited by applicant]
US 20140314251A1 · Rosca et al. · 2014 [cited by applicant]
US 20140348342A1 · Laaksonen et al. · 2014 [cited by applicant]
US 20150185312A1 · Gaubitch et al. · 2015 [cited by applicant]
US 20150222996A1 · Chu et al. · 2015 [cited by applicant]
US 20150230026A1 · Eichfeld et al. · 2015 [cited by applicant]
US 20160071526A1 · Wingate et al. · 2016 [cited by applicant]
US 20160112469A1 · Liu · 2016 [cited by applicant]
US 20160173976A1 · Podhradsky · 2016 [cited by applicant]
US 20170178628A1 · Macours et al. · 2017 [cited by applicant]
US 20170347217A1 · McGibney · 2017 [cited by examiner]
US 20170366896A1 · Adsumilli et al. · 2017 [cited by applicant]
US 20170374454A1 · Bernardini et al. · 2017 [cited by applicant]
US 20180074782A1 · McGibney · 2018 [cited by examiner]
US 20180098174A1 · Goodwin et al. · 2018 [cited by applicant]
US 20180249267A1 · Klingler et al. · 2018 [cited by applicant]
US 20190349471A1 · Ferguson et al. · 2019 [cited by applicant]
US 20190364359A1 · Ferguson · 2019 [cited by examiner]
US 20210035563A1 · Cartwright et al. · 2021 [cited by applicant]
US 20220004355A1 · McGibney · 2022 [cited by applicant]
US 20230133265A1 · Springer · 2023 [cited by examiner]
EP 0903055B1 · 2007 [cited by applicant]
EP 2975609A1 · 2016 [cited by applicant]
JP 3154468B2 · 2001 [cited by applicant]
JP 2018026701A · 2018 [cited by applicant]
WO 03010995A2 · 2003 [cited by applicant]
WO 2022118072A1 · 2022 [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Oct. 14, 2024, from European Patent Application No. 20749339.6-1207, 10 sheets. [cited by applicant]
International Search Report and Written Opinion mailed Aug. 9, 2024, for International Patent Application No. PCT/CA2024/050615, 9 sheets. [cited by applicant]
Notice of Allowance dated Feb. 7, 2024, from U.S. Appl. No. 17/516,480, 10 sheets. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Feb. 29, 2024, from European Patent Application No. 21204322.8, 9 sheets. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Mar. 12, 2024, from European Patent Application No. 19808293.5, 6 sheets. [cited by applicant]
Theodoropoulos D et al.: “A reconfigurable beamformer for audio applications”, 7th Symposium on Application Specific Processors, 2009. SASP '09. IEEE,, Jul. 27, 2009, pp. 80-87, XP031522047, ISBN: 978-1-4244-4939-2. [cited by applicant]
Final Office Action dated Dec. 5, 2024, from U.S. Appl. No. 17/739,926, 29 sheets. [cited by applicant]
Non-Final Office Action dated Oct. 11, 2023, from U.S. Appl. No. 17/516,480, 40 sheets. [cited by applicant]
Non-Final Office Action dated Apr. 25, 2024, from U.S. Appl. No. 17/739,926, 57 sheets. [cited by applicant]
International Search Report and Written Opinion mailed Sep. 15, 2017, from International Application No. PCT/CA2017/050642, 12 sheets. [cited by applicant]
Joseph Hector Dibiase, Thesis entitled, “A High-Accuracy, Low-Latency Technique for Talker Localization in Reverberant Environments Using Microphone Arrays”, Brown University, May 2000. [cited by applicant]
Notice of Allowance dated Apr. 30, 2018, from U.S. Appl. No. 15/597,646, 18 sheets. [cited by applicant]
International Search Report and Written Opinion mailed Jun. 7, 2023, from International Application No. PCT/CA2023/50412, 11 sheets. [cited by applicant]
Extended European Search Report mailed May 7, 2019, from European Patent Application No. 17805437.5, 23 sheets. [cited by applicant]
Notice of Allowance dated May 24, 2019, from U.S. Appl. No. 16/110,393, 6 sheets. [cited by applicant]
Non-Final Rejection dated Sep. 17, 2018, from U.S. Appl. No. 16/110,393, 14 sheets. [cited by applicant]
International Search Report and Written Opinion mailed Oct. 12, 2017, from International Application No. PCT/CA2017/050676, 8 sheets. [cited by applicant]
Notice of Allowance dated Apr. 2, 2019, from U.S. Appl. No. 15/603,986, 42 sheets. [cited by applicant]
Final Rejection dated May 25, 2018, from U.S. Appl. No. 15/603,986, 13 sheets. [cited by applicant]
Non-Final Rejection dated Jan. 24, 2018, from U.S. Appl. No. 15/603,986, 26 sheets. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Feb. 17, 2020, from European Patent Application No. 17805437.5, 6 sheets. [cited by applicant]
Notice of Allowance dated Jul. 16, 2020, from U.S. Appl. No. 16/518,013, 19 sheets. [cited by applicant]
Non-Final Rejection dated Feb. 28, 2020, from U.S. Appl. No. 16/518,013, 21 sheets. [cited by applicant]
Notice of Allowance dated Apr. 11, 2019, from U.S. Appl. No. 16/110,393, 18 sheets. [cited by applicant]
Notice of Allowance dated Jan. 19, 2018, from U.S. Appl. No. 15/597,646, 22 sheets. [cited by applicant]
Notice of Allowance dated Aug. 16, 2021, from U.S. Appl. No. 17/097,560, 33 sheets. [cited by applicant]
Extended European search report from European Application No. 20194651.4 with a mailing date of Jan. 21, 2021, 11 sheets. [cited by applicant]
Extended European search report from European Application No. 17847841.8 with a mailing date of Jun. 28, 2019, 12 sheets. [cited by applicant]
Communication pursuant to Rules 70(2) and 70a(2) EPC from European Application No. 17847841.8 with a mailing date of Jul. 16, 2019, 1 sheet. [cited by applicant]
U.S. Appl. No. 62/343,512, filed May 31, 2016, 41 sheets. [cited by applicant]
U.S. Appl. No. 62/162,091, filed May 15, 2015, 52 sheets. [cited by applicant]
U.S. Appl. No. 62/345,208, filed Jun. 3, 2016, 44 sheets. [cited by applicant]
Non-Final Rejection dated Feb. 9, 2021, from U.S. Appl. No. 16/434,725, 72 sheets. [cited by applicant]
Notice of Allowance dated Jan. 25, 2023, from U.S. Appl. No. 17/374,585, 11 sheets. [cited by applicant]
Notice of Allowance dated Jan. 19, 2023, from U.S. Appl. No. 17/374,585, 41 sheets. [cited by applicant]
Non-Final Rejection dated Aug. 8, 2022, from U.S. Appl. No. 17/374,585, 57 sheets. [cited by applicant]
The extended European search report completed Feb. 2, 2022 (dated Feb. 10, 2022), from European Application No. 19808293.5, 8 sheets. [cited by applicant]
Emanuël A. P. Habets and Jacob Benesty, “A Two-Stage Beamforming Approach for Noise Reduction and Dereverberation”, IEEE Transactions on Audio, Speeach, and Language Processing, vol. 21, No. 5, May 2013, pp. 945-958. [cited by applicant]
Gerhard Doblinger, “An Adaptive Microphone Array for Optimum Beamforming and Noise Reduction”, 14th European Signal Processing Conference (EUSIPCO 2006), Florence, Italy, Sep. 4-8, 2006, 5 sheets. [cited by applicant]
Taylor B. Spalt, Christopher R. Fuller, Thomas F. Brooks, William M. Humphreys, Jr., “A Background Noise Reduction Technique using Adaptive Noise Cancellation for Microphone Arrays”, p. 1-16, available at: https://ntrs.… [cited by applicant]
International Search Report and Written Opinion dated Oct. 3, 2019, from PCT/CA2019/050708, 9 sheets. [cited by applicant]
Notice of Allowance dated Feb. 10, 2023, from U.S. Appl. No. 16/421,908, 24 sheets. [cited by applicant]
Final Rejection dated Oct. 11, 2022, from U.S. Appl. No. 16/421,908, 26 sheets. [cited by applicant]
Non-Final Rejection dated Apr. 20, 2022, from U.S. Appl. No. 16/421,908, 38 sheets. [cited by applicant]
International Search Report and Written Opinion dated Jun. 15, 2023, from International Application No. PCT/CA2023/050371, 7 sheets. [cited by applicant]
International Search Report and Written Opinion dated May 30, 2023, from International Application No. PCT/CA2023/050277, 7 sheets. [cited by applicant]
The extended European search report dated Sep. 27, 2022, from European Patent Application No. 20749339.6, 15 sheets. [cited by applicant]
International Search Report and Written Opinion mailed May 22, 2020, from International Application No. PCT/CA2020/050100, 11 sheets. [cited by applicant]
Non-Final Rejection dated Dec. 10, 2020, from U.S. Appl. No. 16/774,258, 28 sheets. [cited by applicant]
Notice of Allowance dated Jul. 26, 2021, from U.S. Appl. No. 16/774,258, 21 sheets. [cited by applicant]
Lightspeed Technologies, “Audio Solutions for Classroom Reopening Challenges”, Duplicom Presentation Systems, https://www.duplicom.com/products/lightspeed-audio-solutions/, Aug. 27, 2020, 7 sheets. [cited by applicant]
Luis Guerra, Troy Jensen, “How to Use The Shure MXA910 Ceiling Array Microphone for Voice Lift”, Shure Incorporated, USA, Created Sep. 2016, upated Jul. 2018, Shure Incorporated, 11 sheets. [cited by applicant]
Alberta Infrastructure, “Sound-Field Systems Guide for Classrooms”, published in May 2004, 19 sheets. [cited by applicant]
The extended European Search Report dated Feb. 11, 2022, from European Patent Application No. 21204322.8, 7 sheets. [cited by applicant]
International Search and Written Opinion dated Jul. 18, 2022, from PCT/CA2022/050731, 8 sheets. [cited by applicant]