IP Library › Granted Patent US 12,379,491
Granted Patent B2
US 12,379,491 · App. 17/583,477 · Granted Aug 5, 2025

Multi-modal acoustic imaging tool

Inventor: Michael D. Stuart (Issaquah, WA)
Assignee: Fluke Corporation
G01S15/86G01H3/125G01S3/808G01S15/89G06T7/33H04N23/20G01J2005/0077G01J5/025G01J5/0265G06T2207/10024G06T2207/10048G06T2207/10132G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,379,491
App. No.
17/583,477
Granted
Aug 5, 2025
Kind
B2
Abstract

Systems and methods directed toward acoustic analysis can include a plurality of acoustic sensor arrays, each including a plurality of acoustic sensor elements, and a processor in communication with the plurality of acoustic sensor arrays. The processor can be configured to select one or more of the plurality of acoustic sensor arrays based on one or more input parameters, and generate acoustic image data representative of an acoustic scene based on received acoustic data from the selected one or more acoustic sensor arrays. Such input parameters can include distance information and/or frequency information. Different acoustic sensor arrays can share acoustic sensor elements in common or can be entirely separate from one another. Acoustic image data can be combined with electromagnetic image data from an electromagnetic imaging tool to generate a display image.

Claims (52)

1. An acoustic analysis system comprising:

a plurality of acoustic sensors configured to receive acoustic signals from an acoustic scene and output acoustic data based on the acoustic signals; and

a processor in communication with the plurality of acoustic sensors, wherein the processor is configured to:

receive input parameters that include:

distance information representative of a distance from the plurality of acoustic sensors to a target in the acoustic scene, and

frequency information representative of a frequency content of acoustic signals generated in the acoustic scene, wherein the frequency information is based on a frequency content of a previously-received acoustic signal or based on a desired or expected frequency content of an acoustic signal to be received from the acoustic scene;

select a subset of acoustic sensors from the plurality of acoustic sensors, wherein the subset of acoustic sensors is selected based on a combination of both the distance information and the frequency information;

receive acoustic data from the subset of acoustic sensors; and

generate acoustic image data representative of the acoustic scene based on the acoustic data received from the subset of acoustic sensors.

2. The acoustic analysis system of claim 1 , wherein the processor is configured to:

receive an acoustic signal from at least one acoustic sensor of the plurality of acoustic sensors; and

determine, from the acoustic signal, the frequency information representative of the frequency content of acoustic signals generated in the acoustic scene.

3. The acoustic analysis system of claim 1 , wherein the processor is configured to:

receive the frequency information, wherein the frequency information is representative of a desired or expected frequency range of the frequency content to be received from the acoustic scene.

4. The acoustic analysis system of claim 1 , wherein the input parameters further include a selection of acoustic sensors from the plurality of acoustic sensors, the selection being received from a user interface.

5. The acoustic analysis system of claim 1 , wherein the processor is configured to receive the distance information from a distance measuring tool that outputs distance information representative of the distance from the plurality of acoustic sensors to the target in the acoustic scene.

6. The acoustic analysis system of claim 1 , wherein the plurality of acoustic sensors includes a first set of acoustic sensors arranged in a first acoustic sensor array and a second set of acoustic sensors arranged in a second acoustic sensor array, and the second acoustic sensor array has at least one acoustic sensor in common with the first acoustic sensor array, and

wherein the processor is configured to select the subset of acoustic sensors from the first acoustic sensor array or the second acoustic sensor array based on the input parameters.

7. The acoustic analysis system of claim 6 , wherein the second set of acoustic sensors is a subset of the first set of acoustic sensors.

8. The acoustic analysis system of claim 6 , wherein one or more acoustic sensors in the second acoustic sensor array that are not in common with the first acoustic sensor array are nested within the first acoustic sensor array.

9. The acoustic analysis system of claim 1 , wherein the processor is configured to:

select a back-propagation calculation from a plurality of back-propagation calculations based on the distance information and the frequency information; and

generate the acoustic image data by performing the back-propagation calculation on the acoustic data received from the subset of acoustic sensors.

10. The acoustic analysis system of claim 1 , wherein the plurality of acoustic sensors includes a first set of acoustic sensors arranged in a first acoustic sensor array and a second set of acoustic sensors arranged in a second acoustic sensor array, and the first acoustic sensor array and the second acoustic sensor array do not have any acoustic sensors in common, and

wherein the processor is configured to select the subset of acoustic sensors from the first acoustic sensor array or the second acoustic sensor array based on the combination of both the distance information and the frequency information.

11. The acoustic analysis system of claim 10 , wherein the first set of acoustic sensors includes at least an acoustic sensor of a first type, and the second set of acoustic sensors includes at least an acoustic sensor of a second type that is different from the first type.

12. The acoustic analysis system of claim 10 , wherein the second set of acoustic sensors in the second acoustic sensor array are positioned between the acoustic scene and the first set of acoustic sensors in the first acoustic sensor array.

13. The acoustic analysis system of claim 1 , wherein the plurality of acoustic sensors includes a first set of acoustic sensors arranged in a first acoustic sensor array, a second set of acoustic sensors arranged in a second acoustic sensor array, and a third set of acoustic sensors arranged in a third acoustic sensor array, and wherein the processor is configured to select the subset of acoustic sensors from the first acoustic sensor array, the second acoustic sensor array, or the third acoustic sensor array based on the combination of both the distance information and the frequency information.

14. The acoustic analysis system of claim 13 , wherein the first acoustic sensor array is optimized for a first frequency range, the second acoustic sensor array is optimized for a second frequency range, and the third acoustic sensor array is optimized for a third frequency range.

15. A method for acoustic analysis, comprising:

receiving, by an acoustic imaging tool, input parameters that include:

distance information representative of a distance from a plurality of acoustic sensors of the acoustic imaging tool to a target in an acoustic scene, and

frequency information representative of a frequency content of acoustic signals generated in the acoustic scene, wherein the frequency information is based on a frequency content of a previously-received acoustic signal or based on a desired or expected frequency content of an acoustic signal to be received from the acoustic scene;

selecting a subset of acoustic sensors from the plurality of acoustic sensors, wherein the subset of acoustic sensors is selected based on a combination of both the distance information and the frequency information;

receiving acoustic data from the subset of acoustic sensors; and

generating acoustic image data representative of the acoustic scene based on the acoustic data received from the subset of acoustic sensors.

16. The method of claim 15 , further comprising selecting a back-propagation calculation from a plurality of back-propagation calculations based on the distance information, and generating the acoustic image data by performing the back-propagation calculation on the acoustic data received from the subset of acoustic sensors.

17. The method of claim 15 , wherein the plurality of acoustic sensors includes a first set of acoustic sensors arranged in a first acoustic sensor array and a second set of acoustic sensors arranged in a second acoustic sensor array, and

wherein the subset of acoustic sensors is selected from the first acoustic sensor array or the second acoustic sensor array based on the combination of both the distance information and the frequency information.

18. The method of claim 15 , further comprising:

receiving an acoustic signal from at least one acoustic sensor of the plurality of acoustic sensors; and

determining, from the acoustic signal, the frequency information representative of the frequency content of acoustic signals generated in the acoustic scene.

19. The method of claim 15 , wherein the frequency information received by the acoustic imaging tool is representative of a desired or expected frequency range of the frequency content to be received from the acoustic scene.

20. A handheld portable acoustic imaging tool comprising:

a plurality of acoustic sensors, wherein at least a first portion of the plurality of acoustic sensors is arranged in a first acoustic sensor array and a second portion of the plurality of acoustic sensors is arranged in a second acoustic sensor array; and

a processor in communication with the plurality of acoustic sensors, wherein the processor is configured to:

select at least one acoustic sensor array from the first acoustic sensor array or the second acoustic sensor array based on a combination of distance information and frequency information; and

generate acoustic image data representative of an acoustic scene based on acoustic data received from the at least one acoustic sensor array,

wherein the distance information is representative of a distance from the plurality of acoustic sensors to a target in the acoustic scene, and the frequency information is representative of a frequency content of acoustic signals generated in the acoustic scene, and

wherein the processor is configured to:

receive the distance information from a distance measuring tool, and

either receive the frequency information according to a desired or expected frequency content of an acoustic signal to be received from the acoustic scene, or determine the frequency information from an acoustic signal previously received from the acoustic scene.

Continuity (2)
Continuation 15802168 · Nov 2, 2017
Related Publication 20220146668A1 · May 12, 2022
References Cited (172)
US 3592534A · Duck et al. · 1971 [cited by applicant]
US 4662222A · Johnson · 1987 [cited by applicant]
US 5289838A · Odell · 1994 [cited by examiner]
US 6006175A · Holzrichter · 1999 [cited by applicant]
US 6198694B1 · Kroling · 2001 [cited by examiner]
US 6249075B1 · Bishop et al. · 2001 [cited by applicant]
US 7138576B2 · Metcalf · 2006 [cited by applicant]
US 7289633B2 · Metcalf · 2007 [cited by applicant]
US 7538326B2 · Johnson et al. · 2009 [cited by applicant]
US 8279112B2 · Carrick · 2012 [cited by applicant]
US 8376946B2 · Littrup et al. · 2013 [cited by applicant]
US 8446254B2 · Carrick et al. · 2013 [cited by applicant]
US 8520858B2 · Metcalf · 2013 [cited by applicant]
US 8638362B1 · Thompson et al. · 2014 [cited by applicant]
US 8701491B2 · Scholte et al. · 2014 [cited by applicant]
US 8784321B2 · Courtney et al. · 2014 [cited by applicant]
US 9084045B2 · Scholte · 2015 [cited by applicant]
US 9176990B2 · Stuart et al. · 2015 [cited by applicant]
US 9511842B2 · Longson et al. · 2016 [cited by applicant]
US 9520120B2 · Scholte et al. · 2016 [cited by applicant]
US 9568492B2 · Yuen · 2017 [cited by applicant]
US 9599632B2 · Yuen · 2017 [cited by applicant]
US 9706292B2 · Duraiswami et al. · 2017 [cited by applicant]
US 9729803B2 · Holliday · 2017 [cited by applicant]
US 9736580B2 · Cahill et al. · 2017 [cited by applicant]
US 10042038B1 · Lord · 2018 [cited by applicant]
US 10111013B2 · Hu · 2018 [cited by applicant]
US 10152811B2 · Johnson et al. · 2018 [cited by applicant]
US 10375325B2 · Schmidt · 2019 [cited by applicant]
US 10408933B1 · DeHart · 2019 [cited by examiner]
US 11099075B2 · Stuart · 2021 [cited by applicant]
US 11209306B2 · Stuart et al. · 2021 [cited by applicant]
US 11494158B2 · Reiger et al. · 2022 [cited by applicant]
US 20020069054A1 · Arrowood et al. · 2002 [cited by applicant]
US 20030089183A1 · Jacobsen et al. · 2003 [cited by applicant]
US 20030202423A1 · Clayton et al. · 2003 [cited by applicant]
US 20040021031A1 · Klaus · 2004 [cited by applicant]
US 20040120532A1 · Dedieu et al. · 2004 [cited by applicant]
US 20040160370A1 · Ghosh · 2004 [cited by examiner]
US 20040252587A1 · Melese et al. · 2004 [cited by applicant]
US 20060153391A1 · Hooley et al. · 2006 [cited by applicant]
US 20060159281A1 · Koh et al. · 2006 [cited by applicant]
US 20060289772A1 · Johnson et al. · 2006 [cited by applicant]
US 20070005348A1 · Klefenz · 2007 [cited by applicant]
US 20070189544A1 · Rosenberg · 2007 [cited by applicant]
US 20070195646A1 · Govindswamy et al. · 2007 [cited by applicant]
US 20080034869A1 · Heinz et al. · 2008 [cited by applicant]
US 20080074307A1 · Boric-Lubecke et al. · 2008 [cited by applicant]
US 20080146930A1 · Takeuchi · 2008 [cited by examiner]
US 20080265130A1 · Colomb · 2008 [cited by examiner]
US 20090058663A1 · Joshi et al. · 2009 [cited by applicant]
US 20090312819A1 · Klefenz et al. · 2009 [cited by applicant]
US 20100117885A1 · Holbrook et al. · 2010 [cited by applicant]
US 20100161255A1 · Mian · 2010 [cited by examiner]
US 20100272286A1 · Bai et al. · 2010 [cited by applicant]
US 20110019835A1 · Schmidt et al. · 2011 [cited by applicant]
US 20110098056A1 · Rhoads et al. · 2011 [cited by applicant]
US 20110120222A1 · Scholte et al. · 2011 [cited by applicant]
US 20110252888A1 · Goodman et al. · 2011 [cited by applicant]
US 20120051182A1 · Shin · 2012 [cited by applicant]
US 20120089396A1 · Patel et al. · 2012 [cited by applicant]
US 20120331143A1 · Niebergall et al. · 2012 [cited by applicant]
US 20130155248A1 · Neeley et al. · 2013 [cited by applicant]
US 20130155249A1 · Neeley et al. · 2013 [cited by applicant]
US 20130162835A1 · Forland et al. · 2013 [cited by applicant]
US 20130226593A1 · Magnusson et al. · 2013 [cited by applicant]
US 20130272548A1 · Visser et al. · 2013 [cited by applicant]
US 20140055785A1 · Silny · 2014 [cited by examiner]
US 20140071789A1 · Brodsky et al. · 2014 [cited by applicant]
US 20140119547A1 · Nobile · 2014 [cited by examiner]
US 20140177388A1 · D'Angelo · 2014 [cited by applicant]
US 20140192201A1 · Benoit · 2014 [cited by examiner]
US 20140241548A1 · Kim et al. · 2014 [cited by applicant]
US 20140267757A1 · Abramson et al. · 2014 [cited by applicant]
US 20140269163A1 · Proctor · 2014 [cited by examiner]
US 20140278385A1 · Fan · 2014 [cited by applicant]
US 20150015763A1 · Lee et al. · 2015 [cited by applicant]
US 20150117673A1 · Fenichel · 2015 [cited by applicant]
US 20150177403A1 · Haugen et al. · 2015 [cited by applicant]
US 20150230024A1 · Goshen et al. · 2015 [cited by applicant]
US 20150247999A1 · Ntziachristos et al. · 2015 [cited by applicant]
US 20150293214A1 · Cannon et al. · 2015 [cited by applicant]
US 20150296413A1 · Sadek · 2015 [cited by examiner]
US 20150317565A1 · Li · 2015 [cited by examiner]
US 20150371096A1 · Stein et al. · 2015 [cited by applicant]
US 20160025993A1 · Mor et al. · 2016 [cited by applicant]
US 20160037244A1 · Yamanaka et al. · 2016 [cited by applicant]
US 20160073087A1 · Davis et al. · 2016 [cited by applicant]
US 20160076937A1 · Stuart et al. · 2016 [cited by applicant]
US 20160142830A1 · Hu · 2016 [cited by applicant]
US 20160165341A1 · Benattar · 2016 [cited by applicant]
US 20160277863A1 · Cahill et al. · 2016 [cited by applicant]
US 20160291146A1 · Wang · 2016 [cited by examiner]
US 20160330545A1 · McElveen et al. · 2016 [cited by applicant]
US 20160345115A1 · Paik · 2016 [cited by applicant]
US 20160364960A1 · Cheatham, III et al. · 2016 [cited by applicant]
US 20170010359A1 · Jung · 2017 [cited by applicant]
US 20170061981A1 · Nakadai et al. · 2017 [cited by applicant]
US 20170178392A1 · Zuccarino et al. · 2017 [cited by applicant]
US 20170225033A1 · Czaja · 2017 [cited by applicant]
US 20170243367A1 · Lee et al. · 2017 [cited by applicant]
US 20170281982A1 · Zhu · 2017 [cited by examiner]
US 20180190260A1 · Christoph · 2018 [cited by applicant]
US 20180199137A1 · Mate et al. · 2018 [cited by applicant]
US 20180317826A1 · Muhsin et al. · 2018 [cited by applicant]
US 20190128730A1 · Stuart et al. · 2019 [cited by applicant]
US 20190128739A1 · Stuart · 2019 [cited by applicant]
US 20190129027A1 · Stuart · 2019 [cited by applicant]
US 20190231220A1 · Refai et al. · 2019 [cited by applicant]
US 20190261108A1 · Saksela et al. · 2019 [cited by applicant]
US 20200195906A1 · Van Hoff et al. · 2020 [cited by applicant]
US 20210152969A1 · Vilkamo et al. · 2021 [cited by applicant]
US 20210293953A1 · Stuart et al. · 2021 [cited by applicant]
US 20210310856A1 · Stuart et al. · 2021 [cited by applicant]
US 20210310857A1 · Stuart et al. · 2021 [cited by applicant]
US 20210311187A1 · Stuart et al. · 2021 [cited by applicant]
US 20210311188A1 · Stuart et al. · 2021 [cited by applicant]
US 20240118416A1 · Stuart et al. · 2024 [cited by applicant]
CN 101111748A · 2008 [cited by applicant]
CN 101290347A · 2008 [cited by applicant]
CN 102879080A · 2013 [cited by applicant]
CN 205067744U · 2016 [cited by applicant]
CN 105474667A · 2016 [cited by applicant]
CN 107223332A · 2017 [cited by applicant]
DE 19844870A1 · 2000 [cited by applicant]
DE 102016215522A1 · 2018 [cited by applicant]
EP 1636404A · 2008 [cited by applicant]
EP 24693323A1 · 2012 [cited by applicant]
FR 3018023A1 · 2015 [cited by applicant]
JP H09304055A · 1997 [cited by applicant]
JP 2000075014A · 2000 [cited by applicant]
JP 2002181913A · 2002 [cited by applicant]
JP 2004028980A · 2004 [cited by applicant]
JP 2004077277A · 2004 [cited by applicant]
JP 2006516373A · 2006 [cited by applicant]
JP 2006308409A · 2006 [cited by applicant]
JP 2007225590A · 2007 [cited by applicant]
JP 2009210491A · 2009 [cited by applicant]
JP 2010206419A · 2010 [cited by applicant]
JP 2011015050A · 2011 [cited by applicant]
JP 2011163776A · 2011 [cited by applicant]
JP 2012021969A · 2012 [cited by applicant]
JP 4892177B2 · 2012 [cited by applicant]
JP 2012150059A · 2012 [cited by applicant]
JP 2013250111A · 2013 [cited by applicant]
JP 2014137323A · 2014 [cited by applicant]
JP 2015078845A · 2015 [cited by applicant]
JP 2015152316A · 2015 [cited by applicant]
JP 2016046705A · 2016 [cited by applicant]
JP 2016515698A · 2016 [cited by applicant]
JP 5939341B1 · 2016 [cited by applicant]
JP 2017092732A · 2017 [cited by applicant]
JP 2017519967A · 2017 [cited by applicant]
JP 2017530580A · 2017 [cited by applicant]
JP 2017207399A · 2017 [cited by applicant]
JP 2018500075A · 2018 [cited by applicant]
JP 2018077837A · 2018 [cited by applicant]
KR 101204499B1 · 2012 [cited by applicant]
NL 9201787A · 1994 [cited by applicant]
WO 03011139A1 · 2003 [cited by applicant]
WO WO2004021031A1 · 2004 [cited by applicant]
WO 2006060746A1 · 2006 [cited by applicant]
WO WO2009130243A2 · 2009 [cited by applicant]
WO 2016148825A1 · 2016 [cited by applicant]
WO 2018055232A1 · 2018 [cited by applicant]
WO WO2020023622A1 · 2020 [cited by applicant]
English Abstract and Machine Translation for Chinese Publication No. CN101290347A, published Oct. 22, 2008, 9 pages. [cited by applicant]
European Patent Application No. 18204005.5, Extended European Search Report mailed Jul. 18, 2019, 19 pages. [cited by applicant]
European Patent Application No. 18204005.5, Partial European Search Report mailed Mar. 21, 2019, 18 pages. [cited by applicant]
Stuart et al., U.S. Appl. No. 62/702,716, “Acoustic Imaging Systems and Methods,” filed Jul. 24, 2018, 199 pages. [cited by applicant]
Teo et al., “Multifrequency Holography Using Backpropogation,” Ultrasonic Imaging, vol. 8, No. 3, Jul. 1986, pp. 213-224, Abstract Only. [cited by applicant]
Lanslots, J. et al., “Selecting Sound Source Localization Techniques for Industrial Applications”, Sound & Vibration, www.SandV.com, Jun. 2010, 5 pgs. [cited by applicant]