IP Library Granted Patent US 12,372,646
Granted Patent B2
US 12,372,646 · App. 18/468,530 · Granted Jul 29, 2025

Systems and methods for representing acoustic signatures from a target scene

Inventors: Michael D. Stuart (Issaquah, WA); Henk Koppelmans (Uden, NL); Dileepa Prabhakar (Edmonds, WA); Scott M. Tsukamaki (Bothell, WA); Darwin C. Witt (Seattle, WA)
Assignee: Fluke Corporation
G01S15/8977G01C3/02G01C21/16G01H3/125G01S3/808G01S3/8086G01S7/56G01S15/86G01S15/89G01S17/86G01S19/01G06T7/70G06T11/00H04N23/95H04R29/008H04S7/301H04S7/40G06T2207/10012H04R2430/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,372,646
App. No.
18/468,530
Granted
Jul 29, 2025
Kind
B2
Abstract

Acoustic imaging systems can include an acoustic sensing array, an electromagnetic imaging tool, a display, and an audio device. A processor can receive data from the acoustic sensor array and the electromagnetic imaging tool to generate a display image combining acoustic image data and electromagnetic image data. Systems can include an audio device that receives an audio output from the processor and outputs audio feedback signals to a user. The audio feedback signals can represent acoustic signals from an acoustic scene. Systems can provide a display image to a user including acoustic image data, and a user can select an acoustic signal for which to provide a corresponding audio output to an audio device. Audio outputs and display images can change dynamically in response to a change in pointing of the acoustic sensing array, such as by changing a stereo audio output.

Claims (43)

1. An acoustic analysis system, comprising:

an acoustic sensor array comprising a plurality of acoustic sensor elements configured to receive an acoustic signal from a scene and output acoustic data based on the acoustic signal; and

one or more processors configured to:

generate, based on the acoustic data, a visual output to visually indicate a spatial location in the scene;

generate an audio output based at least on a part of the acoustic data associated with the spatial location, wherein the audio output is an audible reproduction of sound in the acoustic signal received from the spatial location in the scene; and

produce an audiovisual output including both the visual output and the audio output.

2. The acoustic analysis system of claim 1 , wherein the audio output is generated with a periodicity that is representative of a periodicity of the sound in the acoustic signal.

3. The acoustic analysis system of claim 1 , wherein, in the audiovisual output, the visual output and the audio output are synchronized.

4. The acoustic analysis system of claim 1 , wherein a frequency or intensity of the audio output is normalized according to an audible frequency range or level of magnitude for a user.

5. The acoustic analysis system of claim 1 , wherein the acoustic sensor array is configured to receive the acoustic signal in a broadband frequency range, and the audio output is generated based at least on a part of the acoustic data in the broadband frequency range.

6. The acoustic analysis system of claim 1 , wherein the acoustic sensor array is configured to receive the acoustic signal in a broadband frequency range, and the audio output is generated based at least on a part of the acoustic data that is filtered according to a frequency range.

7. The acoustic analysis system of claim 1 , wherein the audiovisual output indicates a severity of the acoustic signal.

8. The acoustic analysis system of claim 1 , wherein the one or more processors are configured to receive a user selection of the spatial location, and the audio output is generated based at least on a part of the acoustic data associated with the user-selected spatial location.

9. The acoustic analysis system of claim 1 , wherein:

the visual output visually indicates multiple spatial locations in the scene; and

the one or more processors are configured to generate the audio output based at least on a part of the acoustic data associated with a selected spatial location of the multiple spatial locations.

10. The acoustic analysis system of claim 9 , wherein the one or more processors are configured to generate the audio output in response to a user selection of the selected spatial location.

11. The acoustic analysis system of claim 9 , wherein the visual output visually indicates the multiple spatial locations using graphics that change according to a selection of the selected spatial location.

12. The acoustic analysis system of claim 1 , wherein the one or more processors are further configured to:

generate an indicator in the audiovisual output to guide a user to select an acoustic signal at the spatial location in the scene based on:

(a) one or more acoustic parameters of the acoustic signal that are represented by the indicator, and

(b) the indicator being positioned in the audiovisual output at the spatial location in the scene; and

generate the audio output of the acoustic signal based on a user selection of the indicator.

13. The acoustic analysis system of claim 12 , wherein the one or more acoustic parameters that are represented by the indicator include a signal frequency of the acoustic signal, and the audio output is generated using a filter having a frequency range that includes the signal frequency.

14. An acoustic analysis system, comprising:

an acoustic sensor array comprising a plurality of acoustic sensor elements configured to receive an acoustic signal from a scene and output acoustic data based on the acoustic signal; and

one or more processors configured to:

generate, based on the acoustic data, a visual output to visually indicate a spatial location in the scene;

generate an audio output based at least on a part of the acoustic data associated with the spatial location; and

produce an audiovisual output including both the visual output and the audio output,

wherein the audiovisual output has a characteristic that dynamically changes depending on a pointing of the acoustic sensor array relative to a detected source of the acoustic signal.

15. The acoustic analysis system of claim 14 , wherein the characteristic that dynamically changes is a magnitude of the audio output.

16. The acoustic analysis system of claim 14 , wherein the characteristic that dynamically changes is transparency of the visual output.

17. An acoustic analysis system, comprising:

a plurality of acoustic sensor elements configured to output acoustic data based on acoustic signals received from a scene; and

one or more processors configured to:

generate, based on the acoustic data, a visual output that visually indicates one or more spatial locations of one or more acoustic signals in the scene;

generate an audio output based at least on a part of the acoustic data associated with a spatial location of the one or more spatial locations, wherein the audio output includes a first audio output and a second audio output that are each generated based on the spatial location of the one or more spatial locations; and

produce an audiovisual output including both the visual output and the audio output,

wherein when the spatial location is within a first area of the visual output, the first audio output has a greater magnitude than the second audio output, and when the spatial location is within a second area of the visual output, the second audio output has a greater magnitude than the first audio output.

18. The acoustic analysis system of claim 17 , wherein when the spatial location is within the first area of the visual output, the audio output includes only the first audio output, and when the spatial location is within the second area of the visual output, the audio output includes only the second audio output.

19. The acoustic analysis system of claim 17 , wherein the first area and/or the second area of the visual output is further divided into two or more subareas in which the magnitude of the first audio output and/or the second audio output varies according to the spatial location in the two or more subareas.

20. The acoustic analysis system of claim 17 , wherein when the spatial location is proximate to an outer edge of the visual output, the audio output includes only the first audio output or the second audio output, and when the spatial location is closer to a center of the visual output, the audio output includes both the first and second audio outputs.

Continuity (3)
Continuation 17262502
Provisional Application 62702716 · Jul 24, 2018
Related Publication 20240118416A1 · Apr 11, 2024
References Cited (174)
US 3592534A · Duck et al. · 1971 [cited by applicant]
US 4662222A · Johnson · 1987 [cited by applicant]
US 5289838A · Odell · 1994 [cited by applicant]
US 6006175A · Holzrichter · 1999 [cited by applicant]
US 6198694B1 · Kröling et al. · 2001 [cited by applicant]
US 6249075B1 · Bishop et al. · 2001 [cited by applicant]
US 7138576B2 · Metcalf · 2006 [cited by applicant]
US 7289633B2 · Metcalf · 2007 [cited by applicant]
US 7538326B2 · Johnson et al. · 2009 [cited by applicant]
US 8279112B2 · Carrick · 2012 [cited by applicant]
US 8376946B2 · Littrup et al. · 2013 [cited by applicant]
US 8446254B2 · Carrick et al. · 2013 [cited by applicant]
US 8520858B2 · Metcalf · 2013 [cited by applicant]
US 8638362B1 · Thompson et al. · 2014 [cited by applicant]
US 8701491B2 · Scholte et al. · 2014 [cited by applicant]
US 8784321B2 · Courtney et al. · 2014 [cited by applicant]
US 9084045B2 · Scholte · 2015 [cited by applicant]
US 9176990B2 · Stuart et al. · 2015 [cited by applicant]
US 9511842B2 · Longson et al. · 2016 [cited by applicant]
US 9520120B2 · Scholte et al. · 2016 [cited by applicant]
US 9568492B2 · Yuen · 2017 [cited by applicant]
US 9599632B2 · Yuen · 2017 [cited by applicant]
US 9706292B2 · Duraiswami et al. · 2017 [cited by applicant]
US 9729803B2 · Holliday · 2017 [cited by applicant]
US 9736580B2 · Cahill et al. · 2017 [cited by applicant]
US 10042038B1 · Lord · 2018 [cited by applicant]
US 10111013B2 · Hu · 2018 [cited by applicant]
US 10152811B2 · Johnson et al. · 2018 [cited by applicant]
US 10375325B2 · Schmidt · 2019 [cited by applicant]
US 10408933B1 · DeHart et al. · 2019 [cited by applicant]
US 11099075B2 · Stuart · 2021 [cited by applicant]
US 11209306B2 · Stuart et al. · 2021 [cited by applicant]
US 11494158B2 · Reiger et al. · 2022 [cited by applicant]
US 20020069054A1 · Arrowood et al. · 2002 [cited by applicant]
US 20030089183A1 · Jacobsen et al. · 2003 [cited by applicant]
US 20030202423A1 · Clayton et al. · 2003 [cited by applicant]
US 20040021031A1 · Klaus · 2004 [cited by applicant]
US 20040120532A1 · Dedieu et al. · 2004 [cited by applicant]
US 20040160370A1 · Ghosh et al. · 2004 [cited by applicant]
US 20040252587A1 · Melese et al. · 2004 [cited by applicant]
US 20060153391A1 · Hooley et al. · 2006 [cited by applicant]
US 20060159281A1 · Koh et al. · 2006 [cited by applicant]
US 20060289772A1 · Johnson et al. · 2006 [cited by applicant]
US 20070005348A1 · Klefenz · 2007 [cited by applicant]
US 20070189544A1 · Rosenberg · 2007 [cited by applicant]
US 20070195646A1 · Govindswamy et al. · 2007 [cited by applicant]
US 20080034869A1 · Heinz et al. · 2008 [cited by applicant]
US 20080074307A1 · Boric-Lubecke et al. · 2008 [cited by applicant]
US 20080146930A1 · Takeuchi · 2008 [cited by applicant]
US 20080265130A1 · Colomb et al. · 2008 [cited by applicant]
US 20090058663A1 · Joshi et al. · 2009 [cited by applicant]
US 20090312819A1 · Klefenz et al. · 2009 [cited by applicant]
US 20100117885A1 · Holbrook et al. · 2010 [cited by applicant]
US 20100161255A1 · Mian et al. · 2010 [cited by applicant]
US 20100272286A1 · Bai et al. · 2010 [cited by applicant]
US 20110019835A1 · Schmidt et al. · 2011 [cited by applicant]
US 20110098056A1 · Rhoads et al. · 2011 [cited by applicant]
US 20110120222A1 · Scholte et al. · 2011 [cited by applicant]
US 20110252888A1 · Goodman et al. · 2011 [cited by applicant]
US 20120051182A1 · Shin · 2012 [cited by applicant]
US 20120089396A1 · Patel et al. · 2012 [cited by applicant]
US 20120331143A1 · Niebergall et al. · 2012 [cited by applicant]
US 20130155248A1 · Neeley et al. · 2013 [cited by applicant]
US 20130155249A1 · Neeley et al. · 2013 [cited by applicant]
US 20130162835A1 · Forland et al. · 2013 [cited by applicant]
US 20130226593A1 · Magnusson et al. · 2013 [cited by applicant]
US 20130272548A1 · Visser et al. · 2013 [cited by applicant]
US 20140071789A1 · Brodsky et al. · 2014 [cited by applicant]
US 20140119547A1 · Nobile et al. · 2014 [cited by applicant]
US 20140177388A1 · D'Angelo · 2014 [cited by applicant]
US 20140192201A1 · Benoit et al. · 2014 [cited by applicant]
US 20140241548A1 · Kim et al. · 2014 [cited by applicant]
US 20140267757A1 · Abramson et al. · 2014 [cited by applicant]
US 20140269163A1 · Proctor · 2014 [cited by applicant]
US 20140278385A1 · Fan · 2014 [cited by applicant]
US 20150015763A1 · Lee et al. · 2015 [cited by applicant]
US 20150117673A1 · Fenichel · 2015 [cited by applicant]
US 20150177403A1 · Haugen et al. · 2015 [cited by applicant]
US 20150230024A1 · Goshen et al. · 2015 [cited by applicant]
US 20150247999A1 · Ntziachristos · 2015 [cited by examiner]
US 20150293214A1 · Cannon et al. · 2015 [cited by applicant]
US 20150296413A1 · Sadek et al. · 2015 [cited by applicant]
US 20150317565A1 · Li et al. · 2015 [cited by applicant]
US 20150371096A1 · Stein et al. · 2015 [cited by applicant]
US 20160025993A1 · Mor et al. · 2016 [cited by applicant]
US 20160037244A1 · Yamanaka et al. · 2016 [cited by applicant]
US 20160073087A1 · Davis et al. · 2016 [cited by applicant]
US 20160076937A1 · Stuart et al. · 2016 [cited by applicant]
US 20160142830A1 · Hu · 2016 [cited by applicant]
US 20160165341A1 · Benattar · 2016 [cited by applicant]
US 20160277863A1 · Cahill et al. · 2016 [cited by applicant]
US 20160330545A1 · McElveen et al. · 2016 [cited by applicant]
US 20160345115A1 · Paik · 2016 [cited by applicant]
US 20160364960A1 · Cheatham, III et al. · 2016 [cited by applicant]
US 20170010359A1 · Jung · 2017 [cited by applicant]
US 20170061663A1 · Johnson et al. · 2017 [cited by applicant]
US 20170061981A1 · Nakadai et al. · 2017 [cited by applicant]
US 20170178392A1 · Zuccarino et al. · 2017 [cited by applicant]
US 20170225033A1 · Czaja · 2017 [cited by applicant]
US 20170243367A1 · Lee et al. · 2017 [cited by applicant]
US 20170281982A1 · Zhu et al. · 2017 [cited by applicant]
US 20170374296A1 · Schmidt · 2017 [cited by applicant]
US 20180190260A1 · Christoph · 2018 [cited by applicant]
US 20180199137A1 · Mate et al. · 2018 [cited by applicant]
US 20180317826A1 · Muhsin et al. · 2018 [cited by applicant]
US 20190128730A1 · Stuart et al. · 2019 [cited by applicant]
US 20190128739A1 · Stuart · 2019 [cited by applicant]
US 20190129027A1 · Stuart · 2019 [cited by applicant]
US 20190231220A1 · Refai et al. · 2019 [cited by applicant]
US 20190261108A1 · Saksela et al. · 2019 [cited by applicant]
US 20200195906A1 · Van Hoff et al. · 2020 [cited by applicant]
US 20210152969A1 · Vilkamo et al. · 2021 [cited by applicant]
US 20210293953A1 · Stuart et al. · 2021 [cited by applicant]
US 20210310856A1 · Stuart et al. · 2021 [cited by applicant]
US 20210310857A1 · Stuart et al. · 2021 [cited by applicant]
US 20210311187A1 · Stuart et al. · 2021 [cited by applicant]
US 20210311188A1 · Stuart et al. · 2021 [cited by applicant]
US 20220146668A1 · Stuart · 2022 [cited by applicant]
US 20240118416A1 · Stuart et al. · 2024 [cited by applicant]
CN 101111748A · 2008 [cited by applicant]
CN 101290347A · 2008 [cited by applicant]
CN 102879080A · 2013 [cited by applicant]
CN 205067744U · 2016 [cited by applicant]
CN 105474667A · 2016 [cited by applicant]
CN 107223332A · 2017 [cited by applicant]
DE 19844870A1 · 2000 [cited by applicant]
DE 102016215522A1 · 2018 [cited by applicant]
EP 1636404A1 · 2006 [cited by applicant]
EP 2469323A1 · 2012 [cited by applicant]
FR 3018023A1 · 2015 [cited by applicant]
JP H09304055A · 1997 [cited by applicant]
JP 2000075014A · 2000 [cited by applicant]
JP 2002181913A · 2002 [cited by applicant]
JP 2004028980A · 2004 [cited by applicant]
JP 2004077277A · 2004 [cited by applicant]
JP 2006516373A · 2006 [cited by applicant]
JP 2006308409A · 2006 [cited by applicant]
JP 2007225590A · 2007 [cited by applicant]
JP 2009210491A · 2009 [cited by applicant]
JP 2010206419A · 2010 [cited by applicant]
JP 2011015050A · 2011 [cited by applicant]
JP 2011163776A · 2011 [cited by applicant]
JP 2012021969A · 2012 [cited by applicant]
JP 4892177B2 · 2012 [cited by applicant]
JP 2012150059A · 2012 [cited by applicant]
JP 2013250111A · 2013 [cited by applicant]
JP 2014137323A · 2014 [cited by applicant]
JP 2015078845A · 2015 [cited by applicant]
JP 2015152316A · 2015 [cited by applicant]
JP 2016046705A · 2016 [cited by applicant]
JP 2016515698A · 2016 [cited by applicant]
JP 5939341B1 · 2016 [cited by applicant]
JP 2017092732A · 2017 [cited by applicant]
JP 2017519967A · 2017 [cited by applicant]
JP 2017530580A · 2017 [cited by applicant]
JP 2017207399A · 2017 [cited by applicant]
JP 2018500075A · 2018 [cited by applicant]
JP 2018077837A · 2018 [cited by applicant]
KR 101204499B1 · 2012 [cited by applicant]
NL 9201787A · 1994 [cited by applicant]
WO WO03011139A1 · 2003 [cited by applicant]
WO WO2004021031A1 · 2004 [cited by applicant]
WO WO2006060746A2 · 2006 [cited by applicant]
WO WO2009130243A2 · 2009 [cited by applicant]
WO WO2016148825A1 · 2016 [cited by applicant]
WO WO2018055232A1 · 2018 [cited by applicant]
WO WO2020023622A1 · 2020 [cited by applicant]
English Abstract and Machine Translation for Chinese Publication No. CN101290347A, published Oct. 22, 2008, 9pgs. [cited by applicant]
European Patent Application No. 18203998.2, Extended European Search Report mailed Mar. 28, 2019, 8 pages. [cited by applicant]
European Patent Application No. 18204004.8, Extended European Search Report mailed Mar. 22, 2019, 11 pages. [cited by applicant]
European Patent Application No. 18204005.5, Extended European Search Report mailed Jul. 18, 2019, 19 pages. [cited by applicant]
European Patent Application No. 18204005.5, Partial European Search Report mailed Mar. 21, 2019, 18 pages. [cited by applicant]
Lanslots, J. et al., “Selecting Sound Source Localization Techniques for Industrial Applications”, Sound & Vibration, www.SandV.com, Jun. 2010, 5 pgs. [cited by applicant]
Teo et al., “Multifrequency Holography Using Backpropogation,” Ultrasonic Imaging, vol. 8, No. 3, Jul. 1986, pp. 213-224, Abstract Only. [cited by applicant]