IP Library › Granted Patent US 12,262,193
Granted Patent B2
US 12,262,193 · App. 17/719,285 · Granted Mar 25, 2025

Audio source spatialization relative to orientation sensor and output

Inventor: Benjamin D. Benattar (Cranbury, NJ)
Assignee: STAGES LLC
H04S7/303H04R1/406H04R3/005H04R5/027H04R5/033H04R2201/401H04R2430/20H04S7/304H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,193
App. No.
17/719,285
Granted
Mar 25, 2025
Kind
B2
Abstract

An audio customization system operates to enhance a user's audio environment. A user may wear headphones and specify what portion the ambient audio and/or source audio will be transmitted to the headphones or the personal speaker system. The audio signal may be enhanced by application of a spatialized transformation using a spatialization engine such as head-related transfer functions so that at least a portion of the audio presented to the personal speaker system will appear to originate from a particular direction. The direction may be modified in response to movement of the personal speaker system.

Claims (11)

1. An audio spatialization system comprising:

a directional cue reporting unit having an output signal representative of a position of an audio source;

a listener position orientation unit having a first input connected to a signal corresponding to a user position and orientation and a second input connected said directional cue reporting unit output signal representative of an audio source wherein said listener position orientation unit combines said first input with said second input and generates an output signal representing an intended audio signal direction of arrival of said audio signal relative to said user position and orientation;

an audio spatialization engine having a first input connected to an audio signal corresponding to said audio source and a second input connected to said output signal representing an intended direction of arrival of said audio signal relative to said user position and orientation and wherein said audio spatialization engine generates a spatialized audio output.

2. The audio spatialization system according to claim 1 wherein said directional cue reporting unit further comprises a location processor connected to a beamforming unit; a beam steering unit and a directionally discriminating acoustic sensor associated with a personal speaker system.

3. The audio spatialization system according to claim 2 wherein said directionally discriminating acoustic sensor is a microphone array.

4. The audio spatialization system according to claim 3 wherein said audio spatialization engine applies head related transfer functions to said audio signal.

5. The audio spatialization system according to claim 1 wherein said audio signal is a generated audio signal.

6. The audio spatialization system according to claim 1 wherein said audio signal to said audio spatialization engine is derived from ambient audio detected by an audio sensor.

7. The audio spatialization system according to claim 1 wherein said listener position and orientation unit updates said output representing an intended direction of arrival of said audio signal relative to said user position and orientation.

8. The audio spatialization system according to claim 1 wherein said audio spatialization engine is connected to an augmented reality game.

Continuity (3)
Continuation 15946647 · Apr 5, 2018
Continuation 15355766 · Nov 18, 2016
Related Publication 20220240045A1 · Jul 28, 2022
References Cited (162)
US 3806919A · Comey · 1974 [cited by applicant]
US 4776044A · Makins · 1988 [cited by applicant]
US 5432858A · Clair, Jr. et al. · 1995 [cited by applicant]
US 5581620A · Brandstein et al. · 1996 [cited by applicant]
US 5619582A · Oltman et al. · 1997 [cited by applicant]
US 5638343A · Ticknor · 1997 [cited by applicant]
US 5668884A · Clair, Jr. et al. · 1997 [cited by applicant]
US 5737431A · Brandstein et al. · 1998 [cited by applicant]
US 5778082A · Chu et al. · 1998 [cited by applicant]
US 5822440A · Oltman et al. · 1998 [cited by applicant]
US 6259795B1 · McGrath · 2001 [cited by examiner]
US 6462808B2 · Paritsky et al. · 2002 [cited by applicant]
US RE38405E · Clair, Jr. et al. · 2004 [cited by applicant]
US 6959075B2 · Cutaia et al. · 2005 [cited by applicant]
US 7110552B1 · Saliterman · 2006 [cited by applicant]
US D552077S · Brunner et al. · 2007 [cited by applicant]
US 7349547B1 · Isvan · 2008 [cited by applicant]
US 7415117B2 · Tashev et al. · 2008 [cited by applicant]
US 7475434B2 · Ambuske et al. · 2009 [cited by applicant]
US 7492907B2 · Klayman et al. · 2009 [cited by applicant]
US 7583808B2 · Smaragdis et al. · 2009 [cited by applicant]
US 7620409B2 · Budampati et al. · 2009 [cited by applicant]
US 7631305B2 · Rong et al. · 2009 [cited by applicant]
US 7817805B1 · Griffin · 2010 [cited by applicant]
US 7848512B2 · Eldracher · 2010 [cited by applicant]
US 7970150B2 · Oxford · 2011 [cited by applicant]
US D641725S · Chong et al. · 2011 [cited by applicant]
US 7995770B1 · Simon · 2011 [cited by applicant]
US 8064607B2 · Monceaux et al. · 2011 [cited by applicant]
US 8150054B2 · Andrea et al. · 2012 [cited by applicant]
US 8155346B2 · Yoshizawa et al. · 2012 [cited by applicant]
US 8160265B2 · Mao et al. · 2012 [cited by applicant]
US 8194873B2 · Pan et al. · 2012 [cited by applicant]
US 8290174B1 · Simon · 2012 [cited by applicant]
US 8379874B1 · Simon · 2013 [cited by applicant]
US 8483396B2 · Amadu et al. · 2013 [cited by applicant]
US 8521316B2 · Louboutin · 2013 [cited by applicant]
US 8542843B2 · Andrea et al. · 2013 [cited by applicant]
US 8566887B2 · Hasek et al. · 2013 [cited by applicant]
US 8577053B1 · Simon · 2013 [cited by applicant]
US 8612187B2 · Amadu · 2013 [cited by applicant]
US 8768496B2 · Katz et al. · 2014 [cited by applicant]
US 8873767B2 · Regler · 2014 [cited by applicant]
US 8917506B2 · Diebel et al. · 2014 [cited by applicant]
US 8934635B2 · Esnault et al. · 2015 [cited by applicant]
US 8949958B1 · Dixon · 2015 [cited by applicant]
US 9087506B1 · Kraft et al. · 2015 [cited by applicant]
US 9111529B2 · Amadu et al. · 2015 [cited by applicant]
US 9112464B2 · Amadu et al. · 2015 [cited by applicant]
US 9113264B2 · Frater · 2015 [cited by applicant]
US 9131308B2 · Kraft et al. · 2015 [cited by applicant]
US 9226088B2 · Pandey et al. · 2015 [cited by applicant]
US 9271103B2 · Wells · 2016 [cited by applicant]
US 9538289B2 · Karkkainen · 2017 [cited by examiner]
US 9761055B2 · Miller · 2017 [cited by examiner]
US 10089063B2 · Shivappa et al. · 2018 [cited by applicant]
US 10257637B2 · Di Censo · 2019 [cited by examiner]
US 10645518B2 · Eronen · 2020 [cited by examiner]
US 10979843B2 · Thagadur Shivappa · 2021 [cited by examiner]
US 11120818B2 · Magnusson · 2021 [cited by examiner]
US 20020122137A1 · Chen et al. · 2002 [cited by applicant]
US 20030161485A1 · Smith · 2003 [cited by applicant]
US 20050004985A1 · Stochosky · 2005 [cited by applicant]
US 20060056638A1 · Schobben · 2006 [cited by applicant]
US 20070030986A1 · McArthur et al. · 2007 [cited by applicant]
US 20080174665A1 · Enstad et al. · 2008 [cited by applicant]
US 20090010443A1 · Ahnert et al. · 2009 [cited by applicant]
US 20100034396A1 · Wollmershauser et al. · 2010 [cited by applicant]
US 20100141153A1 · Recker et al. · 2010 [cited by applicant]
US 20100239105A1 · Pan · 2010 [cited by applicant]
US 20100290636A1 · Mao et al. · 2010 [cited by applicant]
US 20110025912A1 · Regler · 2011 [cited by applicant]
US 20110081024A1 · Soulodre · 2011 [cited by applicant]
US 20120020502A1 · Adams · 2012 [cited by applicant]
US 20120087507A1 · Meyer · 2012 [cited by applicant]
US 20120224715A1 · Kikkeri · 2012 [cited by applicant]
US 20120259628A1 · Siotis · 2012 [cited by applicant]
US 20120270231A1 · Smith et al. · 2012 [cited by applicant]
US 20120330653A1 · Lissek et al. · 2012 [cited by applicant]
US 20130121505A1 · Duraiswami et al. · 2013 [cited by applicant]
US 20130305297A1 · Jabara et al. · 2013 [cited by applicant]
US 20140044275A1 · Goldstein et al. · 2014 [cited by applicant]
US 20140093093A1 · Dusan et al. · 2014 [cited by applicant]
US 20140157325A1 · Jabara et al. · 2014 [cited by applicant]
US 20140184386A1 · Regler et al. · 2014 [cited by applicant]
US 20140200054A1 · Fraden · 2014 [cited by applicant]
US 20140233181A1 · Harms et al. · 2014 [cited by applicant]
US 20140270200A1 · Usher et al. · 2014 [cited by applicant]
US 20140270231A1 · Dusan et al. · 2014 [cited by applicant]
US 20140301568A1 · Amadu et al. · 2014 [cited by applicant]
US 20140359444A1 · Greenberg-Sanders et al. · 2014 [cited by applicant]
US 20150054913A1 · Annau et al. · 2015 [cited by applicant]
US 20150055937A1 · Van Hoff et al. · 2015 [cited by applicant]
US 20150058102A1 · Christensen et al. · 2015 [cited by applicant]
US 20150095026A1 · Bisani et al. · 2015 [cited by applicant]
US 20150189621A1 · Bekiares et al. · 2015 [cited by applicant]
US 20150206524A1 · Kraft et al. · 2015 [cited by applicant]
US 20150208170A1 · Kraft et al. · 2015 [cited by applicant]
US 20150215701A1 · Usher · 2015 [cited by applicant]
US 20150234156A1 · Rondinelli et al. · 2015 [cited by applicant]
US 20150242519A1 · Alsina et al. · 2015 [cited by applicant]
US 20150312671A1 · Wiggins et al. · 2015 [cited by applicant]
US 20150312677A1 · Kraft et al. · 2015 [cited by applicant]
US 20150348580A1 · Hoff et al. · 2015 [cited by applicant]
US 20150350768A1 · Terpstra · 2015 [cited by applicant]
US 20150355880A1 · Kraft et al. · 2015 [cited by applicant]
US 20150373474A1 · Kraft et al. · 2015 [cited by applicant]
US 20150382106A1 · Kraft et al. · 2015 [cited by applicant]
US 20160055861A1 · Kraft et al. · 2016 [cited by applicant]
US 20160057526A1 · Jaffe et al. · 2016 [cited by applicant]
US 20160300584A1 · Pandey et al. · 2016 [cited by applicant]
US 20170295446A1 · Shivappa · 2017 [cited by applicant]
US 20170374455A1 · Shastry · 2017 [cited by examiner]
US 20180046431A1 · Shivappa et al. · 2018 [cited by applicant]
US 20180160211A1 · Kirsch et al. · 2018 [cited by applicant]
US 20180184226A1 · Giannuzzi · 2018 [cited by applicant]
US 20180206054A1 · Laitinen et al. · 2018 [cited by applicant]
US 20180270571A1 · Di Censo · 2018 [cited by examiner]
US 20190104371A1 · Ballande et al. · 2019 [cited by applicant]
AU 2002300314B2 · 2009 [cited by applicant]
AU 2003236382B2 · 2011 [cited by applicant]
CN 103229160A · 2013 [cited by applicant]
DE 102004025533A1 · 2005 [cited by applicant]
EP 0653144B1 · 1998 [cited by applicant]
JP 2009188641A · 2009 [cited by applicant]
WO 2005032209A2 · 2005 [cited by applicant]
WO 2012048299A1 · 2012 [cited by applicant]
WO 2014096861A2 · 2014 [cited by applicant]
Albing, Brad, Noise-Reducing Headphones Hide Analog Heart, Jan. 24, 2013, retrieved from http://www.planetanalog.com/author.asp?section.sub.--id=385&doc.sub.--id=- 558728, USA on Feb. 5, 2015. [cited by applicant]
Andrea Electronics Corporation, Digital Super Directional Array, DSDA Far-Field Microphone Technology, 2 pages, Melville, NY, USA. [cited by applicant]
AustriaMicrosystems AG, AS3421/22 Low Power Ambient Noise-Cancelling Speaker Driver DataSheet, 61 pages, 1997-2013, Austria. [cited by applicant]
AustriaMicrosystems AG-AMS AG, AS3501 AS3502 Low Power Ambient Noise-Cancelling Speaker Driver DataSheet, 46 pages, 1997-2009, Austria. [cited by applicant]
Baldwin, Richard G., Adaptive Noise Cancellation Using Java, Java Programing Notes #2360, Apr. 18, 2006, retrieved from http://www.developer.com/java/other/article.php/3599661/Adaptive-Noise-Ca- ncellation-Using-Java.ht… [cited by applicant]
Chowdhry, Amit, 26 Best Noise Cancelling Headphones, Pulse2.0 Technology News Since 2006, Nov. 28, 2012, retrieved from http://pulse2.com/2012/11/28/best-noise canceling-headphones/, USA on Feb. 5, 2015. [cited by applicant]
CNET TV, Monoprice's Noise Cancelling Headphone tries to silence critics,—You Tube, http://scienceheap.com/?rvq, https://www.youtube.com/watch?v=h8.sub.--PDtXQu58#t=89, Apr. 10, 2013, USA. [cited by applicant]
Conexant, Conexant AudioSmart Voice & Speech Processing White Paper, Feb. 12, 2014, pp. 1-19. [cited by applicant]
Dualta, Currie, Shedding Some Light on Voice Authentication, SANS Institute InfoSec Reading Room, 2003, 17 pages, USA. [cited by applicant]
Elliott, S.J., Nelson, P.A., Active Noise Control—Low-frequency techniques for suppressing acoustic noise leap forward with signal processing, IEEE Signal Processing Magazine, Oct. 1993, 24 pages, USA. [cited by applicant]
FMA Solutions, Inc., Best Noise Canceling Earphones, Westone Noise Canceling Earphones, 2014, earphonesolutions.com/coofsoiseaan.html, Orlando, FL, USA. [cited by applicant]
FrankFSP, ConcertTronix! The Revolutionary New Way to Attend, Listen and Record Live Concerts with Your Mobile Device!, Sep. 12, 2012, USA. [cited by applicant]
Geronazzo, Michelle; Bedin, Alberto; Brayda, Luca; Campus, Claudio; Avanzini, Federico. Interactive spatial sonification for non-visual exploration of virtual maps, Int. J. Human-Computer Studies, 85(2016) 4-15, 2015 El… [cited by applicant]
Haynes, Toby, A Primer on Digital Beamforming, Mar. 26, 1988, www.spectrumsignal.com, 15 pages, British Columbia, Canada. [cited by applicant]
Wikipedia Contributors “Head-related transfer function”. The Free Encyclopedia, Wikipedia, retrieved from https://en.wikipedia.org/wiki/Head-related_transfer_function on Sep. 28, 2016. [cited by applicant]
Jezierny, Michael; Keller, Brenton; Lee, Kyung Yul, Digital Active Noise Cancelling Headphones, School of Engineering and Applied Science, Electrical and Systems Engineering Department, Washington University in St. Loui… [cited by applicant]
Jiang, Wentao, “Sound of silence”: a secure indoor wireless ultrasonic communication system, School of Engineering—Electrical & Electronic Engineering, UCC, 2014, retrieved from http://publish.ucc.ie/boolean/pdf/2014/00… [cited by applicant]
Kendall, Gary S., A 3-D Sound Primer: Directional Hearing and Stereo Reproduction, Computer Music Journal, vol. 19, No. 4 (Winter, 1995), pp. 23-46. [cited by applicant]
Kuo, S.M., Panahi, I., Chung, K.M., Horner, T., Nadeski, M., Chyan, J., Design of Active Noise Control Systems with the TMS320 Family Application Report, Texas Instruments Digital Signal Processing Solutions, 1996, 171 … [cited by applicant]
Kuo, Sen M. and Morgan, Dennis R., Active Noise Control: A Tutorial Review, Proceedings of the IEEE, vol. 87, No. 6, Jun. 1999, pp. 943-973, USA. [cited by applicant]
Lavalle, S.M.; Yershova, A.; Katseve, M.; Antonov, M. (2014). Head Tracking for the Oculus Rift, Proceedings of the IEEE International Conference on Robotics and Automation, p. 187-194. [cited by applicant]
Lu, Yan-Chen; Cooke, Martin, Motion strategies for binaural localisation of speech sources in azimuth and distance by artificial listeners, Speech Comm. (2010) , Jun. 12, 2010, ScienceDirect. [cited by applicant]
Mannion, Patrick. Teardown: Analog Rules Over Digital in Noise-Canceling Headphones, EDN Network, Jan. 11, 2013, 3 pages, USA. [cited by applicant]
Maxim, Audio Design Guide, 12th Edition, Dec. 2009, 20 pages, USA. [cited by applicant]
MiniDSP Ltd., Digital Crossover Basics, www.minidsp.com/, 2009-2014, 4 pages, Hong Kong. [cited by applicant]
Parra, Lucas; Fancourt, Craig, An Adaptive Beamforming Perspective on Convolutive Blind Source Separation, Samoff Corporation, Noise Reduction in Speech Applications, Ed. G. Davis, CRC Press, 2002, Princeton, NJ, pp. 1-… [cited by applicant]
Priyantha, N.B.; Chakraborty, A.; Balakrishan, H., The Cricket Location-Support System, 2000, MIT Laboratory for Computer Science, Cambridge, Massachusetts, U.S. [cited by applicant]
Ruckus Wireless, Inc., Best Practice Design Guide: Deploying Very High Density Wi-Fi—Design and Configuration Guide for Stadiums, 2012, http://c541678.r78.cf2.rackcdn.com/appnotes/bpg-highdensity.pdf, 2012, USA. [cited by applicant]
Singh, Aarti, Adaptive Noise Cancellation, Dept. of Electronics & Communication, Netaji Subhas Institute of Technology, 2001, 52 pages, India. [cited by applicant]
STMicroelectrics, STA311B Multichannel digital audio processor with FFX Datasheet, Oct. 2013, 102 pages, USA. [cited by applicant]
STMicroelectronics, STA308A Multi-channel digital audio processor with DDX Datasheet, Jul. 2007, USA. [cited by applicant]
Wassp, WMB-3230, Operator manual, Version V1.1a, Jun. 2013, pp. 1-74. [cited by applicant]
Zaunschirm, Markus and Zotter, Franz, Measurement-Based Modal Beamforming Using Planar Circular Microphone Arrays, Proc. of the EAA Joint Symposium on Auralization and Ambisonics, Apr. 3-5, 2014, pp. 75-80, Berlin, Germ… [cited by applicant]
Stefania Repetto and Andrea Trucco, Signing Superdirective Microphone Arrays with a Frequency-Invariant Beam Pattern, IEEE Sensors Journal, Jun. 2006, pp. 737-747, vol. 6, No. 3, Italy. [cited by applicant]