IP Library Granted Patent US 12,418,270
Granted Patent B2
US 12,418,270 · App. 18/405,641 · Granted Sep 16, 2025

Methods and systems for automatically equalizing audio output based on room position

Inventors: Benjamin Louis Shaya (Mountain View, CA); Rasmus Larsen (San Jose, CA); Richard F. Lyon (Los Altos, CA); Michael Smedegaard (Danville, CA)
Assignee: GOOGLE LLC
H03G5/165G06F3/167H04R1/403H04R1/406H04R3/005H04R3/04H04R3/12H04R29/001H04S7/301H04S7/305G06N3/04H04R2420/07H04R2430/03H04S2420/00H04S2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,418,270
App. No.
18/405,641
Granted
Sep 16, 2025
Kind
B2
Abstract

The various implementations described herein include methods, devices, and systems for automatic audio equalization. In one aspect, a method is performed at an electronic device that includes speakers, microphones, processors and memory. The electronic device outputs audio user content from the speakers and automatically equalizes subsequent audio output of the device without user input. The automatic equalization includes: (1) obtaining audio content signals, including receiving outputted audio content at each microphone; (2) determining from the audio content signals phase differences between microphones; (3) obtaining a feature vector based on the phase differences; (4) obtaining a frequency correction from a correction database based on the obtained feature vector; and (5) applying the obtained frequency correction to the subsequent audio output.

Claims (45)

1. A method for equalizing audio at an electronic device located in a defined space, comprising:

outputting first audio content from at least one speaker of the electronic device;

capturing, via a plurality of microphones, audio data representing a set of reflections of the first audio content within the defined space;

based on the audio data that was captured, obtaining, by a processor of the electronic device, a frequency response for the defined space;

obtaining, by the processor, a frequency correction based on the frequency response and a target frequency response obtained through an analysis of an environs of the electronic device, the frequency correction being over a range of frequencies above and below a transition frequency; and

applying, by the processor, the frequency correction to subsequent audio content.

2. The method of claim 1 , wherein obtaining the frequency response for the defined space comprises:

obtaining, by the processor of the electronic device, the frequency response for the defined space, wherein the frequency response comprises a set of fluctuations in amplitude over the range of frequencies.

3. The method of claim 1 , wherein obtaining the frequency response for the defined space comprises:

obtaining, by the processor of the electronic device, the frequency response for the defined space, wherein the frequency response corresponds to a position of the electronic device within the defined space.

4. The method of claim 1 , wherein obtaining the frequency response for the defined space comprises:

determining, by the processor based on the audio data that was captured, a plurality of phase differences between the plurality of microphones; and

obtaining a feature vector based on the plurality of phase differences.

5. The method of claim 4 , wherein obtaining the frequency correction based on the frequency response comprises:

obtaining the frequency correction based on the feature vector.

6. The method of claim 1 , wherein obtaining the frequency correction based on the frequency response comprises:

obtaining, using a database local to the electronic device, the frequency correction based on the frequency response.

7. The method of claim 1 , further comprising:

outputting training audio from the at least one speaker of the electronic device;

capturing, via the plurality of microphones, additional audio data representing an additional set of reflections of the training audio within the defined space;

generating a reference feature vector and a reference frequency correction based on the additional audio data that was captured; and

adding, to a correction database, the reference feature vector and the reference frequency correction.

8. The method of claim 7 , wherein obtaining the frequency correction based on the frequency response comprises:

obtaining, based on the reference feature vector and the reference frequency correction in the correction database, the frequency correction based on the frequency response.

9. An electronic device located in a defined space, comprising: at least one speaker; a plurality of microphones; a memory storing at least one computer program; and a processor interfaced with the at least one speaker, the plurality of microphones, and the memory, and configured to execute the at least one computer program to cause the processor to: cause the at least one speaker to output first audio content, capture, via the plurality of microphones, audio data representing a set of reflections of the first audio content within the defined space, based on the audio data that was captured, obtain a frequency response for the defined space, and obtain a frequency correction frequency based on the frequency response and a target frequency response obtained through an analysis of an environs of the electronic device, the frequency correction being over a range of frequencies above and below a transition frequency, and apply the frequency correction to subsequent audio content.

10. The electronic device of claim 9 , wherein to obtain the frequency response for the defined space, the processor is configured to:

obtain the frequency response for the defined space, wherein the frequency response comprises a set of fluctuations in amplitude over the range of frequencies.

11. The electronic device of claim 9 , wherein to obtain the frequency response for the defined space, the processor is configured to:

obtain the frequency response for the defined space, wherein the frequency response corresponds to a position of the electronic device within the defined space.

12. The electronic device of claim 9 , wherein to obtain the frequency response for the defined space, the processor is configured to:

determine, based on the audio data that was captured, a plurality of phase differences between the plurality of microphones, and

obtain a feature vector based on the plurality of phase differences.

13. The electronic device of claim 12 , wherein to obtain the frequency correction based on the frequency response, the processor is configured to:

obtain the frequency correction based on the feature vector.

14. The electronic device of claim 9 , further comprising:

a database;

wherein to obtain the frequency correction based on the frequency response, the processor is configured to:

obtain, using the database, the frequency correction based on the frequency response.

15. The electronic device of claim 9 , wherein the processor is configured to execute the at least one computer program to further cause the processor to:

cause the at least one speaker to output training audio,

capture, via the plurality of microphones, additional audio data representing an additional set of reflections of the training audio within the defined space,

generate a reference feature vector and a reference frequency correction based on the additional audio data that was captured, and

add, to a correction database, the reference feature vector and the reference frequency correction.

16. The electronic device of claim 15 , wherein to obtain the frequency correction based on the frequency response, the processor is configured to:

obtain, based on the reference feature vector and the reference frequency correction in the correction database, the frequency correction based on the frequency response.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2024
From: SHAYA, BENJAMIN LOUIS; LARSEN, RASMUS; LYON, RICHARD; SMEDEGAARD, MICHAEL
To: GOOGLE LLC
Reel/Frame 066066/0986 →
Continuity (6)
Continuation 17191510 · Mar 3, 2021
Continuation 16719847 · Dec 18, 2019
Continuation 16058885 · Aug 8, 2018
Provisional Application 62568219 · Oct 4, 2017
Provisional Application 62568216 · Oct 4, 2017
Related Publication 20240146274A1 · May 2, 2024
References Cited (105)
US 4340780A · Odlen · 1982 [cited by applicant]
US 5754774A · Bittinger et al. · 1998 [cited by applicant]
US 6731760B2 · Pedersen · 2004 [cited by applicant]
US 6766025B1 · Levy et al. · 2004 [cited by applicant]
US 7769183B2 · Bharitkar et al. · 2010 [cited by applicant]
US 8045721B2 · Burgan et al. · 2011 [cited by applicant]
US 8331585B2 · Hagen et al. · 2012 [cited by applicant]
US 8676728B1 · Velusamy et al. · 2014 [cited by applicant]
US 9020153B2 · Britt, Jr. · 2015 [cited by applicant]
US 9185199B2 · Zurek et al. · 2015 [cited by applicant]
US 9219460B2 · Bush · 2015 [cited by applicant]
US 9294859B2 · Ivanov et al. · 2016 [cited by applicant]
US 9351091B2 · Ivanov et al. · 2016 [cited by applicant]
US 9438996B2 · Maher et al. · 2016 [cited by applicant]
US 9521497B2 · Schuster et al. · 2016 [cited by applicant]
US 9689960B1 · Barton et al. · 2017 [cited by applicant]
US 9763018B1 · McPherson et al. · 2017 [cited by applicant]
US 9826328B2 · Mehta et al. · 2017 [cited by applicant]
US 9888319B2 · Soulodre · 2018 [cited by examiner]
US 9952825B2 · Sheen · 2018 [cited by applicant]
US 9992595B1 · Choisel · 2018 [cited by examiner]
US 10051393B2 · Rabinowitz · 2018 [cited by examiner]
US 10127008B2 · Sheen et al. · 2018 [cited by applicant]
US 10149087B1 · Choisel · 2018 [cited by examiner]
US 10283137B2 · Pakarinen et al. · 2019 [cited by applicant]
US 10440492B2 · Crockett · 2019 [cited by examiner]
US 10459684B2 · Shih et al. · 2019 [cited by applicant]
US 10523172B2 · Shaya et al. · 2019 [cited by applicant]
US 11264044B2 · Delcroix et al. · 2022 [cited by applicant]
US 11513216B1 · Kamath Koteshwara et al. · 2022 [cited by applicant]
US 20030235318A1 · Bharitkar et al. · 2003 [cited by applicant]
US 20050031129A1 · Devantier et al. · 2005 [cited by applicant]
US 20050195984A1 · Miura et al. · 2005 [cited by applicant]
US 20050207592A1 · Sporer et al. · 2005 [cited by applicant]
US 20060153391A1 · Hooley et al. · 2006 [cited by applicant]
US 20070025557A1 · Nackvi · 2007 [cited by applicant]
US 20080075303A1 · Kim et al. · 2008 [cited by applicant]
US 20080219470A1 · Kimijima · 2008 [cited by applicant]
US 20090110218A1 · Swain · 2009 [cited by applicant]
US 20110103590A1 · Christoph · 2011 [cited by applicant]
US 20110163972A1 · Anzures et al. · 2011 [cited by applicant]
US 20120183165A1 · Foo et al. · 2012 [cited by applicant]
US 20130064042A1 · Aarts et al. · 2013 [cited by applicant]
US 20130216071A1 · Maher et al. · 2013 [cited by applicant]
US 20130346559A1 · Van Erven et al. · 2013 [cited by applicant]
US 20140003635A1 · Mohammad et al. · 2014 [cited by applicant]
US 20140064492A1 · Lakkundi et al. · 2014 [cited by applicant]
US 20140185852A1 · Pereira · 2014 [cited by applicant]
US 20140274212A1 · Zurek et al. · 2014 [cited by applicant]
US 20150163616A1 · Chatterjee · 2015 [cited by applicant]
US 20150289076A1 · Zhu et al. · 2015 [cited by applicant]
US 20150341729A1 · Meskens et al. · 2015 [cited by applicant]
US 20160029142A1 · Isaac · 2016 [cited by applicant]
US 20160219392A1 · Vilermo et al. · 2016 [cited by applicant]
US 20160315384A1 · van Erven et al. · 2016 [cited by applicant]
US 20160366517A1 · Chandran et al. · 2016 [cited by applicant]
US 20170025873A1 · Fathollahi · 2017 [cited by applicant]
US 20170041445A1 · Ukai et al. · 2017 [cited by applicant]
US 20170123755A1 · Hersh et al. · 2017 [cited by applicant]
US 20170188167A1 · Li et al. · 2017 [cited by applicant]
US 20170280223A1 · Cavarra et al. · 2017 [cited by applicant]
US 20170295440A1 · Gran et al. · 2017 [cited by applicant]
US 20180063626A1 · Pong et al. · 2018 [cited by applicant]
US 20180098167A1 · Welch et al. · 2018 [cited by applicant]
US 20180364901A1 · Fan · 2018 [cited by applicant]
US 20190075414A1 · Bush · 2019 [cited by applicant]
US 20210294845A1 · Bharitkar et al. · 2021 [cited by applicant]
CN 103155526A · 2013 [cited by applicant]
CN 103517178A · 2014 [cited by applicant]
CN 104898970A · 2015 [cited by applicant]
CN 105224280A · 2016 [cited by applicant]
CN 105260071A · 2016 [cited by applicant]
CN 105867766A · 2016 [cited by applicant]
CN 106708403A · 2017 [cited by applicant]
EP 0772374A2 · 1997 [cited by applicant]
EP 2567554A1 · 2013 [cited by applicant]
EP 2986034A1 · 2016 [cited by applicant]
WO WO2011139502A1 · 2011 [cited by applicant]
WO WO2012040363A1 · 2012 [cited by applicant]
WO WO2014036121A1 · 2014 [cited by applicant]
WO WO2018026799A1 · 2018 [cited by applicant]
International Preliminary Report on Patentability for Application No. PCT/US2018/042345, dated Apr. 8, 2020. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2018/042345, dated Dec. 21, 2018. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2018/045703, dated Nov. 14, 2019. [cited by applicant]
Jan Abildgaard Pedersen, “Adjusting a Loudspeaker to Its Acoustic Environmen—The ABC System,” Audio Engineer Society Convention Paper 5880 (Oct. 10-13, 2003). [cited by applicant]
Excerpts from Andrew Tanenbaum, Computer Networks (4th ed. 2003). [cited by applicant]
Excerpts from Morfey, Christopher L., Dictionary of Acoustics (2001). [cited by applicant]
BeoLab 5 Guide Retreived from the Internet at: <URL:https://content.abt.com/documents/6163/BeoLab5_om.pdf>. [cited by applicant]
Pioneer, “What is MCACC?,” (2021). Retreived from the Internet at: <URL:https://www.pioneerhomeusa.com/mcacc/>. [cited by applicant]
Creative, “Creative Unveils the World's First Self-Calibrating Wireless Speaker System—the Creative D5xm™ Intelligent Wireless Speakers,” (2021). Retreived from the Internet at: <URL:https://sg.creative.com/corporate/pr… [cited by applicant]
Welcome to REW (2004-2020). Retreived from the Internet at: <URL:https://www.roomeqwizard.com/betahelp/help_en-GB/html/welcome.html>. [cited by applicant]
Anthem, “Current Products—Room Correction—Anthem Room Correction,” (2021). Retreived from the Internet at: <URL:https://www.anthemav.com/products-current/series=arc/type=room-correction>. [cited by applicant]
“What is Audyssey MultEQ XT?” (2021). Retreived from the Internet at: <URL:https://denon.custhelp.com/app/answers/detail/a_id/32/˜/audyssey-multeq-xt>. [cited by applicant]
DIRAC Live, “Play or Record your favorite music. Experience music as it is intended,” (2021). Retreived from the Internet at: <URL:https://live.dirac.com/>. [cited by applicant]
Trinnov Audio (2021). Retreived from the Internet at: <URL:https://www.trinnov.com/>. [cited by applicant]
Sony, “help Guide; Multi Channel AV RECEIVERSTR-DH750/STR-DH550,” (2014). Retreived from the Internet at: <URL:https://helpguide.sony.net/ha/strdh7555/v1/en/contents/TP0000299119.html>. [cited by applicant]
Bose, “Bose Soundbar 500,” (2021). Retreived from the Internet at: <URL:https://www.bose.com/en_us/support/articles/HC1971/productCodes/bose_soundbar_500/article.html>. [cited by applicant]
Yamaha, “Optimizing the speaker settings automatically (YPAO),” (2019). Retreived from the Internet at: <URL:https://manual.yamaha.com/av/18/rxv685/en-US/311793035.html>. [cited by applicant]
Google LLC, International Preliminary Report on Patentability, PCT/US2018/042345, Apr. 8, 2020, 13 pgs. [cited by applicant]
Google LLC, International Search Report/Written Opinion, PCT/US2018/042345, Dec. 21, 2018, 19 pgs. [cited by applicant]
Google LLC, International Search Report/Written Opinion, PCT/US2019/045703, Nov. 14, 2019, 9 pgs. [cited by applicant]
Notification of First Office Action for Chinese Application No. 201980053721.X, dated Aug. 23, 2021. [cited by applicant]
First Examination Report for India Application No. 201947047310, dated Oct. 8, 2021. [cited by applicant]
Notification of Second Office Action for Chinese Application No. 201980053721.X, dated Jan. 27, 2022. [cited by applicant]
Office Action for European Application No. 18753503.4, dated Jul. 13, 2022. [cited by applicant]