IP Library Granted Patent US 11,778,398
Granted Patent B2
US 11,778,398 · App. 18/058,232 · Granted Oct 3, 2023

Reverberation fingerprint estimation

Inventors: Mathieu Parvaix (Santa Clara, CA); Jean-Marc Jot (Aptos, CA); Colby Nelson Leider (Coral Gables, FL)
Assignee: Magic Leap, Inc.
H04R29/00H04R1/08H04R3/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,778,398
App. No.
18/058,232
Granted
Oct 3, 2023
Kind
B2
Abstract

Examples of the disclosure describe systems and methods for estimating acoustic properties of an environment. In an example method, a first audio signal is received via a microphone of a wearable head device. An envelope of the first audio signal is determined, and a first reverberation time is estimated based on the envelope of the first audio signal. A difference between the first reverberation time and a second reverberation time is determined. A change in the environment is determined based on the difference between the first reverberation time and the second reverberation time. A second audio signal is presented via a speaker of a wearable head device, wherein the second audio signal is based on the second reverberation time.

Claims (53)

1. A method comprising:

receiving, via a microphone of a wearable head device comprising a see-through display and a sensor, an audio signal;

presenting, via the see-through display, a view of a real-world environment;

concurrently with presenting the view of the real-world environment, presenting, via the see-through display, a view of a virtual environment;

receiving, via the sensor of the wearable head device, sensor data indicative of the real-world environment;

determining an envelope of the audio signal;

estimating a reverberation time based on the envelope of the audio signal, wherein said estimating the reverberation time comprises determining a difference between a first reverberation time and a second reverberation time; and

based on the estimated reverberation time and based further on the sensor data, determining a location of the wearable head device in the real-world environment.

2. The method of claim 1 , wherein said estimating the reverberation time comprises determining if the envelope of the audio signal is decaying for a time greater than a threshold amount of time.

3. The method of claim 1 , wherein said estimating the reverberation time comprises:

determining a linear fit of a decaying region in the envelope of the audio signal; and

determining if the linear fit has a correlation greater than a threshold correlation.

4. The method of claim 1 , further comprising estimating a first reverberation gain based on the envelope of the audio signal, wherein said determining the location of the wearable head device in the real-world environment is based further on the estimated first reverberation gain.

5. The method of claim 4 , wherein said estimating the first reverberation gain comprises detecting a clapping sound.

6. The method of claim 4 , wherein said estimating the first reverberation gain comprises presenting, via the speaker of the wearable head device, an impulse signal.

7. The method of claim 1 , wherein:

said determining the envelope of the audio signal comprises applying a bandpass filter to the audio signal.

8. A system comprising:

a wearable head device comprising a see-through display;

a microphone of the wearable head device;

a sensor of the wearable head device; and

one or more processors configured to perform a method comprising:

presenting, via the see-through display, a view of a real-world environment;

concurrently with presenting the view of the real-world environment, presenting, via the see-through display, a view of a virtual environment;

receiving, via the sensor of the wearable head device, sensor data indicative of the real-world environment;

receiving, via the microphone of the wearable head device, an audio signal;

determining an envelope of the audio signal;

estimating a reverberation time based on the envelope of the audio signal, wherein said estimating the reverberation time comprises determining a difference between a first reverberation time and a second reverberation time; and

based on the estimated reverberation time and based further on the sensor data, determining a location of the wearable head device in the real-world environment.

9. The system of claim 8 , wherein said estimating the reverberation time comprises determining if the envelope of the audio signal is decaying for a time greater than a threshold amount of time.

10. The system of claim 8 , wherein said estimating the reverberation time comprises:

determining a linear fit of a decaying region in the envelope of the audio signal; and

determining if the linear fit has a correlation greater than a threshold correlation.

11. The system of claim 8 , wherein the method further comprises estimating a first reverberation gain based on the envelope of the audio signal, wherein said determining the location of the wearable head device in the real-world environment is based further on the estimated first reverberation gain.

12. The system of claim 11 , wherein said estimating the first reverberation gain comprises detecting a clapping sound.

13. The system of claim 11 , wherein said estimating the first reverberation gain comprises presenting, via a speaker of the wearable head device, an impulse signal.

14. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

receiving, via a microphone of a wearable head device comprising a see-through display and a sensor, an audio signal;

presenting, via the see-through display, a view of a real-world environment;

concurrently with presenting the view of the real-world environment, presenting, via the see-through display, a view of a virtual environment;

receiving, via the sensor of the wearable head device, sensor data indicative of the real-world environment;

determining an envelope of the audio signal;

estimating a reverberation time based on the envelope of the audio signal, wherein said estimating the reverberation time comprises determining a difference between a first reverberation time and a second reverberation time; and

based on the estimated reverberation time and based further on the sensor data, determining a location of the wearable head device in the real-world environment.

15. The non-transitory computer-readable medium of claim 14 , wherein said estimating the first reverberation time comprises determining if the envelope of the audio signal is decaying for a time greater than a threshold amount of time.

16. The non-transitory computer-readable medium of claim 14 , wherein said estimating the reverberation time comprises:

determining a linear fit of a decaying region in the envelope of the audio signal; and

determining if the linear fit has a correlation greater than a threshold correlation.

17. The non-transitory computer-readable medium of claim 14 , wherein the method further comprises estimating a first reverberation gain based on the envelope of the audio signal, wherein said determining the location of the wearable head device in the real-world environment is based further on the estimated first reverberation gain.

18. The non-transitory computer-readable medium of claim 17 , wherein said estimating the first reverberation gain comprises detecting a clapping sound.

19. The non-transitory computer-readable medium of claim 17 , wherein said estimating the first reverberation gain comprises presenting, via a speaker of the wearable head device, an impulse signal.

20. The non-transitory computer-readable medium of claim 14 , wherein:

said determining the envelope of the audio signal comprises applying a bandpass filter to the audio signal.

Assignments (3)
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073031/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: PARVAIX, MATHIEU; JOT, JEAN-MARC; LEIDER, COLBY NELSON
To: MAGIC LEAP, INC.
Reel/Frame 064406/0893 →
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →