IP Library Granted Patent US 12,149,896
Granted Patent B2
US 12,149,896 · App. 18/237,803 · Granted Nov 19, 2024

Reverberation fingerprint estimation

Inventors: Mathieu Parvaix (Santa Clara, CA); Jean-Marc Jot (Aptos, CA); Colby Nelson Leider (Coral Gables, FL)
Assignee: Magic Leap, Inc.
H04R29/00H04R1/08H04R3/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,149,896
App. No.
18/237,803
Granted
Nov 19, 2024
Kind
B2
Abstract

Examples of the disclosure describe systems and methods for estimating acoustic properties of an environment. In an example method, a first audio signal is received via a microphone of a wearable head device. An envelope of the first audio signal is determined, and a first reverberation time is estimated based on the envelope of the first audio signal. A difference between the first reverberation time and a second reverberation time is determined. A change in the environment is determined based on the difference between the first reverberation time and the second reverberation time. A second audio signal is presented via a speaker of a wearable head device, wherein the second audio signal is based on the second reverberation time.

Claims (41)

1. A method comprising:

receiving, via a microphone, an audio signal;

receiving, via a sensor, sensor data indicative of a real-world environment;

determining an envelope of the audio signal;

estimating a reverberation time based on the envelope of the audio signal, wherein said estimating the reverberation time comprises determining a difference between a first reverberation time and a second reverberation time; and

based on the estimated reverberation time and based further on the sensor data, determining a location in the real-world environment.

2. The method of claim 1 , wherein said estimating the reverberation time comprises determining, based on the envelope of the audio signal, whether a decay time is greater than a threshold amount of time.

3. The method of claim 1 , wherein said estimating the reverberation time comprises determining whether a correlation of a linear fit with the audio signal is greater than a threshold correlation.

4. The method of claim 1 , further comprising estimating a first reverberation gain based on the envelope of the audio signal, wherein said determining the location in the real-world environment is based further on the estimated first reverberation gain.

5. The method of claim 4 , wherein said estimating the first reverberation gain comprises detecting an impulse signal.

6. The method of claim 4 , wherein said estimating the first reverberation gain comprises presenting, via a speaker, an impulse signal.

7. The method of claim 1 , wherein:

said determining the envelope of the audio signal comprises applying a bandpass filter to the audio signal.

8. The method of claim 1 , wherein:

a wearable head device comprises the microphone and the sensor, and

the location in the real-world environment comprises a location of the wearable head device.

9. The method of claim 8 , further comprising presenting a virtual object on a display of the wearable head device based on the determined location.

10. The method of claim 1 , further comprising determining, based on the estimated reverberation time and based further on the sensor data, an orientation in the real-world environment.

11. The method of claim 1 , wherein the location in the real-world environment is determined further based on an acoustic property of the real-world environment.

12. A system comprising:

a microphone;

a sensor; and

one or more processors configured to perform a method comprising:

receiving, via the microphone, an audio signal;

receiving, via the sensor, sensor data indicative of a real-world environment;

determining an envelope of the audio signal;

estimating a reverberation time based on the envelope of the audio signal, wherein said estimating the reverberation time comprises determining a difference between a first reverberation time and a second reverberation time; and

based on the estimated reverberation time and based further on the sensor data, determining a location in the real-world environment.

13. The system of claim 12 , wherein said estimating the reverberation time comprises determining, based on the envelope of the audio signal, whether a decay time is greater than a threshold amount of time.

14. The system of claim 13 , wherein the method further comprises determining, based on the estimated reverberation time and based further on the sensor data, an orientation in the real-world environment.

15. The system of claim 13 , wherein the location in the real-world environment is determined further based on an acoustic property of the real-world environment.

16. The system of claim 12 , wherein said estimating the reverberation time comprises determining whether a correlation of a linear fit with the audio signal is greater than a threshold correlation.

17. The system of claim 12 , wherein the method further comprises estimating a first reverberation gain based on the envelope of the audio signal and said determining the location in the real-world environment is based further on the estimated first reverberation gain.

18. The system of claim 12 , further comprising a wearable head device comprising the microphone and the sensor, wherein the location in the real-world environment comprises a location of the wearable head device.

19. The system of claim 18 , wherein the method further comprises presenting a virtual object on a display of the wearable head device based on the determined location.

20. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

receiving, via a microphone, an audio signal;

receiving, via a sensor, sensor data indicative of a real-world environment;

determining an envelope of the audio signal;

estimating a reverberation time based on the envelope of the audio signal, wherein said estimating the reverberation time comprises determining a difference between a first reverberation time and a second reverberation time; and

based on the estimated reverberation time and based further on the sensor data, determining a location in the real-world environment.

Assignments (4)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073438/0463 →
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073008/0696 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2023
From: PARVAIX, MATHIEU; JOT, JEAN-MARC; LEIDER, COLBY NELSON
To: MAGIC LEAP, INC.
Reel/Frame 064820/0309 →
Continuity (5)
Continuation 18058232 · Nov 22, 2022
Continuation 17686025 · Mar 3, 2022
Continuation 17079212 · Oct 23, 2020
Provisional Application 62926330 · Oct 25, 2019
Related Publication 20230403524A1 · Dec 14, 2023
Cited By (3)
US 12,308,011 US 12,317,064 US 12,615,407