IP Library Granted Patent US 11,540,072
Granted Patent B2
US 11,540,072 · App. 17/686,025 · Granted Dec 27, 2022

Reverberation fingerprint estimation

Inventors: Mathieu Parvaix (Santa Clara, CA); Jean-Marc Jot (Aptos, CA); Colby Nelson Leider (Coral Gables, FL)
Assignee: Magic Leap, Inc.
H04R29/00H04R1/08H04R3/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,540,072
App. No.
17/686,025
Granted
Dec 27, 2022
Kind
B2
Abstract

Examples of the disclosure describe systems and methods for estimating acoustic properties of an environment. In an example method, a first audio signal is received via a microphone of a wearable head device. An envelope of the first audio signal is determined, and a first reverberation time is estimated based on the envelope of the first audio signal. A difference between the first reverberation time and a second reverberation time is determined. A change in the environment is determined based on the difference between the first reverberation time and the second reverberation time. A second audio signal is presented via a speaker of a wearable head device, wherein the second audio signal is based on the second reverberation time.

Claims (57)

1. A method comprising:

receiving, at a first time, via a microphone of a wearable head device configured to present a view of a virtual environment, a first audio signal;

determining an envelope of the first audio signal;

estimating a first reverberation time based on the envelope of the first audio signal;

based on the estimated first reverberation time, determining that a location of the wearable head device at the first time corresponds to a first region of the virtual environment;

receiving, at a second time, via the microphone of the wearable head device, a second audio signal;

determining an envelope of the second audio signal;

estimating a second reverberation time based on the envelope of the second audio signal; and

based on the estimated second reverberation time, determining that a location of the wearable head device at the second time corresponds to a second region of the virtual environment, the second region different from the first region.

2. The method of claim 1 , wherein said estimating the first reverberation time comprises determining if the envelope of the first audio signal is decaying for a time greater than a threshold amount of time.

3. The method of claim 1 , wherein said estimating the first reverberation time comprises:

determining a linear fit of a decaying region in the envelope of the first audio signal; and

determining if the linear fit has a correlation greater than a threshold correlation.

4. The method of claim 1 , further comprising estimating a first reverberation gain based on the envelope of the first audio signal, wherein determining that the location of the wearable head device at the first time corresponds to the first region of the virtual environment is based further on the estimated first reverberation gain.

5. The method of claim 4 , wherein said estimating the first reverberation gain comprises prompting a user to clap.

6. The method of claim 4 , wherein said estimating the first reverberation gain comprises presenting, via the speaker of the wearable head device, an impulse sound.

7. The method of claim 1 , wherein:

determining the envelope of the first audio signal comprises applying a bandpass filter to the first audio signal; and

determining the envelope of the second audio signal comprises applying the bandpass filter to the second audio signal.

8. A system comprising:

a wearable head device configured to present a view of a virtual environment;

a microphone of the wearable head device; and

one or more processors configured to execute a method comprising:

receiving, at a first time, via the microphone of the wearable head device, a first audio signal;

determining an envelope of the first audio signal;

estimating a first reverberation time based on the envelope of the first audio signal;

based on the estimated first reverberation time, determining that a location of the wearable head device at the first time corresponds to a first region of the virtual environment;

receiving, at a second time, via the microphone of the wearable head device, a second audio signal;

determining an envelope of the second audio signal;

estimating a second reverberation time based on the envelope of the second audio signal; and

based on the estimated second reverberation time, determining that a location of the wearable head device at the second time corresponds to a second region of the virtual environment, the second region different from the first region.

9. The system of claim 8 , wherein said estimating the first reverberation time comprises determining if the envelope of the first audio signal is decaying for a time greater than a threshold amount of time.

10. The system of claim 8 , wherein said estimating the first reverberation time comprises:

determining a linear fit of a decaying region in the envelope of the first audio signal; and

determining if the linear fit has a correlation greater than a threshold correlation.

11. The system of claim 8 , wherein the method further comprises estimating a first reverberation gain based on the envelope of the first audio signal, wherein determining that the location of the wearable head device at the first time corresponds to the first region of the virtual environment is based further on the estimated first reverberation gain.

12. The system of claim 11 , wherein said estimating the first reverberation gain comprises prompting a user to clap.

13. The system of claim 11 , wherein said estimating the first reverberation gain comprises presenting, via a speaker of the wearable head device, an impulse sound.

14. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:

receiving, at a first time, via a microphone of a wearable head device configured to present a view of a virtual environment, a first audio signal;

determining an envelope of the first audio signal;

estimating a first reverberation time based on the envelope of the first audio signal;

based on the estimated first reverberation time, determining that a location of the wearable head device at the first time corresponds to a first region of the virtual environment;

receiving, at a second time, via the microphone of the wearable head device, a second audio signal;

determining an envelope of the second audio signal;

estimating a second reverberation time based on the envelope of the second audio signal; and

based on the estimated second reverberation time, determining that a location of the wearable head device at the second time corresponds to a second region of the virtual environment, the second region different from the first region.

15. The non-transitory computer-readable medium of claim 14 , wherein said estimating the first reverberation time comprises determining if the envelope of the first audio signal is decaying for a time greater than a threshold amount of time.

16. The non-transitory computer-readable medium of claim 14 , wherein said estimating the first reverberation time comprises:

determining a linear fit of a decaying region in the envelope of the first audio signal; and

determining if the linear fit has a correlation greater than a threshold correlation.

17. The non-transitory computer-readable medium of claim 14 , wherein the method further comprises estimating a first reverberation gain based on the envelope of the first audio signal, wherein determining that the location of the wearable head device at the first time corresponds to the first region of the virtual environment is based further on the estimated first reverberation gain.

18. The non-transitory computer-readable medium of claim 17 , wherein said estimating the first reverberation gain comprises prompting a user to clap.

19. The non-transitory computer-readable medium of claim 17 , wherein said estimating the first reverberation gain comprises presenting, via a speaker of the wearable head device, an impulse sound.

20. The non-transitory computer-readable medium of claim 14 , wherein:

determining the envelope of the first audio signal comprises applying a bandpass filter to the first audio signal; and

determining the envelope of the second audio signal comprises applying the bandpass filter to the second audio signal.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: PARVAIX, MATHIEU; JOT, JEAN-MARC; LEIDER, COLBY NELSON
To: MAGIC LEAP, INC.
Reel/Frame 064406/0893 →
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
Continuity (3)
Continuation 17079212 · Oct 23, 2020
Provisional Application 62926330 · Oct 25, 2019
Related Publication 20220272469A1 · Aug 25, 2022
Cited By (3)
US 12,308,011 US 12,317,064 US 12,615,407