IP Library Granted Patent US 11,304,017
Granted Patent B2
US 11,304,017 · App. 17/079,212 · Granted Apr 12, 2022

Reverberation fingerprint estimation

Inventors: Mathieu Parvaix (Santa Clara, CA); Jean-Marc Jot (Aptos, CA); Colby Nelson Leider (Coral Gables, FL)
Assignee: Magic Leap, Inc.
H04R29/00H04R1/08H04R3/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,304,017
App. No.
17/079,212
Granted
Apr 12, 2022
Kind
B2
Abstract

Examples of the disclosure describe systems and methods for estimating acoustic properties of an environment. In an example method, a first audio signal is received via a microphone of a wearable head device. An envelope of the first audio signal is determined, and a first reverberation time is estimated based on the envelope of the first audio signal. A difference between the first reverberation time and a second reverberation time is determined. A change in the environment is determined based on the difference between the first reverberation time and the second reverberation time. A second audio signal is presented via a speaker of a wearable head device, wherein the second audio signal is based on the second reverberation time.

Claims (59)

1. A method comprising:

receiving, via a microphone of a wearable head device, a first audio signal;

determining an envelope of the first audio signal;

estimating a first reverberation time based on the envelope of the first audio signal;

determining a difference between the first reverberation time and a second reverberation time;

determining a change in an environment based on the difference between the first reverberation time and the second reverberation time; and

in accordance with the determined change in the environment, presenting, via a speaker of the wearable head device, a second audio signal, wherein the second audio signal is based on the first reverberation time.

2. The method of claim 1 , wherein said estimating the first reverberation time comprises determining if the envelope of the first audio signal is decaying for a time greater than a threshold amount of time.

3. The method of claim 1 , wherein said estimating the first reverberation time comprises:

determining a linear fit of a decaying region in the envelope of the first audio signal; and

determining if the linear fit has a correlation greater than a threshold correlation.

4. The method of claim 1 , further comprising:

determining whether a confidence in the first reverberation time exceeds a threshold amount of confidence;

in accordance with a determination that the confidence in the first reverberation time exceeds the threshold amount of confidence, determining the first reverberation time; and

in accordance with a determination that the confidence in the first reverberation time does not exceed the threshold amount of confidence, forgoing determining the first reverberation time,

wherein said determining the difference between the first reverberation time and the second reverberation time, said determining the change in the environment based on the difference between the first reverberation time and the second reverberation time, and said presenting, via the speaker of the wearable head device, the second audio signal are performed in accordance with the determination that the confidence in the first reverberation time exceeds the threshold amount of confidence.

5. The method of claim 1 , further comprising estimating a first reverberation gain based on the envelope of the first audio signal, and wherein the second audio signal is based on the first reverberation gain.

6. The method of claim 5 , wherein said estimating the first reverberation gain comprises prompting a user to clap.

7. The method of claim 5 , wherein said estimating the first reverberation gain comprises presenting, via the speaker of the wearable head device, an impulse sound.

8. The method of claim 5 , wherein the first reverberation gain comprises a ratio of a direct sound energy and a reverberation sound energy.

9. A system comprising:

a microphone of a wearable head device;

a speaker of the wearable head device;

one or more processors configured to execute a method comprising:

receiving, via the microphone of the wearable head device, a first audio signal;

determining an envelope of the first audio signal;

estimating a first reverberation time based on the envelope of the first audio signal;

determining a difference between the first reverberation time and a second reverberation time;

determining a change in an environment based on the difference between the first reverberation time and the second reverberation time; and

in accordance with the determined change in the environment, presenting, via the speaker of the wearable head device, a second audio signal, wherein the second audio signal is based on the first reverberation time.

10. The system of claim 9 , wherein said estimating the first reverberation time comprises determining if the envelope of the first audio signal is decaying for a time greater than a threshold amount of time.

11. The system of claim 9 , wherein said estimating the first reverberation time comprises:

determining a linear fit of a decaying region in the envelope of the first audio signal; and

determining if the linear fit has a correlation greater than a threshold correlation.

12. The system of claim 9 , wherein the method further comprises:

determining whether a confidence in the first reverberation time exceeds a threshold amount of confidence;

in accordance with a determination that the confidence in the first reverberation time exceeds the threshold amount of confidence, determining the first reverberation time; and

in accordance with a determination that the confidence in the first reverberation time does not exceed the threshold amount of confidence, forgoing determining the first reverberation time,

wherein said determining the difference between the first reverberation time and the second reverberation time, said determining the change in the environment based on the difference between the first reverberation time and the second reverberation time, and said presenting, via the speaker of the wearable head device, the second audio signal are performed in accordance with the determination that the confidence in the first reverberation time exceeds the threshold amount of confidence.

13. The system of claim 9 , further comprising estimating a first reverberation gain based on the envelope of the first audio signal, and wherein the second audio signal is based on the first reverberation gain.

14. The system of claim 13 , wherein said estimating the first reverberation gain comprises presenting, via the speaker of the wearable head device, an impulse sound.

15. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:

receiving, via a microphone of a wearable head device, a first audio signal;

determining an envelope of the first audio signal;

estimating a first reverberation time based on the envelope of the first audio signal;

determining a difference between the first reverberation time and a second reverberation time;

determining a change in an environment based on the difference between the first reverberation time and the second reverberation time; and

in accordance with the determined change in the environment, presenting, via a speaker of the wearable head device, a second audio signal, wherein the second audio signal is based on the first reverberation time.

16. The non-transitory computer-readable medium of claim 15 , wherein said estimating the first reverberation time comprises determining if the envelope of the first audio signal is decaying for a time greater than a threshold amount of time.

17. The non-transitory computer-readable medium of claim 15 , wherein said estimating the first reverberation time comprises:

determining a linear fit of a decaying region in the envelope of the first audio signal; and

determining if the linear fit has a correlation greater than a threshold correlation.

18. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises:

determining whether a confidence in the first reverberation time exceeds a threshold amount of confidence;

in accordance with a determination that the confidence in the first reverberation time exceeds the threshold amount of confidence, determining the first reverberation time; and

in accordance with a determination that the confidence in the first reverberation time does not exceed the threshold amount of confidence, forgoing determining the first reverberation time,

wherein said determining the difference between the first reverberation time and the second reverberation time, said determining the change in the environment based on the difference between the first reverberation time and the second reverberation time, and said presenting, via the speaker of the wearable head device, the second audio signal are performed in accordance with the determination that the confidence in the first reverberation time exceeds the threshold amount of confidence.

19. The non-transitory computer-readable medium of claim 15 , further comprising estimating a first reverberation gain based on the envelope of the first audio signal, and wherein the second audio signal is based on the first reverberation gain.

20. The non-transitory computer-readable medium of claim 19 , wherein said estimating the first reverberation gain comprises presenting, via the speaker of the wearable head device, an impulse sound.

Assignments (3)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2021
From: PARVAIX, MATHIEU; JOT, JEAN-MARC; LEIDER, COLBY NELSON
To: MAGIC LEAP, INC.
Reel/Frame 058127/0019 →
Continuity (2)
Provisional Application 62926330 · Oct 25, 2019
Related Publication 20210127220A1 · Apr 29, 2021
Cited By (4)
US 12,308,011 US 12,317,064 US 12,598,442 US 12,615,407