IP Library Granted Patent US 11,627,430
Granted Patent B2
US 11,627,430 · App. 17/112,969 · Granted Apr 11, 2023

Environment acoustics persistence

Inventors: Remi Samuel Audfray (San Francisco, CA); Mark Brandon Hertensteiner (San Jose, CA); Samuel Charles Dicker (San Francisco, CA); Blaine Ivin Wood (Eagle Mountain, UT); Michael Z. Land (Mill Valley, CA); Jean-Marc Jot (Aptos, CA)
Assignee: Magic Leap, Inc.
H04S7/306H04R5/04H04R2430/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,627,430
App. No.
17/112,969
Granted
Apr 11, 2023
Kind
B2
Abstract

Disclosed herein are systems and methods for storing, organizing, and maintaining acoustic data for mixed reality systems. A system may include one or more sensors of a head-wearable device, a speaker of the head-wearable device, and one or more processors configured to execute a method. A method for execution by the one or more processors may include receiving a request to present an audio signal. An environment may be identified via the one or more sensors of the head-wearable device. One or more audio model components associated with the environment may be retrieved. A first audio model may be generated based on the audio model components. A second audio model may be generated based on the first audio model. A modified audio signal may be determined based on the second audio model and based on the request to present an audio signal. The modified audio signal may be presented via the speaker of the head-wearable device.

Claims (68)

1. A system comprising:

one or more sensors of a head-wearable device;

a speaker of the head-wearable device;

one or more processors configured to execute a method comprising:

identifying, via the one or more sensors of the head-wearable device, an environment of the head-wearable device;

at a first time:

detecting, via the one or more sensors, a first location of a user of the head-wearable device with respect to a mixed reality environment;

retrieving one or more audio model components associated with the environment, the one or more audio model components comprising an anchor point associated with the environment; and

generating a first audio model based on the one or more audio model components, wherein the first audio model is associated with the mixed reality environment;

at a second time later than the first time:

receiving a request to present an audio signal;

detecting, via the one or more sensors, a second location of the user of the head-wearable device with respect to the mixed reality environment;

determining whether a difference between the first location and the second location exceeds a threshold;

in accordance with a determination that the difference exceeds the threshold:

generating a second audio model based on the first audio model; and

determining the audio signal based on the second audio model; and

in accordance with a determination that the difference does not exceed the threshold:

determining the audio signal based on the first audio model; and

presenting, via the speaker of the head-wearable device, the audio signal.

2. The system of claim 1 , wherein the second audio model is generated via an audio service.

3. The system of claim 1 , wherein the audio signal is determined via an audio service.

4. The system of claim 1 , wherein the one or more audio model components comprises one or more dimensions of the environment.

5. The system of claim 1 , wherein the one or more audio model components comprises a reverberation time.

6. The system of claim 1 , wherein the one or more audio model components comprises a reverberation gain.

7. The system of claim 1 , wherein the one or more audio model components comprises a transmission loss coefficient.

8. The system of claim 1 , wherein the one or more audio model components comprises an absorption coefficient.

9. The system of claim 1 , wherein the anchor point is associated with a specified location in the environment.

10. The system of claim 1 , wherein the anchor point is retrieved based on a proximity of the anchor point to the environment.

11. The system of claim 1 , wherein the anchor point is associated with a map of the environment.

12. A method comprising:

identifying, via one or more sensors of a head-wearable device, an environment of the head-wearable device;

at a first time:

detecting, via the one or more sensors, a first location of a user of the head-wearable device with respect to a mixed reality environment;

retrieving one or more audio model components associated with the environment, the one or more audio model components comprising an anchor point associated with the environment; and

generating a first audio model based on the one or more audio model components, wherein the first audio model is associated with the mixed reality environment;

at a second time later than the first time:

receiving a request to present an audio signal;

detecting, via the one or more sensors, a second location of the user of the head-wearable device with respect to the mixed reality environment;

determining whether a difference between the first location and the second location exceeds a threshold;

in accordance with a determination that the difference exceeds the threshold:

generating a second audio model based on the first audio model; and

determining the audio signal based on the second audio model; and

in accordance with a determination that the difference does not exceed the threshold:

determining the audio signal based on the first audio model; and

presenting, via a speaker of the head-wearable device, the audio signal.

13. The method of claim 12 , wherein the second audio model is generated via an audio service.

14. The method of claim 12 , wherein the audio signal is determined via an audio service.

15. The method of claim 12 , wherein the one or more audio model components comprises one or more dimensions of the environment.

16. The method of claim 12 , wherein the one or more audio model components comprises a reverberation time.

17. The method of claim 12 , wherein the one or more audio model components comprises a reverberation gain.

18. The method of claim 12 , wherein the one or more audio model components comprises a transmission loss coefficient.

19. The method of claim 12 , wherein the one or more audio model components comprises an absorption coefficient.

20. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:

identifying, via one or more sensors of a head-wearable device, an environment of the head-wearable device;

at a first time:

detecting, via the one or more sensors, a first location of a user of the head-wearable device with respect to a mixed reality environment;

retrieving one or more audio model components associated with the environment, the one or more audio model components comprising an anchor point associated with the environment; and

generating a first audio model based on the one or more audio model components, wherein the first audio model is associated with the mixed reality environment;

at a second time later than the first time:

receiving a request to present an audio signal;

detecting, via the one or more sensors, a second location of the user of the head-wearable device with respect to the mixed reality environment;

determining whether a difference between the first location and the second location exceeds a threshold;

in accordance with a determination that the difference exceeds the threshold:

generating a second audio model based on the first audio model; and

determining the audio signal based on the second audio model; and

in accordance with a determination that the difference does not exceed the threshold:

determining the audio signal based on the first audio model; and

presenting, via a speaker of the head-wearable device, the audio signal.

Assignments (4)
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0476 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2023
From: AUDFRAY, REMI SAMUEL; HERTENSTEINER, MARK BRANDON; DICKER, SAMUEL CHARLES; WOOD, BLAINE IVIN; LAND, MICHAEL Z.; JOT, JEAN-MARC
To: MAGIC LEAP, INC.
Reel/Frame 063471/0902 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →