Granted Patent B2

US 12,738,289 · App. 18/700,175 · Granted Sep 15, 2026

Inventors: Remi Samuel Audfray (San Francisco, CA); Mark Brandon Hertensteiner (San Jose, CA)

Assignee: Magic Leap, Inc.

G10L21/003G06F3/16

Abstract

Claims (42)

1 . A method for providing audio output through a wearable device configured to present a mixed reality environment, the method comprising:

receiving an input audio signal corresponding to a sound source originating from a real environment;

determining one or more acoustic properties of the mixed reality environment, wherein the one or more acoustic properties of the mixed reality environment are different from at least one acoustic property of the real environment;

determining a signal modification parameter based on the one or more acoustic properties of the mixed reality environment;

applying the signal modification parameter to the input audio signal to determine a second audio signal; and

presenting the second audio signal through the wearable device.

2 . The method of claim 1 , wherein the input audio signal corresponds to the sound source that is a voice of a user of the wearable device.

3 . The method of claim 1 , wherein the mixed reality environment corresponds to a remote meeting environment.

4 . The method of claim 1 , wherein the signal modification parameter corresponds to one or more reflections of the input audio signal off a surface of the mixed reality environment.

5 . The method of claim 1 , wherein the signal modification parameter corresponds to one or more reverberations of the input audio signal off a surface of the mixed reality environment.

6 . The method of claim 1 , further comprising determining a source directivity pattern based on the input audio signal.

7 . The method of claim 6 , wherein the determining the signal modification parameter is further based on the source directivity pattern.

8 . The method of claim 1 , further comprising:

receiving a third input audio signal corresponding to a second sound source originating from the real environment;

determining a second signal modification parameter based on the one or more acoustic properties of the mixed reality environment;

applying the second signal modification parameter to the third input audio signal to determine a fourth audio signal;

mixing the second audio signal and the fourth audio signal; and

presenting the mixed audio signal through the wearable device.

9 . The method of claim 1 , further comprising processing the first audio signal to isolate a sound corresponding to the sound source.

10 . A wearable device configured to present a mixed reality environment, the wearable device comprising:

a display configured to display a view of the mixed reality environment;

one or more sensors;

one or more speakers; and

one or more processors configured to perform operations comprising:

receiving an input audio signal, via the one or more sensors, the input audio signal corresponding to a sound source originating from a real environment;

determining one or more acoustic properties of the mixed reality environment, wherein the one or more acoustic properties of the mixed reality environment are different from at least one acoustic property of the real environment;

determining a signal modification parameter based on the one or more acoustic properties of the mixed reality environment;

applying the signal modification parameter to the input audio signal to determine a second audio signal; and

presenting the second audio signal through the one or more speakers.

11 . The wearable device of claim 10 , wherein the input audio signal corresponds to the sound source that is a voice of a user of the wearable device.

12 . The wearable device of claim 10 , wherein the mixed reality environment corresponds to a remote meeting environment.

13 . The wearable device of claim 10 , wherein the signal modification parameter corresponds to one or more reflections of the input audio signal off a surface of the mixed reality environment.

14 . The wearable device of claim 10 , wherein the signal modification parameter corresponds to one or more reverberations of the input audio signal off a surface of the mixed reality environment.

15 . The wearable device of claim 10 , wherein the method further comprises determining a source directivity pattern based on the input audio signal.

16 . The wearable device of claim 15 , wherein the determining the signal modification parameter is further based on the source directivity pattern.

17 . The wearable device of claim 10 , wherein the method further comprises:

receiving a third input audio signal, via the one or more sensors, the third input audio signal corresponding to a second sound source originating from the real environment;

determining a second signal modification parameter based on the one or more acoustic properties of the mixed reality environment;

applying the second signal modification parameter to the third input audio signal to determine a fourth audio signal;

mixing the second audio signal and the fourth audio signal; and

presenting the mixed audio signal through the one or more speakers.

18 . The wearable device of claim 10 , wherein the method further comprises processing the first audio signal to isolate a sound corresponding to the sound source.

Assignments (2)

Continuity (2)

References Cited (265)