Granted Patent B2

US 12,615,407 · App. 18/909,765 · Granted Apr 28, 2026

Inventors: Anastasia Andreyevna Tajik (Fort Lauderdale, FL); Jean-Marc Jot (Aptos, CA)

Assignee: Magic Leap, Inc.

H04N21/42203G06F3/165H04N21/439H04N21/816H04R5/04

Abstract

Claims (54)

1 . A method of presenting an audio signal to a user of a mixed reality environment, the method comprising:

identifying a first audio signal in the mixed reality environment;

identifying an object intersected by the first audio signal in the mixed reality environment;

identifying, via one or more sensors of a wearable head device, a position of the user in the mixed reality environment;

identifying, based on the position of the user, a listener coordinate associated with the user;

determining whether the object comprises a virtual object or a real object;

determining, based on the object and based further on the listener coordinate, a transfer function, wherein:

the transfer function comprises a first transfer function in accordance with a determination that the object comprises a virtual object, and

the transfer function comprises a second transfer function, different from the first transfer function, in accordance with a determination that the object comprises a real object;

generating a second audio signal based on the first audio signal and based further on the transfer function; and

presenting, to the user, the second audio signal.

2 . The method of claim 1 , wherein said identifying the first audio signal comprises detecting a voice signal generated by the user.

3 . The method of claim 1 , further comprising identifying, via the one or more sensors, an orientation of the user in the mixed reality environment, wherein the transfer function is determined based further on the orientation of the user.

4 . The method of claim 1 , further comprising determining an angle at which the first audio signal intersects the object, wherein the transfer function is determined based further on the angle.

5 . The method of claim 1 , wherein the first audio signal comprises a virtual audio signal.

6 . The method of claim 1 , further comprising determining an origin and a direction of the second audio signal in the mixed reality environment, wherein the transfer function is determined based further on the origin and the direction of the second audio signal.

7 . The method of claim 1 , wherein a see-through display of the wearable head device is configured to present the object.

8 . A system comprising:

a wearable head device including a see-through display configured to present a mixed reality environment to a user;

a speaker;

one or more sensors; and

one or more processors configured to perform a method comprising:

identifying a first audio signal in the mixed reality environment;

identifying an object intersected by the first audio signal in the mixed reality environment;

identifying, via the one or more sensors, a position of the user in the mixed reality environment;

identifying, based on the position of the user, a listener coordinate associated with the user;

determining whether the object comprises a virtual object or a real object;

determining, based on the object and based further on the listener coordinate, a transfer function, wherein:

the transfer function comprises a first transfer function in accordance with a determination that the object comprises a virtual object, and

the transfer function comprises a second transfer function, different from the first transfer function, in accordance with a determination that the object comprises a real object;

generating a second audio signal based on the first audio signal and based further on the transfer function; and

presenting, via the speaker to the user, the second audio signal.

9 . The system of claim 8 , wherein the system further comprises a microphone and wherein said identifying the first audio signal comprises detecting, via the microphone, a voice signal generated by the user.

10 . The system of claim 8 , wherein the method further comprises identifying, via the one or more sensors, an orientation of the user in the mixed reality environment, wherein the transfer function is determined based further on the orientation of the user.

11 . The system of claim 8 , wherein the method further comprises determining an angle at which the first audio signal intersects the object, wherein the transfer function is determined based further on the angle.

12 . The system of claim 8 , wherein the first audio signal comprises a virtual audio signal.

13 . The system of claim 8 , wherein the method further comprises determining an origin and a direction of the second audio signal in the mixed reality environment, wherein the transfer function is determined based further on the origin and the direction of the second audio signal.

14 . The system of claim 8 , wherein the see-through display is configured to present the object.

15 . A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:

identifying a first audio signal in the mixed reality environment;

identifying an object intersected by the first audio signal in the mixed reality environment;

identifying, via one or more sensors of a wearable head device, a position of the user in the mixed reality environment;

identifying, based on the position of the user, a listener coordinate associated with the user;

determining whether the object comprises a virtual object or a real object;

determining, based on the object and based further on the listener coordinate, a transfer function, wherein:

the transfer function comprises a first transfer function in accordance with a determination that the object comprises a virtual object, and

the transfer function comprises a second transfer function, different from the first transfer function, in accordance with a determination that the object comprises a real object;

generating a second audio signal based on the first audio signal and based further on the transfer function; and

presenting, to the user, the second audio signal.

16 . The non-transitory computer-readable medium of claim 15 , wherein said identifying the first audio signal comprises detecting a voice signal generated by the user.

17 . The non-transitory computer-readable medium of claim 15 , wherein the method further comprises identifying, via the one or more sensors, an orientation of the user in the mixed reality environment, wherein the transfer function is determined based further on the orientation of the user.

18 . The non-transitory computer-readable medium of claim 15 , wherein the first audio signal comprises a virtual audio signal.

19 . The non-transitory computer-readable medium of claim 15 , wherein the method further comprises determining an origin and a direction of the second audio signal in the mixed reality environment, wherein the transfer function is determined based further on the origin and the direction of the second audio signal.

20 . The non-transitory computer-readable medium of claim 15 , wherein a see-through display of the wearable head device is configured to present the object.

Assignments (3)

Continuity (5)

References Cited (357)