IP Library Granted Patent US 12,317,062
Granted Patent B2
US 12,317,062 · App. 18/587,728 · Granted May 27, 2025

Dual listener positions for mixed reality

Inventor: Anastasia Andreyevna Tajik (Fort Lauderdale, FL)
Assignee: Magic Leap, Inc.
H04S7/303G02B27/0101G02B27/0172G06T19/006H04R1/403H04R3/12G02B2027/0138H04R2430/20H04R2499/15H04S2400/11H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,317,062
App. No.
18/587,728
Filed
Feb 26, 2024
Granted
May 27, 2025
Kind
B2
Art Unit
2691
USPC
381/310
Abstract

A method of presenting audio comprises: identifying a first ear listener position and a second ear listener position in a mixed reality environment; identifying a first virtual sound source in the mixed reality environment; identifying a first object in the mixed reality environment; determining a first audio signal in the mixed reality environment, wherein the first audio signal originates at the first virtual sound source and intersects the first ear listener position; determining a second audio signal in the mixed reality environment, wherein the second audio signal originates at the first virtual sound source, intersects the first object, and intersects the second ear listener position; determining a third audio signal based on the second audio signal and the first object; presenting, to a first ear of a user, the first audio signal; and presenting, to a second ear of the user, the third audio signal.

Claims (47)

1. A method of presenting audio signals in a mixed reality environment, the method comprising:

identifying a virtual sound source in the mixed reality environment;

identifying an object in the mixed reality environment;

determining, via one or more sensors of a wearable head device, a parameter of the object, wherein the parameter of the object is associated with at least one of a filtering, a phase shift, a delay, and a modulation;

determining a first audio signal in the mixed reality environment, wherein the first audio signal is associated with the virtual sound source;

determining a second audio signal based on the first audio signal and based further on the parameter, wherein:

the second audio signal is associated with an interaction of the first audio signal with the object having the parameter in the mixed reality environment, and

the second audio signal is determined further based on the interaction; and

presenting, via a speaker of the wearable head device, the second audio signal.

2. The method of claim 1 , wherein the first audio signal corresponds to a signal path that intersects the object in the mixed reality environment.

3. The method of claim 1 , further comprising identifying, via the one or more sensors, a listener position in the mixed reality environment, wherein the second audio signal is presented to the listener.

4. The method of claim 1 , wherein said identifying the object comprises identifying a real object.

5. The method of claim 1 , wherein said identifying the object comprises using the one or sensors to determine a position of the object in the mixed reality environment.

6. The method of claim 1 , wherein said identifying the object comprises identifying a virtual object.

7. The method of claim 1 , wherein the second audio signal is determined further in accordance with a determination that the first audio signal corresponds to a signal path that intersects the object in the mixed reality environment.

8. The method of claim 1 , wherein the parameter is further associated with an attenuation.

9. The method of claim 1 , wherein the parameter is associated with a reverb.

10. The method of claim 1 , wherein the one or more sensors comprises a camera.

11. The method of claim 1 , wherein said determining the second audio signal comprises applying at least one of a filter and an attenuation to the first audio signal.

12. The method of claim 1 , wherein the interaction comprises a physical interaction between the first audio signal and the object.

13. A wearable head device comprising:

a speaker;

one or more sensors; and

one or more processors configured to perform a method comprising:

identifying a virtual sound source in the mixed reality environment;

identifying an object in the mixed reality environment;

determining, via the one or more sensors, a parameter of the object, wherein the parameter of the object is associated with at least one of a filtering, a phase shift, a delay, and a modulation;

determining a first audio signal in the mixed reality environment, wherein the first audio signal is associated with the virtual sound source;

determining a second audio signal based on the first audio signal and based further on the parameter, wherein:

the second audio signal is associated with an interaction of the first audio signal with the object having the parameter in the mixed reality environment, and

the second audio signal is determined further based on the interaction; and

presenting, via the speaker, the second audio signal.

14. The wearable head device of claim 13 , wherein the first audio signal corresponds to a signal path that intersects the object in the mixed reality environment.

15. The wearable head device of claim 13 , wherein said identifying the object comprises identifying a real object.

16. The wearable head device of claim 13 , wherein said identifying the object comprises identifying a virtual object.

17. The wearable head device of claim 13 , wherein the parameter is further associated an attenuation.

18. The wearable head device of claim 13 , wherein the one or more sensors comprises a camera.

19. The wearable head device of claim 13 , wherein the interaction comprises a physical interaction between the first audio signal and the object.

20. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

identifying a virtual sound source in the mixed reality environment;

identifying an object in the mixed reality environment;

determining, via one or more sensors of a wearable head device, a parameter of the object, wherein the parameter of the object is associated with at least one of a filtering, a phase shift, a delay, and a modulation;

determining a first audio signal in the mixed reality environment, wherein the first audio signal is associated with the virtual sound source;

determining a second audio signal based on the first audio signal and based further on the parameter, wherein:

the second audio signal is associated with an interaction of the first audio signal with the object having the parameter in the mixed reality environment, and

the second audio signal is determined further based on the interaction; and

presenting, via a speaker of the wearable head device, the second audio signal.