IP Library Granted Patent US 11,956,620
Granted Patent B2
US 11,956,620 · App. 18/340,744 · Granted Apr 9, 2024

Dual listener positions for mixed reality

Inventor: Anastasia Andreyevna Tajik (Fort Lauderdale, FL)
Assignee: Magic Leap, Inc.
H04S7/303G02B27/0101G02B27/0172G06T19/006H04R1/403H04R3/12G02B2027/0138H04R2430/20H04R2499/15H04S2400/11H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,956,620
App. No.
18/340,744
Granted
Apr 9, 2024
Kind
B2
Abstract

A method of presenting audio comprises: identifying a first ear listener position and a second ear listener position in a mixed reality environment; identifying a first virtual sound source in the mixed reality environment; identifying a first object in the mixed reality environment; determining a first audio signal in the mixed reality environment, wherein the first audio signal originates at the first virtual sound source and intersects the first ear listener position; determining a second audio signal in the mixed reality environment, wherein the second audio signal originates at the first virtual sound source, intersects the first object, and intersects the second ear listener position; determining a third audio signal based on the second audio signal and the first object; presenting, to a first ear of a user, the first audio signal; and presenting, to a second ear of the user, the third audio signal.

Claims (56)

1. A method comprising:

determining, via a sensor, a listener position in a mixed reality environment;

identifying a virtual sound source in the mixed reality environment;

identifying an object in the mixed reality environment;

determining a first audio signal in the mixed reality environment, wherein the first audio signal originates at the virtual sound source and intersects the listener position;

in accordance with a determination that the first audio signal intersects the object:

determining a second audio signal based on the first audio signal and the object; and

presenting, via a speaker to an ear of a user, the second audio signal; and

in accordance with a determination that the first audio signal does not intersect the object:

forgoing determining the second audio signal; and

presenting, via the speaker to the ear of the user, the first audio signal.

2. The method of claim 1 , wherein a wearable head device comprises the sensor.

3. The method of claim 1 , wherein the sensor comprises an inertial measurement unit.

4. The method of claim 1 , wherein the sensor comprises a camera.

5. The method of claim 1 , wherein the listener position in the mixed reality environment is determined further via a second sensor.

6. The method of claim 1 , wherein:

the object is associated with a property, and

the second audio signal is determined further based on the property.

7. The method of claim 6 , wherein the property is associated with at least one of an attenuation, a filtering, a phase shift, a delay, a reverb, and a modulation.

8. The method of claim 1 , wherein the determining the second audio signal based on the first audio signal and the object comprises applying at least one of a filter and an attenuation to the first audio signal.

9. The method of claim 1 , wherein the identifying the object comprises identifying a virtual object.

10. The method of claim 1 , wherein the identifying the object comprises identifying a real object.

11. A system comprising:

a speaker;

a sensor; and

one or more processors configured to execute a method comprising:

determining, via the sensor, a listener position in a mixed reality environment;

identifying a virtual sound source in the mixed reality environment;

identifying an object in the mixed reality environment;

determining a first audio signal in the mixed reality environment, wherein the first audio signal originates at the virtual sound source and intersects the listener position;

in accordance with a determination that the first audio signal intersects the object:

determining a second audio signal based on the first audio signal and the object; and

presenting, via the speaker to an ear of a user, the second audio signal; and

in accordance with a determination that the first audio signal does not intersect the object:

forgoing determining the second audio signal; and

presenting, via the speaker to the ear of the user, the first audio signal.

12. The system of claim 11 , further comprising a wearable head device, wherein the wearable head device comprises the sensor.

13. The system of claim 11 , wherein the sensor comprises an inertial measurement unit.

14. The system of claim 11 , wherein the sensor comprises a camera.

15. The system of claim 11 , further comprising a second sensor, wherein the listener position in the mixed reality environment is determined further via the second sensor.

16. The system of claim 11 , wherein:

the object is associated with a property, and

the second audio signal is determined further based on the property.

17. The system of claim 11 , wherein the determining the second audio signal based on the first audio signal and the object comprises applying at least one of a filter and an attenuation to the first audio signal.

18. The system of claim 11 , wherein the identifying the object comprises identifying a virtual object.

19. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:

determining, via a sensor, a listener position in a mixed reality environment;

identifying a virtual sound source in the mixed reality environment;

identifying an object in the mixed reality environment;

determining a first audio signal in the mixed reality environment, wherein the first audio signal originates at the virtual sound source and intersects the listener position;

in accordance with a determination that the first audio signal intersects the object:

determining a second audio signal based on the first audio signal and the object; and

presenting, via a speaker to an ear of a user, the second audio signal; and

in accordance with a determination that the first audio signal does not intersect the object:

forgoing determining the second audio signal; and

presenting, via the speaker to the ear of the user, the first audio signal.

Assignments (3)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2024
From: TAJIK, ANASTASIA ANDREYEVNA
To: MAGIC LEAP, INC.
Reel/Frame 066313/0955 →