IP Library Granted Patent US 11,736,888
Granted Patent B2
US 11,736,888 · App. 18/047,168 · Granted Aug 22, 2023

Dual listener positions for mixed reality

Inventor: Anastasia Andreyevna Tajik (Fort Lauderdale, FL)
Assignee: Magic Leap, Inc.
H04S7/303G02B27/0101G02B27/0172G06T19/006H04R1/403H04R3/12G02B2027/0138H04R2430/20H04R2499/15H04S2400/11H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,736,888
App. No.
18/047,168
Granted
Aug 22, 2023
Kind
B2
Abstract

A method of presenting audio comprises: identifying a first ear listener position and a second ear listener position in a mixed reality environment; identifying a first virtual sound source in the mixed reality environment; identifying a first object in the mixed reality environment; determining a first audio signal in the mixed reality environment, wherein the first audio signal originates at the first virtual sound source and intersects the first ear listener position; determining a second audio signal in the mixed reality environment, wherein the second audio signal originates at the first virtual sound source, intersects the first object, and intersects the second ear listener position; determining a third audio signal based on the second audio signal and the first object; presenting, to a first ear of a user, the first audio signal; and presenting, to a second ear of the user, the third audio signal.

Claims (81)

1. A method of presenting audio signals in a mixed reality environment, the method comprising:

identifying a listener position in the mixed reality environment;

identifying a virtual sound source in the mixed reality environment;

identifying an object in the mixed reality environment, wherein the object is associated with a property;

determining whether the property comprises a first property or a second property;

determining a first audio signal in the mixed reality environment, wherein the first audio signal intersects the object in the mixed reality environment;

in accordance with a determination that the property comprises the first property:

determining a second audio signal based on the first audio signal and based further on the first property; and

presenting, via a speaker to an ear of a user, the second audio signal; and

in accordance with a determination that the property comprises the second property:

determining a third audio signal based on the first audio signal and based further on the second property; and

presenting, via the speaker to the ear of the user, the third audio signal.

2. The method of claim 1 , wherein:

said identifying the object comprises identifying a real object, and

said determining whether the property comprises a first property or a second property comprises determining whether the real object is associated with the first property or the second property.

3. The method of claim 2 , wherein said identifying the real object comprises using a sensor to determine a position of the real object relative to the user in the mixed reality environment.

4. The method of claim 1 , wherein:

said identifying the object comprises identifying a virtual object, and

said determining whether the property comprises a first property or a second property comprises determining whether the virtual object is associated with the first property or the second property.

5. The method of claim 1 , wherein:

the first property is associated with a first magnitude, and

the second property is associated with a second magnitude.

6. The method of claim 5 , wherein:

said determining the second audio signal comprises adjusting the first audio signal based on the first magnitude, and

said determining the third audio signal comprises adjusting first audio signal based on the second magnitude.

7. The method of claim 1 , further comprising:

determining whether the first audio signal intersects the object;

in accordance with a determination that the first audio signal does not intersect the object, presenting, via the speaker to the ear of the user, the first audio signal; and

in accordance with a determination that the first audio signal intersects the object, forgoing presenting the first audio signal.

8. The method of claim 1 , wherein each of the first property and the second property is associated with at least one of an attenuation, a filtering, a phase shift, a delay, a reverb, and a modulation.

9. A system comprising:

a wearable head device comprising a speaker; and

one or more processors configured to execute a method comprising:

identifying a listener position in the mixed reality environment;

identifying a virtual sound source in the mixed reality environment;

identifying an object in the mixed reality environment, wherein the object is associated with a property;

determining whether the property comprises a first property or a second property;

determining a first audio signal in the mixed reality environment, wherein the first audio signal intersects the object in the mixed reality environment;

in accordance with a determination that the property comprises the first property:

determining a second audio signal based on the first audio signal and based further on the first property; and

presenting, via the speaker to an ear of a user, the second audio signal; and

in accordance with a determination that the property comprises the second property:

determining a third audio signal based on the first audio signal and based further on the second property; and

presenting, via the speaker to the ear of the user, the third audio signal.

10. The system of claim 9 , wherein:

said identifying the object comprises identifying a real object, and

said determining whether the property comprises a first property or a second property comprises determining whether the real object is associated with the first property or the second property.

11. The system of claim 10 , wherein the wearable head device comprises a sensor, and said identifying the real object comprises using the sensor to determine a position of the real object relative to the user in the mixed reality environment.

12. The system of claim 9 , wherein:

said identifying the object comprises identifying a virtual object, and

said determining whether the property comprises a first property or a second property comprises determining whether the virtual object is associated with the first property or the second property.

13. The system of claim 9 , wherein:

the first property is associated with a first magnitude, and

the second property is associated with a second magnitude.

14. The system of claim 13 , wherein:

said determining the second audio signal comprises adjusting the first audio signal based on the first magnitude, and

said determining the third audio signal comprises adjusting first audio signal based on the second magnitude.

15. The system of claim 9 , wherein the method further comprises:

determining whether the first audio signal intersects the object;

in accordance with a determination that the first audio signal does not intersect the object, presenting, via the speaker to the ear of the user, the first audio signal; and

in accordance with a determination that the first audio signal intersects the object, forgoing presenting the first audio signal.

16. The system of claim 9 , wherein each of the first property and the second property is associated with at least one of an attenuation, a filtering, a phase shift, a delay, a reverb, and a modulation.

17. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:

identifying a listener position in the mixed reality environment;

identifying a virtual sound source in the mixed reality environment;

identifying an object in the mixed reality environment, wherein the object is associated with a property;

determining whether the property comprises a first property or a second property;

determining a first audio signal in the mixed reality environment, wherein the first audio signal intersects the object in the mixed reality environment;

in accordance with a determination that the property comprises the first property:

determining a second audio signal based on the first audio signal and based further on the first property; and

presenting, via a speaker to an ear of a user, the second audio signal; and

in accordance with a determination that the property comprises the second property:

determining a third audio signal based on the first audio signal and based further on the second property; and

presenting, via the speaker to the ear of the user, the third audio signal.

18. The non-transitory computer-readable medium of claim 17 , wherein:

the first property is associated with a first magnitude, and

the second property is associated with a second magnitude.

19. The non-transitory computer-readable medium of claim 18 , wherein:

said determining the second audio signal comprises adjusting the first audio signal based on the first magnitude, and

said determining the third audio signal comprises adjusting first audio signal based on the second magnitude.

20. The non-transitory computer-readable medium of claim 17 , wherein each of the first property and the second property is associated with at least one of an attenuation, a filtering, a phase shift, a delay, a reverb, and a modulation.

Assignments (3)
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073008/0696 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2023
From: TAJIK, ANASTASIA ANDREYEVNA
To: MAGIC LEAP, INC.
Reel/Frame 064341/0201 →
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →
Continuity (4)
Continuation 17528473 · Nov 17, 2021
Continuation 16970324
Provisional Application 62631422 · Feb 15, 2018
Related Publication 20230065046A1 · Mar 2, 2023
Cited By (2)
US 12,317,062 US 12,342,158