IP Library Granted Patent US 12,143,660
Granted Patent B2
US 12,143,660 · App. 18/471,071 · Granted Nov 12, 2024

Mixed reality virtual reverberation

Inventors: Anastasia Andreyevna Tajik (Fort Lauderdale, FL); Jean-Marc Jot (Aptos, CA)
Assignee: Magic Leap, Inc.
H04N21/42203G06F3/165H04N21/439H04N21/816H04R5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,143,660
App. No.
18/471,071
Granted
Nov 12, 2024
Kind
B2
Abstract

A method of presenting an audio signal to a user of a mixed reality environment is disclosed, the method comprising the steps of detecting a first audio signal in the mixed reality environment, where the first audio signal is a real audio signal; identifying a virtual object intersected by the first audio signal in the mixed reality environment; identifying a listener coordinate associated with the user; determining, using the virtual object and the listener coordinate, a transfer function; applying the transfer function to the first audio signal to produce a second audio signal; and presenting, to the user, the second audio signal.

Claims (45)

1. A method of presenting an audio signal to a user of a mixed reality environment, the method comprising:

identifying a first audio signal in the mixed reality environment;

identifying a virtual object intersected by the first audio signal in the mixed reality environment;

identifying, via one or more sensors of a wearable head device, a position of the user in the mixed reality environment;

identifying, based on the position of the user, a listener coordinate associated with the user;

determining, based on the virtual object and based further on the listener coordinate, a transfer function;

generating a second audio signal based on the first audio signal and based further on the transfer function; and

presenting, to the user, the second audio signal.

2. The method of claim 1 , wherein said identifying the first audio signal comprises detecting a voice signal generated by the user.

3. The method of claim 1 , further comprising identifying, via the one or more sensors, an orientation of the user in the mixed reality environment, wherein the transfer function is determined based further on the orientation of the user.

4. The method of claim 1 , further comprising determining an angle at which the first audio signal intersects the virtual object, wherein the transfer function is determined based further on the angle.

5. The method of claim 1 , wherein the first audio signal comprises a virtual audio signal.

6. The method of claim 1 , further comprising determining an origin and a direction of the second audio signal in the mixed reality environment, wherein the transfer function is determined based further on the origin and the direction of the second audio signal.

7. The method of claim 1 , further comprising presenting, to the user via a see-through display of the wearable head device, the virtual object.

8. A system comprising:

a wearable head device including a see-through display configured to present a mixed reality environment to a user;

a speaker;

one or more sensors; and

one or more processors configured to perform a method comprising:

identifying a first audio signal in the mixed reality environment;

identifying a virtual object intersected by the first audio signal in the mixed reality environment;

identifying, via the one or more sensors, a position of the user in the mixed reality environment;

identifying, based on the position of the user, a listener coordinate associated with the user;

determining, based on the virtual object and based further on the listener coordinate, a transfer function;

generating a second audio signal based on the first audio signal and based further on the transfer function; and

presenting, to the user via the speaker, the second audio signal.

9. The system of claim 8 , wherein the system further comprises a microphone and wherein said identifying the first audio signal comprises detecting, via the microphone, a voice signal generated by the user.

10. The system of claim 8 , wherein the method further comprises identifying, via the one or more sensors, an orientation of the user in the mixed reality environment, wherein the transfer function is determined based further on the orientation of the user.

11. The system of claim 8 , wherein the method further comprises determining an angle at which the first audio signal intersects the virtual object, wherein the transfer function is determined based further on the angle.

12. The system of claim 8 , wherein the first audio signal comprises a virtual audio signal.

13. The system of claim 8 , wherein the method further comprises determining an origin and a direction of the second audio signal in the mixed reality environment, wherein the transfer function is determined based further on the origin and the direction of the second audio signal.

14. The system of claim 8 , wherein the method further comprises presenting, to the user via the see-through display, the virtual object.

15. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:

identifying a first audio signal in a mixed reality environment;

identifying a virtual object intersected by the first audio signal in the mixed reality environment;

identifying, via one or more sensors of a wearable head device, a position of a user in the mixed reality environment;

identifying, based on the position of the user, a listener coordinate associated with the user;

determining, based on the virtual object and based further on the listener coordinate, a transfer function;

generating a second audio signal based on the first audio signal and based further on the transfer function; and

presenting, to the user, the second audio signal.

16. The non-transitory computer-readable medium of claim 15 , wherein said identifying the first audio signal comprises detecting a voice signal generated by the user.

17. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises identifying, via the one or more sensors, an orientation of the user in the mixed reality environment, wherein the transfer function is determined based further on the orientation of the user.

18. The non-transitory computer-readable medium of claim 15 , wherein the first audio signal comprises a virtual audio signal.

19. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises determining an origin and a direction of the second audio signal in the mixed reality environment, wherein the transfer function is determined based further on the origin and the direction of the second audio signal.

20. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises presenting, to the user via a see-through display of the wearable head device, the virtual object.

Assignments (3)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073430/0225 →
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073031/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2024
From: TAJIK, ANASTASIA ANDREYEVNA; JOT, JEAN-MARC
To: MAGIC LEAP, INC.
Reel/Frame 068838/0445 →