IP Library Granted Patent US 12,156,016
Granted Patent B2
US 12,156,016 · App. 18/449,624 · Granted Nov 26, 2024

Spatial audio for interactive audio environments

Inventors: Remi Samuel Audfray (San Francisco, CA); Jean-Marc Jot (Aptos, CA); Samuel Charles Dicker (Plantation, FL)
Assignee: Magic Leap, Inc.
H04S7/304G02B27/017G10K15/10H04R3/04H04R3/12H04R5/033H04R5/04H04S3/008H04S7/305G02B2027/0178H04R2499/15H04S2400/01H04S2400/13H04S2400/15H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,156,016
App. No.
18/449,624
Granted
Nov 26, 2024
Kind
B2
Abstract

Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. A first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the sound source in the virtual environment, and the first intermediate audio signal is associated with a first bus. A second intermediate audio signal is determined. The second intermediate audio signal corresponds to a reverberation of the input audio signal in the virtual environment. The second intermediate audio signal is determined based on a location of the sound source, and further based on an acoustic property of the virtual environment. The second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first and second buses.

Claims (46)

1. A method comprising:

determining, based on a location of a sound source and further based on an acoustic property of an environment, an intermediate audio signal, the intermediate audio signal comprising a reverberation of an input audio signal in the environment;

associating the intermediate audio signal with a bus;

adjusting a gain of the bus based on the location of the sound source; and

presenting, to a listener via the bus, an output audio signal comprising the reverberation of the input audio signal,

wherein:

the acoustic property of the environment is determined based on a feature of the environment, and

the feature is determined based on information received via one or more sensors.

2. The method of claim 1 , further comprising receiving the acoustic property.

3. The method of claim 1 , wherein the one or more sensors comprise one or more microphones.

4. The method of claim 1 , wherein the one or more sensors comprise one or more cameras.

5. The method of claim 1 , wherein the one or more sensors comprise a first sensor of a first type and a second sensor of a second type different from the first type.

6. The method of claim 1 , wherein the acoustic property is stored in a database.

7. The method of claim 1 , wherein the intermediate audio signal is determined further based on a location of the listener.

8. The method of claim 7 , wherein the location of the listener is determined via one or more second sensors.

9. The method of claim 1 , wherein the acoustic property is determined via a first device, and the intermediate audio signal is determined via a second device different from the first device.

10. The method of claim 1 , wherein the information received via one or more sensors comprises a location of the one or more sensors in the environment.

11. The method of claim 1 , wherein the acoustic property is associated with a location in the environment.

12. The method of claim 1 , wherein the determining the acoustic property comprises updating a stored acoustic property.

13. The method of claim 1 , wherein the feature comprises a geometry of the environment.

14. The method of claim 1 , wherein the gain of the bus is adjusted in accordance with a determination that a distance between the location of the sound source and the listener is greater than a minimum distance associated with the sound source.

15. A system comprising:

one or more processors; and

one or more sensors, wherein the one or more processors configured to perform a method comprising:

determining, based on a location of a sound source and further based on an acoustic property of an environment, an intermediate audio signal, the intermediate audio signal comprising a reverberation of an input audio signal in the environment;

associating the intermediate audio signal with a bus;

adjusting a gain of the bus based on the location of the sound source; and

presenting, to a listener via the bus, an output audio signal comprising the reverberation of the input audio signal,

wherein:

the acoustic property of the environment is determined based on a feature of the environment, and

the feature is determined based on information received via the one or more sensors.

16. The system of claim 15 , wherein the method comprises storing the acoustic property in a database.

17. The system of claim 15 , further comprising one or more second sensors, wherein:

the intermediate audio signal is determined further based on a location of the listener, and

the location of the listener is determined via the one or more second sensors.

18. The system of claim 15 , further comprising a first device and a second device, wherein the acoustic property is determined via the first device, and the intermediate audio signal is determined via the second device different from the first device.

19. The system of claim 15 , wherein the acoustic property is associated with a location in the environment.

20. The system of claim 15 , wherein the feature comprises a geometry of the environment.

21. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:

determining, based on a location of a sound source and further based on an acoustic property of an environment, an intermediate audio signal, the intermediate audio signal comprising a reverberation of an input audio signal in the environment;

associating the intermediate audio signal with a bus;

adjusting a gain of the bus based on the location of the sound source; and

presenting, to a listener via the bus, an output audio signal comprising the reverberation of the input audio signal,

wherein:

the acoustic property of the environment is determined based on a feature of the environment, and

the feature is determined based on information received via one or more sensors.

Assignments (3)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073438/0463 →
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073008/0696 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2024
From: AUDFRAY, REMI SAMUEL; JOT, JEAN-MARC; DICKER, SAMUEL CHARLES
To: MAGIC LEAP, INC.
Reel/Frame 067111/0524 →
Continuity (6)
Continuation 18069702 · Dec 21, 2022
Continuation 17175374 · Feb 12, 2021
Continuation 16905855 · Jun 18, 2020
Continuation 16445163 · Jun 18, 2019
Provisional Application 62686665 · Jun 18, 2018
Related Publication 20230388736A1 · Nov 30, 2023
Cited By (1)
US 12,294,852