IP Library Granted Patent US 11,696,087
Granted Patent B2
US 11,696,087 · App. 17/900,709 · Granted Jul 4, 2023

Emphasis for audio spatialization

Inventor: Samuel Charles Dicker (San Francisco, CA)
Assignee: Magic Leap, Inc.
H04S7/304H04R3/04H04R5/033H04R5/04H04S3/008H04S7/307H04S2400/01H04S2400/11H04S2400/13H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,696,087
App. No.
17/900,709
Granted
Jul 4, 2023
Kind
B2
Abstract

Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. According to an example method, a first input audio signal is received. The first input audio signal is processed to generate a first output audio signal. The first output audio signal is presented via one or more speakers associated with the wearable head device. Processing the first input audio signal comprises applying a pre-emphasis filter to the first input audio signal; adjusting a gain of the first input audio signal; and applying a de-emphasis filter to the first audio signal. Applying the pre-emphasis filter to the first input audio signal comprises attenuating a low frequency component of the first input audio signal. Applying the de-emphasis filter to the first input audio signal comprises attenuating a high frequency component of the first input audio signal.

Claims (91)

1. A method of presenting an audio signal to a user of a wearable head device, the method comprising:

receiving a first input audio signal, the first input audio signal associated with a virtual environment presented on a display of the wearable head device;

processing the first input audio signal to generate a first output audio signal, the first output audio signal associated with the virtual environment, wherein processing the first input audio signal comprises:

applying one or more of a pre-emphasis filter and a de-emphasis filter to the first input audio signal; and

adjusting a gain of the first input audio signal; and

presenting the first output audio signal via one or more speakers associated with the wearable head device,

wherein:

applying the pre-emphasis filter to the first input audio signal comprises attenuating a first frequency component of the first input audio signal,

applying the de-emphasis filter to the first input audio signal comprises attenuating a second frequency component of the first input audio signal, the second frequency higher than the first frequency, and

one or more of the first frequency component and the second frequency component is associated with a sonic artifact caused by a control signal change associated with the virtual environment.

2. The method of claim 1 , further comprising receiving a second input audio signal, wherein:

said processing the first input audio signal to generate the first output audio signal further comprises mixing, via a mixer, the first input audio signal with the second input audio signal.

3. The method of claim 1 , wherein said presenting the first output audio signal via one or more speakers of the wearable head device comprises:

applying a first head-related transfer function (HRTF) to the first output audio signal;

presenting the output of the first HRTF to a left speaker of the one or more speakers of the wearable head device;

applying a second HRTF to the first output audio signal; and

presenting the output of the second HRTF to a right speaker of the one or more speakers of the wearable head device.

4. The method of claim 1 , wherein said processing the first input audio signal to generate the first output audio signal further comprises:

applying an output of the pre-emphasis filter to an input of one or more filters;

panning a first output of the one or more filters to generate a first panned signal, a second panned signal, a third panned signal, and a fourth panned signal;

applying the first panned signal to a left bus;

applying the second panned signal to a right bus;

applying the third panned signal to a standard bus;

applying the fourth panned signal to a diffuse bus;

applying the left bus, the right bus, the standard bus, and the diffuse bus as input to a virtualizer; and

applying the de-emphasis filter to an output of the virtualizer.

5. The method of claim 4 , wherein said processing the first input audio signal to generate the first output audio signal further comprises applying a second output of the one or more filters as input to a clustered reflections module, and applying an output of the clustered reflections module to the standard bus.

6. The method of claim 4 , wherein said processing the first input audio signal to generate the first output audio signal further comprises applying a second output of the one or more filters as input to a reverb module, and applying an output of the reverb module to the standard bus.

7. The method of claim 4 , wherein the one or more filters comprises one or more of a distance filter, an air absorption filter, a source directivity filter, an occlusion filter, and an obstruction filter.

8. A system comprising:

a wearable head device comprising a display;

one or more speakers; and

one or more processors configured to perform a method comprising:

receiving a first input audio signal, the first input audio signal associated with a virtual environment presented on the display of the wearable head device;

processing the first input audio signal to generate a first output audio signal, the first output audio signal associated with the virtual environment, wherein processing the first input audio signal comprises:

applying one or more of a pre-emphasis filter and a de-emphasis filter to the first input audio signal; and

adjusting a gain of the first input audio signal; and

presenting the first output audio signal via the one or more speakers,

wherein:

applying the pre-emphasis filter to the first input audio signal comprises attenuating a first frequency component of the first input audio signal,

applying the de-emphasis filter to the first input audio signal comprises attenuating a second frequency component of the first input audio signal, the second frequency higher than the first frequency, and

one or more of the first frequency component and the second frequency component is associated with a sonic artifact caused by a control signal change associated with the virtual environment.

9. The system of claim 8 , wherein:

the method further comprises receiving a second input audio signal; and

said processing the first input audio signal to generate the first output audio signal further comprises mixing, via a mixer, the first input audio signal with the second input audio signal.

10. The system of claim 8 , wherein said presenting the first output audio signal via the one or more speakers comprises:

applying a first HRTF to the first output audio signal;

presenting the output of the first HRTF to a left speaker of the one or more speakers;

applying a second HRTF to the first output audio signal; and

presenting the output of the second HRTF to a right speaker of the one or more speakers.

11. The system of claim 8 , wherein said processing the first input audio signal to generate the first output audio signal further comprises:

applying an output of the pre-emphasis filter to an input of one or more filters;

panning a first output of the one or more filters to generate a first panned signal, a second panned signal, a third panned signal, and a fourth panned signal;

applying the first panned signal to a left bus;

applying the second panned signal to a right bus;

applying the third panned signal to a standard bus;

applying the fourth panned signal to a diffuse bus;

applying the left bus, the right bus, the standard bus, and the diffuse bus as input to a virtualizer; and

applying the de-emphasis filter to an output of the virtualizer.

12. The system of claim 11 , wherein said processing the first input audio signal to generate the first output audio signal further comprises applying a second output of the one or more filters as input to a clustered reflections module, and applying an output of the clustered reflections module to the standard bus.

13. The system of claim 11 , wherein said processing the first input audio signal to generate the first output audio signal further comprises applying a second output of the one or more filters as input to a reverb module, and applying an output of the reverb module to the standard bus.

14. The system of claim 11 , wherein the one or more filters comprises one or more of a distance filter, an air absorption filter, a source directivity filter, an occlusion filter, and an obstruction filter.

15. A non-transitory computer-readable medium storing instructions, which when executed by one or more processors, cause the one or more processors to perform a method of presenting an audio signal to a user of a wearable head device, the method comprising:

receiving a first input audio signal, the first input audio signal associated with a virtual environment presented on a display of the wearable head device;

processing the first input audio signal to generate a first output audio signal, the first output audio signal associated with the virtual environment, wherein processing the first input audio signal comprises:

applying one or more of a pre-emphasis filter and a de-emphasis filter to the first input audio signal; and

adjusting a gain of the first input audio signal; and

presenting the first output audio signal via one or more speakers associated with the wearable head device,

wherein:

applying the pre-emphasis filter to the first input audio signal comprises attenuating a first frequency component of the first input audio signal,

applying the de-emphasis filter to the first input audio signal comprises attenuating a second frequency component of the first input audio signal, the second frequency higher than the first frequency, and

one or more of the first frequency component and the second frequency component is associated with a sonic artifact caused by a control signal change associated with the virtual environment.

16. The non-transitory computer-readable medium of claim 15 , wherein:

the method further comprises receiving a second input audio signal; and

said processing the first input audio signal to generate the first output audio signal further comprises mixing, via a mixer, the first input audio signal with the second input audio signal.

17. The non-transitory computer-readable medium of claim 15 , wherein said presenting the first output audio signal via one or more speakers of the wearable head device comprises:

applying a first HRTF to the first output audio signal;

presenting the output of the first HRTF to a left speaker of the one or more speakers of the wearable head device;

applying a second HRTF to the first output audio signal; and

presenting the output of the second HRTF to a right speaker of the one or more speakers of the wearable head device.

18. The non-transitory computer-readable medium of claim 15 , wherein said processing the first input audio signal to generate the first output audio signal further comprises:

applying an output of the pre-emphasis filter to an input of one or more filters;

panning a first output of the one or more filters to generate a first panned signal, a second panned signal, a third panned signal, and a fourth panned signal;

applying the first panned signal to a left bus;

applying the second panned signal to a right bus;

applying the third panned signal to a standard bus;

applying the fourth panned signal to a diffuse bus;

applying the left bus, the right bus, the standard bus, and the diffuse bus as input to a virtualizer; and

applying the de-emphasis filter to an output of the virtualizer.

19. The non-transitory computer-readable medium of claim 18 , wherein said processing the first input audio signal to generate the first output audio signal further comprises applying a second output of the one or more filters as input to a reverb module, and applying an output of the reverb module to the standard bus.

20. The non-transitory computer-readable medium of claim 18 , wherein the one or more filters comprises one or more of a distance filter, an air absorption filter, a source directivity filter, an occlusion filter, and an obstruction filter.

Assignments (3)
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: DICKER, SAMUEL CHARLES
To: MAGIC LEAP, INC.
Reel/Frame 064407/0090 →
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →