IP Library Granted Patent US 12669974
Granted Patent B1
US 12669974 · App. 18/171,993 · Granted Jun 30, 2026

Systems and methods for creating custom audio mixes for artificial reality environments

Inventors: Colleen Kelly Henry (Oakland, CA); Caitlin O'Callaghan (Pacifica, CA)
Assignee: Meta Platforms Technologies, LLC
G06F3/162G02B27/017G06F3/165
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12669974
App. No.
18/171,993
Granted
Jun 30, 2026
Kind
B1
Abstract

A computer-implemented method for creating custom audio mixes for artificial reality environments may include identifying a plurality of artificial reality devices providing the same artificial reality environment, where each artificial reality device is operated by a different user and, for each artificial reality device, playing a custom audio mix by (i) identifying a first set of audio data to be included in the custom audio mix that includes audio generated by the artificial reality environment, (ii) identifying a second set of audio data to be excluded from the custom audio mix that includes audio input from at least one user, (iii) creating the custom audio mix by including the first set of audio data and excluding the second set of audio data, and (iv) playing the custom audio mix via at least one speaker of the artificial reality device. Various other methods, systems, and computer-readable media are also disclosed.

Claims (52)

1 . A computer-implemented method for comprising:

identifying a plurality of artificial reality devices providing a same artificial reality environment, wherein each artificial reality device is operated by a different user; and

for each artificial reality device in the plurality of artificial reality devices providing the same artificial reality environment, playing a custom audio mix by:

identifying a first set of audio data to be included in the custom audio mix that comprises audio generated at least in part by determining a relative positioning of a virtual object and an avatar of a user of the artificial reality device within the artificial reality environment;

identifying a second set of audio data to be excluded from the custom audio mix that comprises audio input from at least one additional user by determining the relative positioning of the plurality of artificial reality devices by

determining whether the plurality of artificial reality devices are in a line-of-sight via sending infrared pulses between the plurality of artificial reality devices;

creating the custom audio mix by including the first set of audio data and excluding the second set of audio data; and

playing the custom audio mix for the user of the artificial reality device via at least one speaker of the artificial reality device.

2 . The computer-implemented method of claim 1 , wherein the plurality of artificial reality devices comprises a plurality of head-mounted displays.

3 . The computer-implemented method of claim 1 , further comprising spatializing audio corresponding to the virtual object based on the determined relative positioning of the virtual object to the avatar of the user.

4 . The computer-implemented method of claim 1 , wherein identifying the first set of audio data to be included in the custom audio mix that comprises the audio generated by the artificial reality environment comprises identifying ambient audio of the artificial reality environment.

5 . The computer-implemented method of claim 1 , wherein identifying the first set of audio data to be included in the custom audio mix comprises identifying audio produced by the virtual object within the artificial reality environment.

6 . The computer-implemented method of claim 1 , wherein:

determining a relative positioning of the virtual object and the avatar of the user of the artificial reality device within the artificial reality environment comprises

customizing an aspect of an audio produced by the virtual object by scaling a volume of the audio produced by the virtual object based on the relative positioning of the virtual object and the avatar.

7 . The computer-implemented method of claim 1 , wherein identifying the first set of audio data to be included in the custom audio mix comprises:

determining that a remote artificial reality device within the plurality of artificial reality devices is not in the physical location as the artificial reality device; and

including audio input received by the remote artificial reality device in response to determining that the remote artificial reality device is not in the physical location as the artificial reality device.

8 . The computer-implemented method of claim 1 , wherein identifying the second set of audio data to be excluded from the custom audio mix that comprises the audio input from the at least one additional user comprises determining that the at least one additional user is in the physical location as the artificial reality device.

9 . The computer-implemented method of claim 1 , wherein identifying the second set of audio data to be excluded from the custom audio mix that comprises the audio input from the at least one additional user comprises determining the relative positioning of the at least one additional user and the artificial reality device within the physical location.

10 . The computer-implemented method of claim 1 , wherein creating the custom audio mix by including the first set of audio data and excluding the second set of audio data comprises adjusting a volume level of at least one channel of audio data within the first set of audio data.

11 . The computer-implemented method of claim 1 , wherein playing the custom audio mix for the user of the artificial reality device comprises transmitting the custom audio mix to an additional device to be played via at least one speaker of the additional device.

12 . The computer-implemented method of claim 11 , wherein transmitting the custom audio mix to the additional device is in response to detecting that the user of the artificial reality device has switched from operating the artificial reality device to operating the additional device.

13 . A system comprising:

at least one physical processor; and

physical memory comprising computer-executable instructions that, when executed by the physical processor, cause the physical processor to:

identify a plurality of artificial reality devices providing a same artificial reality environment, wherein each artificial reality device is operated by a different user; and

for each artificial reality device in the plurality of artificial reality devices providing the same artificial reality environment, play a custom audio mix by:

identifying a first set of audio data to be included in the custom audio mix that comprises audio generated at least in part by determining a relative positioning of a virtual object and an avatar of a user of the artificial reality device within the artificial reality environment;

identifying a second set of audio data to be excluded from the custom audio mix that comprises audio input from at least one additional user by determining the relative positioning of the plurality of artificial reality devices by

determining whether the plurality of artificial reality devices are in a line-of-sight via sending infrared pulses between the plurality of artificial reality devices;

creating the custom audio mix by including the first set of audio data and excluding the second set of audio data; and

playing the custom audio mix for the user of the artificial reality device via at least one speaker of the artificial reality device.

14 . The system of claim 13 , wherein the plurality of artificial reality devices comprises a plurality of head-mounted displays.

15 . The system of claim 13 , further comprising spatializing audio corresponding to the virtual object based on the determined relative positioning of the virtual object to the avatar of the user.

16 . The system of claim 13 , wherein identifying the first set of audio data to be included in the custom audio mix that comprises the audio generated by the artificial reality environment comprises identifying ambient audio of the artificial reality environment.

17 . The system of claim 13 , wherein identifying the first set of audio data to be included in the custom audio mix comprises identifying audio produced by the virtual object within the artificial reality environment.

18 . The system of claim 13 , wherein:

determining a relative positioning of the virtual object and the avatar of the user of the artificial reality device within the artificial reality environment comprises

customizing an aspect of an audio produced by scaling a volume of the audio produced by the virtual object based on the relative positioning of the virtual object and the avatar.

19 . The system of claim 13 , wherein identifying the first set of audio data to be included in the custom audio mix comprises:

determining that a remote artificial reality device within the plurality of artificial reality devices is not in the physical location as the artificial reality device; and

including audio input received by the remote artificial reality device in response to determining that the remote artificial reality device is not in the physical location as the artificial reality device.

20 . A non-transitory computer-readable medium comprising one or more computer-readable instructions that, when executed by at least one processor of a computing device, cause the computing device to:

identify a plurality of artificial reality devices providing a same artificial reality environment, wherein each artificial reality device is operated by a different user; and

for each artificial reality device in the plurality of artificial reality devices providing the same artificial reality environment, play a custom audio mix by:

identifying a first set of audio data to be included in the custom audio mix that comprises audio generated at least in part by determining a relative positioning of a virtual object and an avatar of a user of the artificial reality device within the artificial reality environment;

identifying a second set of audio data to be excluded from the custom audio mix that comprises audio input from at least one additional user by determining the relative positioning of the plurality of artificial reality devices by

determining whether the plurality of artificial reality devices are in a line-of-sight via sending infrared pulses between the plurality of artificial reality devices;

creating the custom audio mix by including the first set of audio data and excluding the second set of audio data; and

playing the custom audio mix for the user of the artificial reality device via at least one speaker of the artificial reality device;

and by determining a relative positioning of the plurality of artificial reality devices in a physical location.