MAPPING OF ENVIROMENTAL AUDIO RESPONSE ON MIXED REALITY DEVICE
This disclosure relates in general to augmented reality (AR), mixed reality (MR), or extended reality (XR) environmental mapping. Specifically, this disclosure relates to AR, MR, or XR audio mapping in an AR, MR, or XR environment. In some embodiments, the disclosed systems and methods allow the environment to be mapped based on a recording. In some embodiments, the audio mapping information is associated to voxels located in the environment.
1 . A method comprising:
receiving an audio signal;
determining whether the audio signal meets a requirement for an audio mapping of an environment, wherein the requirement comprises at least one of a minimum signal-to-noise (SNR) constraint, a signal duration constraint, a collocation constraint, an omnidirectional constraint, and an impulsive signal constraint;
in accordance with a determination that the requirement is met, performing said audio mapping; and
in accordance with a determination that the requirement is not met, forgoing performing said audio mapping.
2 . The method of claim 1 , wherein the determining whether the minimum SNR constraint is met comprises determining whether a signal level exceeds a threshold value.
3 . The method of claim 1 , wherein the determining whether the signal duration constraint is met comprises determining whether a signal level exceeds a threshold value for at least a threshold duration of time.
4 . The method of claim 1 , wherein the determining whether the collocation constraint is met comprises:
determining whether a source of the signal is within a threshold distance of a location of the receipt of the signal.
5 . The method of claim 1 , wherein the determining whether the collocation constraint is met comprises applying a voice activated detection (VAD) process based on the signal.
6 . The method of claim 1 , wherein the determining whether the omnidirectional constraint is met comprises determining whether a source of the signal comprises an omnidirectional source.
7 . The method of claim 1 , wherein the determining whether the omnidirectional constraint is met comprises determining one or more of a radiation pattern for a source of the signal and an orientation for the source of the signal.
8 . The method of claim 1 , wherein the determining whether the omnidirectional constraint is met comprises applying a VAD process based on the signal.
9 . The method of claim 1 , wherein the determining the impulse constraint is met comprises determining whether the signal comprises one or more of an instantaneous signal, an impulse signal, and a transient signal.
10 . The method of claim 1 , wherein the determining whether the impulse constraint is met comprises applying a dual envelope follower based on the signal.
11 . The method of claim 1 , further comprising:
determining the impulse constraint is not met; and
in accordance with the determination that the impulse constraint is not met:
converting the signal into a clean input stream; and
comparing the clean input stream with the signal.
12 . A method comprising:
receiving a signal;
filtering the signal, wherein filtering the signal comprises separating the signal into a plurality of sub-bands; and
for a sub-band of the sub-bands:
identifying a peak of the signal;
identifying a decay of the signal;
based on the peak, the decay, or both the peak and the decay:
determining a decay time; and
determining a reverberation gain.
13 . A method comprising:
receiving a signal;
generating a direct path signal;
deconvolving the signal based on the direct path signal;
based on said deconvolving:
determining a decay time; and
determining a reverberation gain.
14 . A method comprising: associating one or more portions of an audio mapping of an environment to a plurality of voxels located in the environment, wherein:
each portion comprises an audio response property associated with a location of a respective voxel in the environment.
15 . A system comprising: one or more processors configured to perform a method comprising:
receiving an audio signal;
determining whether the audio signal meets a requirement for an audio mapping of an environment, wherein the requirement comprises at least one of a minimum signal-to-noise (SNR) constraint, a signal duration constraint, a collocation constraint, an omnidirectional constraint, and an impulsive signal constraint;
in accordance with a determination that the requirement is met, performing said audio mapping; and
in accordance with a determination that the requirement is not met, forgoing performing said audio mapping.
16 . A non-transitory computer-readable medium storing one or more instructions, which, when executed by one or more processors of an electronic device, cause the device to perform a method comprising:
receiving an audio signal;
determining whether the audio signal meets a requirement for an audio mapping of an environment, wherein the requirement comprises at least one of a minimum signal-to-noise (SNR) constraint, a signal duration constraint, a collocation constraint, an omnidirectional constraint, and an impulsive signal constraint;
in accordance with a determination that the requirement is met, performing said audio mapping; and
in accordance with a determination that the requirement is not met, forgoing performing said audio mapping.
17 . The system of claim 15 , wherein the determining whether the minimum SNR constraint is met comprises determining whether a signal level exceeds a threshold value.
18 . The system of claim 15 , wherein the determining whether the signal duration constraint is met comprises determining whether a signal level exceeds a threshold value for at least a threshold duration of time.
19 . The system of claim 15 , wherein the determining whether the collocation constraint is met comprises:
determining whether a source of the signal is within a threshold distance of a location of the receipt of the signal.
20 . The system of claim 15 , wherein the determining whether the collocation constraint is met comprises applying a voice activated detection (VAD) process based on the signal.