Method and system for spatial audio metering using extended reality devices
Provided herein are system, method, and computer program product embodiments for providing an interactive visual representation of loudspeaker sound coverage in a venue. An embodiment enables temporal, spectral, and spatial audio metering from digital audio to venue acoustics. This technology can visualize audio capabilities of one or more loudspeaker arrays using light to provide visualization grouping of large audio channel outputs. This can allow spatial information to be visually represented by mapping directional sound to light beams.
1 . A computer-implemented method, comprising:
generating, by a user device, a graphical user interface (GUI) comprising virtual graphical elements configured to indicate at least one of a temporal property, a spectral property, or a spatial property of one or more sound sources;
receiving, at the user device via the GUI, a user input that sets one or more parameters, characteristics, or attributes of the one or more sound sources;
in response to receiving the user input, displaying, by the user device, a first projection of visible light beams configured to illustrate coverage areas of corresponding acoustic waves generated by the one or more sound sources, wherein the coverage areas include at least one of a gap or an overlap in coverage;
receiving, at the user device via the GUI, a modification input that adjusts the one or more parameters, characteristics, or attributes of the one or more sound sources such that a coverage modification of the gap or the overlap occurs;
in response to receiving the modification input, displaying, by the user device, a second projection of the visible light beams configured to illustrate the coverage modification of the gap or the overlap; and
updating, by the user device, the virtual graphical elements of the GUI to reflect the modification input.
2 . The computer-implemented method of claim 1 , wherein the generating the GUI comprises generating the virtual graphical elements comprising at least one of a loudness meter, a decibel value, a frequency meter, an equalization control, or a spatial indicator.
3 . The computer-implemented method of claim 1 , wherein the displaying the second projection of the visible light beams comprises displaying a visualization of the coverage modification that fills the gap or eliminates the overlap.
4 . The computer-implemented method of claim 1 , wherein the generating the GUI comprises generating the virtual graphical elements as an overlay over real-world elements of a venue.
5 . The computer-implemented method of claim 1 , wherein the receiving the user input comprises receiving at least one of a first gesture input, a first voice input, or a first physical input at the user device; and
wherein the receiving the modification input comprises receiving at least one of a second gesture input, a second voice input, or a second physical input at the user device.
6 . The computer-implemented method of claim 1 , further comprising:
receiving, at the user device, measurement information of the acoustic waves detected by a microphone; and
updating, by the user device, the virtual graphical elements based on the measurement information;
wherein the receiving the modification input occurs in response to the displaying the first projection or the updating the virtual graphical elements based on the measurement information.
7 . The computer-implemented method of claim 6 , wherein the receiving the measurement information comprises receiving at least one of a measured sound pressure level, a measured frequency response, or a measured coverage of the acoustic waves detected by the microphone.
8 . A processing device, comprising:
a memory configured to store instructions; and
a processor configured to execute the instructions stored in the memory such that the instructions cause the processor to perform operations comprising:
generating, by a user device, a graphical user interface (GUI) comprising virtual graphical elements configured to indicate at least one of a temporal property, a spectral property, or a spatial property of one or more sound sources;
receiving, at the user device via the GUI, a user input that sets one or more parameters, characteristics, or attributes of the one or more sound sources;
in response to receiving the user input, displaying, by the user device, a first projection of visible light beams configured to illustrate coverage areas of corresponding acoustic waves generated by the one or more sound sources, wherein the coverage areas include at least one of a gap or an overlap in coverage;
receiving, at the user device via the GUI, a modification input that adjusts the one or more parameters, characteristics, or attributes of the one or more sound sources such that a coverage modification of the gap or the overlap occurs;
in response to receiving the modification input, displaying, by the user device, a second projection of the visible light beams configured to illustrate the coverage modification of the gap or the overlap; and
updating, by the user device, the virtual graphical elements of the GUI to reflect the modification input.
9 . The processing device of claim 8 , wherein the generating the GUI comprises generating the virtual graphical elements comprising at least one of a loudness meter, a decibel value, a frequency meter, an equalization control, or a spatial indicator.
10 . The processing device of claim 8 , wherein the displaying the second projection of the visible light beams comprises displaying a visualization of the coverage modification that fills the gap or eliminates the overlap.
11 . The processing device of claim 8 , wherein the generating the GUI comprises generating the virtual graphical elements as an overlay over real-world elements of a venue.
12 . The processing device of claim 8 , wherein the receiving the user input comprises receiving at least one of a first gesture input, a first voice input, or a first physical input at the user device; and
wherein the receiving the modification input comprises receiving at least one of a second gesture input, a second voice input, or a second physical input at the user device.
13 . The processing device of claim 8 , wherein the operations further comprise:
receiving, at the user device, measurement information of the acoustic waves detected by a microphone; and
updating, by the user device, the virtual graphical elements based on the measurement information;
wherein the receiving the modification input occurs in response to the displaying the first projection or the updating the virtual graphical elements based on the measurement information.
14 . The processing device of claim 13 , wherein the receiving the measurement information comprises receiving at least one of a measured sound pressure level, a measured frequency response, or a measured coverage of the acoustic waves detected by the microphone.
15 . A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, causes the at least one computing device to perform operations comprising:
generating, by a user device, a graphical user interface (GUI) comprising virtual graphical elements configured to indicate at least one of a temporal property, a spectral property, or a spatial property of one or more sound sources;
receiving, at the user device via the GUI, a user input that sets one or more parameters, characteristics, or attributes of the one or more sound sources;
in response to receiving the user input, displaying, by the user device, a first projection of visible light beams configured to illustrate coverage areas of corresponding acoustic waves generated by the one or more sound sources, wherein the coverage areas include at least one of a gap or an overlap in coverage;
receiving, at the user device via the GUI, a modification input that adjusts the one or more parameters, characteristics, or attributes of the one or more sound sources such that a coverage modification of the gap or the overlap occurs;
in response to receiving the modification input, displaying, by the user device, a second projection of the visible light beams configured to illustrate the coverage modification of the gap or the overlap; and
updating, by the user device, the virtual graphical elements of the GUI to reflect the modification input.
16 . The non-transitory computer-readable device of claim 15 , wherein the generating the GUI comprises generating the virtual graphical elements comprising at least one of a loudness meter, a decibel value, a frequency meter, an equalization control, or a spatial indicator.
17 . The non-transitory computer-readable device of claim 15 , wherein the displaying the second projection of the visible light beams comprises displaying a visualization of the coverage modification that fills the gap or eliminates the overlap.
18 . The non-transitory computer-readable device of claim 15 , wherein the generating the GUI comprises generating the virtual graphical elements as an overlay over real-world elements of a venue.
19 . The non-transitory computer-readable device of claim 15 , wherein the receiving the user input comprises receiving at least one of a first gesture input, a first voice input, or a first physical input at the user device; and
wherein the receiving the modification input comprises receiving at least one of a second gesture input, a second voice input, or a second physical input at the user device.
20 . The non-transitory computer-readable device of claim 15 , wherein the operations further comprise:
receiving, at the user device, measurement information of the acoustic waves detected by a microphone; and
updating, by the user device, the virtual graphical elements based on the measurement information;
wherein the receiving the modification input occurs in response to the displaying the first projection or the updating the virtual graphical elements based on the measurement information; and
wherein the measurement information comprises at least one of a measured sound pressure level, a measured frequency response, or a measured coverage of the acoustic waves detected by the microphone.