IP Library › Granted Patent US 12,317,066
Granted Patent B2
US 12,317,066 · App. 18/423,828 · Granted May 27, 2025

Method and system for spatial audio metering using extended reality devices

Inventors: Yuan-Yi Fan (New York, NY); Neil Wakefield (New York, NY)
Assignee: Sphere Entertainment Group, LLC
H04S7/40G06F3/011G06T15/08G06T19/006H04S7/30G06T2219/004H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,317,066
App. No.
18/423,828
Granted
May 27, 2025
Kind
B2
Abstract

Provided herein are system, method, and computer program product embodiments for providing an interactive visual representation of loudspeaker sound coverage in a venue. An embodiment enables temporal, spectral, and spatial audio metering from digital audio to venue acoustics. This technology can visualize audio capabilities of one or more loudspeaker arrays using light to provide visualization grouping of large audio channel outputs. This can allow spatial information to be visually represented by mapping directional sound to light beams.

Claims (40)

1. A method for visually estimating a coverage area of a loudspeaker across a venue, the method comprising:

configuring, by a user device, at least one of a temporal property, a spectral property, or a spatial property of the loudspeaker within the venue to provide a first acoustic wave toward a target area within the venue;

causing, by the user device, a projection of a light beam in a visible spectrum onto the target area that coincides with the first acoustic wave generated by the loudspeaker to visually estimate a first coverage area of the first acoustic wave onto the target area;

measuring, by the user device, the first acoustic wave to identify one or more parameters, characteristics, or attributes of the first acoustic wave generated by the loudspeaker;

in response to the measuring of the first acoustic wave, modifying by the user device, the one or more parameters, characteristics, or attributes of the first acoustic wave to generate a second acoustic wave from the loudspeaker toward the target area within the venue; and

causing, by the user device, the projection of the light beam onto the target area that coincides with the second acoustic wave generated by the loudspeaker to visually estimate a second coverage area of the second acoustic wave onto the target area.

2. The method of claim 1 , wherein the causing the projection of the light beam in the visible spectrum onto the target area that coincides with the first acoustic wave comprises causing the projection of the light beam to be a visualization of a sound distribution type generated by the loudspeaker.

3. The method of claim 1 , wherein the causing the projection of the light beam in the visible spectrum onto the target area that coincides with the first acoustic wave comprises causing the projection of the light beam to be at least one of a geometric shape, an aperture size, or a volume of light that corresponds to the first acoustic wave.

4. The method of claim 1 , wherein the causing the projection of the light beam in the visible spectrum onto the target area that coincides with the first acoustic wave comprises causing the projection of the light beam to be different colors, gradients, saturations, or brightness that corresponds to different audio frequency ranges of the first acoustic wave.

5. The method of claim 1 , wherein the measuring comprises measuring the first acoustic wave using a microphone at the venue.

6. The method of claim 1 , wherein the measuring comprises identifying a signal volume level, a frequency, a range of frequencies, a signal channel, or a spatial coverage area of the first acoustic wave.

7. The method of claim 6 , further comprising displaying one or more indicators related to the signal volume level, the frequency, the range of frequencies, the signal channel, or the spatial coverage area of the first acoustic wave.

8. A processing device for visually estimating a coverage area of a loudspeaker across a venue, the processing device comprising:

a memory configured to store instructions; and

a processor configured to execute the instructions stored in the memory, the instructions, when executed by the processor, configuring the processor to:

configure at least one of a temporal property, a spectral property, or a spatial property of the loudspeaker within the venue to provide a first acoustic wave toward a target area within the venue,

cause a projection of a light beam in a visible spectrum onto the target area that coincides with the first acoustic wave generated by the loudspeaker to visually estimate a first coverage area of the first acoustic wave onto the target area,

measure the first acoustic wave to identify one or more parameters, characteristics, or attributes of the first acoustic wave generated by the loudspeaker,

in response to the measuring of the first acoustic wave, modify the one or more parameters, characteristics, or attributes of the first acoustic wave to generate a second acoustic wave from the loudspeaker toward the target area within the venue, and

cause the projection of the light beam onto the target area that coincides with the second acoustic wave generated by the loudspeaker to visually estimate a second coverage area of the second acoustic wave onto the target area.

9. The processing device of claim 8 , wherein the instructions, when executed by the processor, configure the processor to cause the projection of the light beam to be a visualization of a sound distribution type generated by the loudspeaker.

10. The processing device of claim 8 , wherein the instructions, when executed by the processor, configure the processor to cause the projection of the light beam to be at least one of a geometric shape, an aperture size, or a volume of light that corresponds to the first acoustic wave.

11. The processing device of claim 8 , wherein the instructions, when executed by the processor, configure the processor to cause the projection of the light beam to be different colors, gradients, saturations, or brightness that corresponds to different audio frequency ranges of the first acoustic wave.

12. The processing device of claim 8 , wherein the instructions, when executed by the processor, configure the processor to measure the first acoustic wave using a microphone at the venue.

13. The processing device of claim 8 , wherein the instructions, when executed by the processor, configure the processor to identify a signal volume level, a frequency, a range of frequencies, a signal channel, or a spatial coverage area of the first acoustic wave.

14. The processing device of claim 13 , wherein the instructions, when executed by the processor, further configure the processor to display one or more indicators related to the signal volume level, the frequency, the range of frequencies, the signal channel, or the spatial coverage area of the first acoustic wave.

15. A three-dimensional structure for hosting an event, comprising:

a plurality of loudspeakers configured to provide a plurality of acoustic waves within the three-dimensional structure;

a projector configured to project a light beam in a visible spectrum coinciding with one of the plurality of acoustic waves; and

a processing device configured to:

configure at least one of a temporal property, a spectral property, or a spatial property of a loudspeaker from among the plurality of loudspeakers to provide a first acoustic wave from among the plurality of acoustic waves toward a target area within the three-dimensional structure,

cause the projector to project the light beam onto the target area that coincides with the first acoustic wave generated by the loudspeaker to visually estimate a first coverage area of the first acoustic wave onto the target area,

measure the first acoustic wave to identify one or more parameters, characteristics, or attributes of the first acoustic wave generated by the loudspeaker,

in response to the measuring of the first acoustic wave, modify the one or more parameters, characteristics, or attributes of the first acoustic wave to generate a second acoustic wave from the loudspeaker toward the target area within the three-dimensional structure, and

cause to projector to project the light beam onto the target area that coincides with the second acoustic wave generated by the loudspeaker to visually estimate a second coverage area of the second acoustic wave onto the target area.

16. The three-dimensional structure of claim 15 , wherein the processing device is configured to cause the projector to project the light beam to be a visualization of a sound distribution type generated by the loudspeaker.

17. The three-dimensional structureof claim 15 , wherein the processing device is configured to cause the projector to project the light beam to be at least one of a geometric shape, an aperture size, or a volume of light that corresponds to the first acoustic wave.

18. The three-dimensional structureof claim 15 , wherein the processing device is configured to cause the projector to project the light beam to be different colors, gradients, saturations, or brightness that corresponds to different audio frequency ranges of the first acoustic wave.

19. The three-dimensional structureof claim 15 , wherein the processing device is configured to identify a signal volume level, a frequency, a range of frequencies, a signal channel, or a spatial coverage area of the first acoustic wave.

20. The three-dimensional structureof claim 19 , wherein the processing device is further configured to display one or more indicators related to the signal volume level, the frequency, the range of frequencies, the signal channel, or the spatial coverage area of the first acoustic wave.

Assignments (2)
CHANGE OF NAME Recorded Apr 29, 2024
From: MSG ENTERTAINMENT GROUP, LLC
To: SPHERE ENTERTAINMENT GROUP, LLC
Reel/Frame 067260/0192 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2024
From: FAN, YUAN-YI; WAKEFIELD, NEIL
To: MSG ENTERTAINMENT GROUP, LLC
Reel/Frame 066287/0089 →
Continuity (2)
Continuation 18114089 · Feb 24, 2023
Related Publication 20240292181A1 · Aug 29, 2024
References Cited (25)
US 5210802A · Aylward · 1993 [cited by applicant]
US 11205303B2 · Schowengerdt · 2021 [cited by examiner]
US 11902773B1 · Fan et al. · 2024 [cited by applicant]
US 11956624B2 · Fan · 2024 [cited by applicant]
US 20060117261A1 · Sim et al. · 2006 [cited by applicant]
US 20120041579A1 · Davis et al. · 2012 [cited by applicant]
US 20120047435A1 · Holladay et al. · 2012 [cited by applicant]
US 20120133899A1 · Chiang · 2012 [cited by examiner]
US 20200053320A1 · Mor · 2020 [cited by examiner]
US 20200187332A1 · Mizerak et al. · 2020 [cited by applicant]
US 20200312033A1 · Ohashi · 2020 [cited by applicant]
US 20200326784A1 · Isaacs et al. · 2020 [cited by applicant]
US 20210008413A1 · Asikainen · 2021 [cited by examiner]
US 20210011544A1 · Robertson · 2021 [cited by examiner]
US 20210011551A1 · Andersson · 2021 [cited by examiner]
US 20210011559A1 · Mutlu · 2021 [cited by examiner]
US 20220329765A1 · Shanmugam · 2022 [cited by examiner]
US 20230232153A1 · Sorensen et al. · 2023 [cited by applicant]
US 20240015467A1 · Fan · 2024 [cited by applicant]
US 20240048674A1 · Mohar Castillo · 2024 [cited by examiner]
US 20240276173A1 · Fan et al. · 2024 [cited by applicant]
International Search Report and Written Opinion directed to related International Application No. PCT/US2023/074906, mailed Feb. 4, 2024; 14 pages. [cited by applicant]
D&b Audiotechnik Gmbh: “TI 385 (4.2 EN) d&b Line array design, ArrayCalc V7.x”, Mar. 1, 2014 (Mar. 1, 2014), XP055495833; 58 pages. [cited by applicant]
Feistel et al., “Adapting Loudspeaker Array Radiation to the Venue using Numerical Optimization of FIR Filters,” Convention paper 8937, Audio Engineering Society, Presented at the 135th Convention, Oct. 17-20, 2023, New… [cited by applicant]
Ahnert Feistel Media Group, “EASE Focus Version 3—User's Guide” A Simulation Software by AFMG, Feb. 28, 2019, XP093072376; 82 pages. [cited by applicant]
Cited By (1)
US 12,701,385