IP Library Granted Patent US 11,956,624
Granted Patent B2
US 11,956,624 · App. 17/811,633 · Granted Apr 9, 2024

Light-based spatial audio metering

Inventors: Yuan-Yi Fan (Los Angeles, CA); Neil Andrew Wakefield (San Francisco, CA)
Assignee: MSG Entertainment Group, LLC
H04S7/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,956,624
App. No.
17/811,633
Granted
Apr 9, 2024
Kind
B2
Abstract

Disclosed herein are system, method, and computer program product embodiments for visualizing sound coverage in a venue. An embodiment operates by receiving audio content from an audio source, determining audio signal properties of the audio content, where the audio signal properties comprise one or more spectral, temporal, spatial components (e.g., energy, spectrum or directivity), receiving an audio system configuration of loudspeakers or sound beams of a venue, visualizing the audio signal based on a mapping of an intersection of a unique volumetric beam of colored light, representing the spectral, temporal, spatial components, with a portion of the venue and displaying the visualized audio signal as a virtual representation of sound coverage of the portion of the venue.

Claims (49)

1. A computer-implemented method, comprising:

receiving, by at least one computing device, audio content from an audio source;

determining, by the at least one computing device, audio signal properties of the audio content, wherein the audio signal properties comprise one or more components of an audio signal of the audio content;

receiving, by the at least one computing device, an audio system configuration of a venue, wherein the audio signal is to be produced at the venue by one or more sound sources configured to provide the audio signals to a portion of the venue;

visualizing, by the at least one computing device, the audio signal comprising:

mapping each of the one or more components of the audio signal to a unique color of light of a set of unique colors of light;

generating, based on the unique color of light, a unique volumetric beam of light; and

determining, based on the audio system configuration of the venue, a spatial origin for the unique volumetric beam of light, and mapping an intersection of the unique volumetric beam of light from the spatial origin with one or more surfaces of the portion of the venue; and

displaying, by the at least one computing device, the visualized audio signal as a virtual representation of sound coverage of the portion of the venue.

2. The computer-implemented method of claim 1 , wherein a first one of the one or more components of the audio signal comprises any of: a frequency, a range of frequencies or a signal channel.

3. The computer-implemented method of claim 1 , further comprising:

varying, based on a second one of the one or more components of the audio signal, an intensity of the unique color of light.

4. The computer-implemented method of claim 3 , wherein the second one of the components of the one or more audio signal comprises a signal level.

5. The computer-implemented method of claim 1 , wherein the one or more sound sources comprises at least a first and second sound source configured to provide the audio signals to one or more of portions of the venue and the visualized audio signal further comprises:

determining, based on the audio system configuration of the venue, a second spatial origin for the unique volumetric beam of light, and mapping the intersection of the unique volumetric beam of light from the second spatial origin with one or more surfaces of the portion of the venue.

6. The computer-implemented method of claim 5 , further comprising aggregating, in the virtual representation of sound coverage of the portion of the venue, visualizations of the intersection of the unique volumetric beam of light from the first spatial origin with one or more surfaces of the portion of the venue and the intersection of the unique volumetric beam of light from the second spatial origin with one or more surfaces of the portion of the venue.

7. The computer-implemented method of claim 1 , wherein the one or more sound sources of the venue corresponds to one or more predetermined locations in the venue.

8. The computer-implemented method of claim 1 , wherein:

the one or more sound sources of the venue corresponds to any of: a speaker, an array of speakers or a sound beam positioned in the venue.

9. The computer-implemented method of claim 1 , wherein the visualized audio signal is overlaid onto the venue in any of: an extended reality, virtual reality, augmented reality or mixed reality environment.

10. The computer-implemented method of claim 1 , wherein the audio source is a stem file separated into multiple frequency bands and further comprising: assigning a different color to each band within the multiple frequency bands.

11. The computer-implemented method of claim 10 , wherein the multiple frequency bands comprises drum, bass, melody and vocal bands.

12. The computer-implemented method of claim 1 , wherein the venue is a dome.

13. A system, comprising:

a memory; and

a processor coupled to the memory and configured to perform operations comprising:

receiving, by at least one computing device, audio content from an audio source;

determining, by the at least one computing device, audio signal properties of the audio content, wherein the audio signal properties comprise one or more components of an audio signal of the audio content;

receiving, by the at least one computing device, an audio system configuration of a venue, wherein the audio signal is to be produced at the venue by one or more sound sources configured to provide the audio signals to a portion of the venue;

visualizing, by the at least one computing device, the audio signal comprising:

mapping each of the one or more components of the audio signal to a unique color of light of a set of unique colors of light;

generating, based on the unique color of light, a unique volumetric beam of light; and

determining, based on the audio system configuration of the venue, a spatial origin for the unique volumetric beam of light, and mapping an intersection of the unique volumetric beam of light from the spatial origin with one or more surfaces of the portion of the venue; and

displaying, by the at least one computing device, the visualized audio signal as a virtual representation of sound coverage of the portion of the venue.

14. The system of claim 13 , the operations further comprising retrieving static imagery representative of the portion of the venue and displaying static imagery as the portion of the venue.

15. The system of claim 13 , wherein the audio source is configured as a set of mono audio signals formatted for the audio system configuration of the venue.

16. The system of claim 13 , wherein the audio system configuration of the venue comprises a fixed data set specifying geometric properties of the one or more sound sources configured to provide the audio signals to the portion of the venue.

17. The system of claim 16 , wherein the one or more sound sources are speaker systems and the geometric properties include any of: location, orientation, size, number of speakers, shape of an array of speakers, or coverage patterns.

18. The system of claim 16 , wherein the one or more sound sources are sound beams and the geometric properties include any of: location, orientation, size, number of sound beams, shape of an array of sound beams, or coverage patterns.

19. The system of claim 13 , wherein the one or more components of the audio signal of the audio content comprise an instantaneous signal level and frequency component.

20. A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

receiving, by the at least one computing device, audio content from an audio source;

determining, by the at least one computing device, audio signal properties of the audio content, wherein the audio signal properties comprise one or more components of an audio signal of the audio content;

receiving, by the at least one computing device, an audio system configuration of a venue, wherein the audio signal is to be produced at the venue by one or more sound sources configured to provide the audio signals to a portion of the venue;

visualizing, by the at least one computing device, the audio signal comprising:

mapping each of the one or more components of the audio signal to a unique color of light of a set of unique colors of light;

generating, based on the unique color of light, a unique volumetric beam of light; and

determining, based on the audio system configuration of the venue, a spatial origin for the unique volumetric beam of light, and mapping an intersection of the unique volumetric beam of light from the spatial origin with one or more surfaces of the portion of the venue; and

displaying, by the at least one computing device, the visualized audio signal as a virtual representation of sound coverage of the portion of the venue.

Assignments (2)
CHANGE OF NAME Recorded Apr 29, 2024
From: MSG ENTERTAINMENT GROUP, LLC
To: SPHERE ENTERTAINMENT GROUP, LLC
Reel/Frame 067260/0192 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2022
From: FAN, YUAN-YI; WAKEFIELD, NEIL ANDREW
To: MSG ENTERTAINMENT GROUP, LLC
Reel/Frame 060473/0882 →
Continuity (1)
Related Publication 20240015467A1 · Jan 11, 2024
Cited By (3)
US 12,238,510 US 12,317,066 US 12,701,385