System and method for generating interactive media
An attraction system includes a display that operates to present augmented reality and/or virtual reality (AR/VR) imagery to a guest in an interactive space. The system includes an audio controller that operates an array of speakers that are distributed throughout the interactive space and a controller having one or more processors. The one or more processors are operable to receive data indicative of a state of the guest (e.g., an action, movement, or gesture of the guest, an input received from an input device). The one or more processors are also operable to adjust the AR/VR imagery in response to the state of the guest, and instruct the audio controller to operate the array of the speakers to provide interactive audio based on the state of the guest and such that the interactive audio presents to the guest as though originating from a dynamic portion of the AR/VR imagery.
1 . An attraction system comprising:
a display configured to depict augmented reality and/or virtual reality (AR/VR) imagery to a guest of a plurality of guests in an interactive physical space;
an audio controller configured to operate an array of speakers, wherein the speakers of the array are distributed throughout the interactive physical space; and
a controller comprising one or more processors, wherein the one or more processors are configured to:
instruct the audio controller to operate the speakers of the array within the interactive physical space to provide interactive audio corresponding to the AR/VR imagery;
receive data indicative of a facial expression of the guest within the interactive physical space;
adjust the AR/VR imagery in response to the facial expression of the guest; and
instruct the audio controller to operate the speakers of the array within the interactive physical space to provide updated interactive audio based on the facial expression of the guest within the interactive physical space.
2 . The attraction system of claim 1 , wherein the AR/VR imagery comprises imagery displayed on or by AR/VR lenses, imagery projected by a projector, or a combination thereof.
3 . The attraction system of claim 1 , comprising a virtual model stored on or in the controller, wherein the virtual model includes a digital twin of the array of speakers.
4 . The attraction system of claim 1 , comprising a mapping system configured to map coordinates associated with the guest from a first coordinate system to a second coordinate system associated with a dynamic portion of the AR/VR imagery, wherein the interactive audio and the updated interactive audio presents to the guest as though originating from the dynamic portion of the AR/VR imagery.
5 . The attraction system of claim 1 , comprising a mapping system configured to map coordinates associated with a dynamic portion of the AR/VR imagery from a first coordinate system to a second coordinate system associated with a physical location of the guest, wherein the interactive audio and the updated interactive audio presents to the guest as though originating from the dynamic portion of the AR/VR imagery.
6 . The attraction system of claim 1 , wherein the one or more processors of the controller are configured to perform mappings between a first coordinate system and a second coordinate system, the first coordinate system is associated with the interactive physical space and the second coordinate system is associated with a virtual model.
7 . The attraction system of claim 6 , wherein the first coordinate system includes:
position coordinates of the guest in the interactive physical space, including one or more of: a location of the guest, a posture of the guest, a location or orientation of at least one eye of the guest, a location or orientation of at least one ear of the guest, and a location or orientation of at least one appendage of the guest; and
location coordinates of the speakers of the array in the interactive physical space.
8 . The attraction system of claim 6 , wherein the first coordinate system is associated with the controller and the second coordinate system is associated with the audio controller.
9 . The attraction system of claim 1 , wherein an input device associated with the guest includes at least one speaker of the array, and wherein the input device is communicatively coupled to the audio controller to receive instructions to provide at least a portion of the interactive audio or the updated interactive audio via the at least one speaker of the input device.
10 . The attraction system of claim 1 , wherein providing the interactive audio or the updated interactive audio comprises changing source locations of the interactive audio or the updated interactive audio.
11 . The attraction system of claim 1 , wherein the audio controller is configured to instruct the array of speakers to produce the interactive audio and the updated interactive audio such that the guest perceives the interactive audio and the updated interactive audio as originating from an interactive physical object within the interactive physical space.
12 . The attraction system of claim 1 , wherein the one or more processors are configured to instruct the audio controller to operate the speakers of the array such that the interactive audio or the updated interactive audio heard by a first guest is different from the interactive audio or the updated interactive audio heard by a second guest.
13 . The attraction system of claim 1 , wherein the updated interactive audio is modified relative to the interactive audio based on the facial expression of the guest.
14 . A non-transitory, computer-readable medium comprising instructions for providing interactive audio, the instructions, when executed by one or more processors of a processor system of a controller, are configured to cause the processor system to perform operations comprising:
instructing an audio controller configured to operate an array of speakers distributed throughout an interactive physical space to provide interactive audio corresponding to augmented reality and/or virtual reality (AR/VR) imagery presented via a display to a guest of a plurality of guests in the interactive physical space;
receiving data indicative of a facial expression of the guest within the interactive physical space;
adjusting the AR/VR imagery in response to the facial expression of the guest; and
instructing the audio controller to operate the speakers of the array within the interactive physical space to provide updated interactive audio based on the facial expression of the guest within the interactive physical space.
15 . The non-transitory, computer-readable medium of claim 14 , wherein the AR/VR imagery comprises imagery displayed on or by AR/VR lenses, imagery projected by a projector, or a combination thereof.
16 . The non-transitory, computer-readable medium of claim 14 , wherein the instructions, when executed by the one or more processors, are configured to cause the processor system to instruct the audio controller to produce the interactive audio or the updated interactive audio via the array of speakers such that the guest perceives the interactive audio or the updated interactive audio as originating from an interactive physical object within the interactive physical space.
17 . The non-transitory, computer-readable medium of claim 14 , wherein the instructions, when executed by the one or more processors, are configured to cause the processor system to instruct the audio controller to produce the interactive audio or the updated interactive audio such that the interactive audio or the updated interactive audio heard by a first guest is different from the interactive audio or the updated interactive audio heard by a second guest.
18 . A method for generating interactive audio, the method comprising:
instructing, via one or more processors of a processor system of a controller, an audio controller to provide the interactive audio corresponding to augmented reality and/or virtual reality (AR/VR) imagery presented to a guest of a plurality of guests within an interactive physical space;
operating, via the audio controller, an array of speakers distributed throughout the interactive physical space to provide the interactive audio;
receiving, via the processor system, data indicative of a facial expression of the guest within the interactive physical space;
adjusting, via the processor system, the AR/VR imagery in response to the facial expression of the guest; and
instructing, via the processor system, the audio controller to operate the speakers of the array within the interactive physical space to provide updated interactive audio based on the facial expression of the guest within the interactive physical space.
19 . The method of claim 18 , comprising performing mappings between a first coordinate system and a second coordinate system, the first coordinate system being associated with the interactive physical space, and the second coordinate system being associated with a virtual model.
20 . The method of claim 19 , wherein the first coordinate system includes:
position coordinates of the guest in the interactive physical space; and
location coordinates of the speakers of the array in the interactive physical space.