Live venue performance sensor capture and visualization over game network
A system and methods for providing interactive content to an audience is disclosed. In aspects, system implements methods to receive sensor data captured by one or more sensors affixed to a performer. A graphical visualization is rendered based on the sensor data. The graphical visualization is transmitted to one or more external devices associated with one or more members of the audience for incorporation into a application executing on the one or more external devices.
1. A computer implemented method for providing interactive content to an audience, the method comprising:
receiving, by one or more computing devices, sensor data captured by one or more sensors affixed to a performer in a venue;
rendering, by the one or more computing devices and based on the sensor data, a graphical visualization for incorporation into a video game application executing on one or more external devices of one or more members of the audience of the venue;
transmitting, by the one or more computing devices, the graphical visualization for display on the one or more external devices; and
in response to transmitting the graphical visualization, receiving, by the one or more computing devices, an input from the one or more members of the audience via the video game application, wherein the input is collected to determine a collective goal of the one or more members of the audience in the video game application.
2. The method of claim 1 , wherein the sensor data comprises motion capture data, an acoustic data, or a biometric data.
3. The method of claim 1 , wherein the graphical visualization comprises a virtual scene with rigs, and wherein the rendering comprises rendering the virtual scene with rigs to change based on the sensor data.
4. The method of claim 1 , wherein the graphical visualization comprises a virtual character with rigs, and wherein the rendering comprises rendering the virtual character with rigs to mimic movements of the performer based on the sensor data.
5. The method of claim 1 , wherein transmitting the graphical visualization to the one or more external devices is done in real-time from when the sensor data is captured.
6. The method of claim 1 , further comprising:
receiving, by the one or more computing devices, a further input from the one or more external devices via the video game application; and
causing, by the one or more computing devices, an interaction with the performer of the venue in which the performer is performing based on the further input.
7. The method of claim 6 , wherein causing the interaction comprises generating a graphic for display on a display interface in the venue.
8. The method of claim 6 , wherein causing the interaction comprises:
generating a haptic feedback; and
transmitting the haptic feedback to the performer.
9. The method of claim 6 , wherein causing the interaction comprises enabling the one or more members of the audience to control one or more mechanical elements in the venue via the video game application.
10. A server for providing interactive content to an audience, the server comprising:
a control unit configured to:
receive sensor data captured by one or more sensors affixed to a performer in a venue,
render based on the sensor data a graphical visualization for incorporation into a video game application executing on one or more external devices of one or more members of the audience of the venue; and
a communication unit, coupled to the control unit, configured to:
transmit the graphical visualization for display on the one or more external devices associated with the one or more members of the audience for incorporation into an application executing on the one or more external devices;
in response to transmitting the graphical visualization, receiving an input from the one or more members of the audience via the video game application; and
wherein the control unit is further configured to collect each input and determine, based on the collected input, a collective goal of the one or more members of the audience in the video game application.
11. The server of claim 10 , wherein the sensor data captured comprises motion capture data, an acoustic data, or a biometric data.
12. The server of claim 10 , wherein the graphical visualization comprises a virtual scene with rigs, and wherein the rendering comprises rendering the virtual scene with rigs to change based on the sensor data.
13. The server of claim 10 , wherein the graphical visualization comprises a virtual character with rigs, and wherein the rendering comprises rendering the virtual character with rigs to mimic movements of the performer based on the sensor data.
14. The server of claim 10 , wherein transmitting the graphical visualization to the one or more external devices is done in real-time from when the sensor data is captured.
15. The server of claim 10 , wherein:
the communication unit is further configured to receive a further input from the one or more external devices via the video game application; and
the control unit is further configured to cause an interaction with the performer of the venue in which the performer is performing based on the further input.
16. The server of claim 15 , wherein the control unit is further configured to cause the interaction by generating a graphic for display on a display interface in the venue.
17. The server of claim 15 , wherein:
the control unit is further configured to cause the interaction by generating a haptic feedback; and
the communication unit is further configured to transmit the haptic feedback to the performer.
18. The server of claim 15 , wherein the control unit is further configured to cause the interaction by enabling the one or more members of the audience to control one or more mechanical elements in the venue via the video game application.
19. A venue for providing interactive content to an audience, the venue comprising:
a server configured to:
receive sensor data captured by one or more sensors affixed to a performer of the venue, render, based on the sensor data, a graphical visualization for incorporation into a video game application executing on one or more external devices of one or more members of the audience of the venue,
transmit the graphical visualization for display on the one or more external devices associated with the one or more members of the audience for incorporation into an application executing on the one or more external devices; and
in response to transmitting the graphical visualization, receive an input from the one or more members of the audience via the video game application, wherein the input is collected to determine a collective goal of the one or more members of the audience in the video game application.
20. The venue of claim 19 , wherein the server is further configured to transmit the graphical visualization to the one or more external devices in real-time from when the sensor data is captured.