IP Library Granted Patent US 12,048,877
Granted Patent B2
US 12,048,877 · App. 17/237,808 · Granted Jul 30, 2024

Interactive audiovisual synchronization for venues

Inventors: Andrey Dobrikov (Brooklyn, NY); Sarah Huth (Edison, NJ); Aaron Pulkka (New York, NY); Benjamin Poynter (New York, NY)
Assignee: MSG Entertainment Group, LLC
A63F13/44A63F13/215A63F13/216A63F13/217A63F13/22A63F13/27H04W4/025H04W4/33A63F2300/403A63F2300/5573A63F2300/8047
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,048,877
App. No.
17/237,808
Granted
Jul 30, 2024
Kind
B2
Abstract

Exemplary venues allow for members of an audience at different locations within these venues to simultaneously interact with an interactive content. The interactive content can convey one or more requisite actions to be performed by the members of the audience. However, the one or more requisite actions can reach members of the audience at different instances in time. These exemplary venues can effectively compensate for these different instances in time such that the accuracy and/or the synchronization of one or more response actions, which are performed by the members of the audience in response to the one or more requisite actions, can be characterized as no longer being dependent upon their distance from the interactive content. Rather, the accuracy and/or the synchronization of the one or more response actions by the members of the audience to the one or more requisite actions can be considered as being related to the performance, for example, timing, of the one or more response actions themselves.

Claims (66)

1. A venue for providing interactive content to an audience, the venue comprising:

an audio/visual system configured to present a rhythm video game to the audience, the rhythm video game conveying an audible representation of a requisite action to be performed by a plurality of members of the audience; and

a content server configured to:

receive a plurality of responses that were performed by the plurality of members of the audience in response to the audible representation of the requisite action reaching the plurality of members of the audience using a plurality of portable electronic devices,

identify a plurality of locations of the plurality of portable electronic devices within the venue,

estimate a plurality of audible flight times for the audible representation to reach the plurality of members of the audience based upon the plurality of locations of the plurality of portable electronic devices,

time-shift the plurality of response actions by their corresponding audible flight times from among the plurality of audible flight times to provide a plurality of time-shifted plurality of response actions, and

grant the plurality of members of the audience one or more awards based upon synchronization of the plurality of time-shifted plurality of response actions in relation to the requisite action.

2. The venue of claim 1 , wherein the requisite action to be performed by the plurality of members of the audience comprises:

pressing a pre-determined sequence of one or more action buttons or one or more omnidirectional control sticks or buttons on the plurality of portable electronic devices, and

wherein the plurality of response actions that were performed by the plurality of members of the audience comprise:

pressing the pre-determined sequence of the one or more action buttons or the one or more omnidirectional control sticks or buttons on the plurality of portable electronic devices.

3. The venue of claim 1 , wherein the content server is further configured to:

receive a plurality of characteristics, parameters, and/or attributes relating to a plurality of seating arrangements of the plurality of members of the audience within the venue; and

compare the plurality of characteristics, parameters, and/or attributes with a venue floorplan that associates the plurality of characteristics, parameters, and/or attributes with their corresponding locations within the venue to identify the plurality of locations of the plurality of portable electronic devices within the venue.

4. The venue of claim 1 , wherein the content server is further configured to receive global positioning information from the plurality of portable electronic devices relating to the plurality of locations of the plurality of portable electronic devices within the venue.

5. The venue of claim 1 , wherein the content server is further configured to:

determine a plurality of distances between the audio/visual system and the plurality of locations of the plurality of portable electronic devices within the venue; and

estimate the plurality of audible flight times for the audible representation based upon a ratio between the plurality of distances and a speed of sound.

6. The venue of claim 1 , wherein the audible representation of the requisite action reaches those members of the audience from among the plurality of members of the audience that are further away from the audio/visual system at later instances in time than those members of the audience from among the plurality of members of the audience that are closer to the audio/visual system.

7. The venue of claim 1 , wherein the content server is further configured to:

store a response action timeline specifying the requisite action to be performed by the plurality of members of the audience and a timeline the requisite action is to be performed by the plurality of members of the audience; and

compare the plurality of time-shifted plurality of response actions to the requisite action timeline to determine the synchronization of the plurality of time-shifted plurality of response actions in relation to the requisite action.

8. A method for providing interactive content to an audience, the method comprising:

receiving, by a content server, a plurality of response actions that were performed by a plurality of members of the audience using a plurality of portable electronic devices, the plurality of response actions being performed by the plurality of members of the audience in response to the interactive content conveying an audible representation of a requisite action to be performed by the plurality of members of the audience reaching the plurality of members of the audience;

identifying, by the content server, a plurality of locations of the plurality of portable electronic devices within the venue;

estimating, by the content server, a plurality of audible flight times for the audible representation of the requisite action to reach the plurality of members of the audience based upon the plurality of locations of the plurality of portable electronic devices; and

time-shifting, by the content server, the plurality of response actions that were performed by the plurality of members of the audience by their corresponding audible flight times from among the plurality of audible flight times to provide a plurality of time-shifted plurality of response actions; and

estimating, by the content server, accuracy or synchronization of the plurality of time-shifted of response actions that were performed by the plurality of members of the audience in relation to the requisite action to be performed by the plurality of members of the audience.

9. The method of claim 8 , wherein the plurality of response actions that were performed by the plurality of members of the audience comprises:

pressing a pre-determined sequence of one or more action buttons or one or more omnidirectional control sticks or buttons on the portable electronic device, and

wherein the requisite action to be performed by the plurality of members of the audience comprises:

pressing the pre-determined sequence of the one or more action buttons or the one or more omnidirectional control sticks or buttons on the portable electronic device.

10. The method of claim 8 , wherein the identifying comprises:

receiving a plurality of characteristics, parameters, and/or attributes relating to a plurality of seating arrangements of the plurality of members of the audience within the venue; and

comparing the plurality of characteristics, parameters, and/or attributes with a venue floorplan that associates the plurality of characteristics, parameters, and/or attributes with their corresponding locations within the venue to identify the plurality of locations of the plurality of portable electronic devices within the venue.

11. The method of claim 8 , wherein the identifying comprises:

receive global positioning information relating to the plurality of locations of the plurality of portable electronic devices within the venue from the plurality of portable electronic devices.

12. The method of claim 8 , wherein the interactive content comprises:

a rhythm video game.

13. The method of claim 8 , wherein the estimating comprises:

storing, by the content server, a response action timeline specifying the requisite action to be performed by the plurality of members of the audience and a timeline the requisite action is to be performed by the plurality of members of the audience; and

comparing, by the content server, the plurality of time-shifted plurality of response actions to the requisite action timeline to estimate the synchronization of the plurality of time-shifted plurality of response actions in relation to the requisite action.

14. A content server for providing interactive content to an audience within a venue, the content server comprising:

a memory that stores instructions; and

a processor configured to execute the instructions, the instructions, when executed by the processor, configuring the processor to:

receive a response action that was performed by a member of the audience using a portable electronic device, the response action being performed by the member of the audience in response to the interactive content conveying a requisite action to be performed by the member of the audience reaching the member of the audience,

estimate a flight time for the requisite action to reach the member of the audience,

time-shift the response action that was performed by the member of the audience by the flight time to provide a time-shifted response action, and

estimate accuracy or synchronization of the time-shifted response action that was performed by the member of the audience in relation to the requisite action to be performed by the member of the audience.

15. The content server of claim 14 , wherein the response action that was performed by the audience comprises:

pressing a pre-determined sequence of one or more action buttons or one or more omnidirectional control sticks or buttons on the portable electronic device, and

wherein the requisite action to be performed by the member of the audience comprises:

pressing the pre-determined sequence of the one or more action buttons or the one or more omnidirectional control sticks or buttons on the portable electronic device.

16. The content server of claim 14 , wherein the instructions, when executed by the processor, configure the processor to:

identify a location of the portable electronic device within the venue; and

estimate the flight time for the requisite action to reach the member of the audience to reach the member of the audience based upon the location of the portable electronic device within the venue.

17. The content server of claim 16 , wherein the instructions, when executed by the processor, configure the processor to:

receive a characteristic, parameter, and/or attribute relating to a seating arrangement of the member of the audience within the venue; and

compare the characteristic, parameter, and/or attribute with a venue floorplan that associates the characteristic, parameter, and/or attribute with its corresponding location within the venue to identify the location of the portable electronic device within the venue.

18. The content server of claim 16 , wherein the instructions, when executed by the processor, configure the processor to receive global positioning information relating to the location of the portable electronic device within the venue from the portable electronic device.

19. The content server of claim 14 , wherein the interactive content comprises:

a rhythm video game.

20. The content server of claim 14 , wherein the instructions, when executed by the processor, configure the processor to:

determine a distance between an electronic device presenting the interactive content and a location of the portable electronic device within the venue; and

estimate the flight time based upon a ratio between the distance and a speed of the requisite action to reach the member of the audience.

Assignments (2)
CHANGE OF NAME Recorded Apr 29, 2024
From: MSG ENTERTAINMENT GROUP, LLC
To: SPHERE ENTERTAINMENT GROUP, LLC
Reel/Frame 067260/0192 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2021
From: DOBRIKOV, ANDREY; HUTH, SARAH; PULKKA, AARON; POYNTER, BENJAMIN
To: MSG ENTERTAINMENT GROUP, LLC
Reel/Frame 056010/0576 →
Continuity (1)
Related Publication 20220339536A1 · Oct 27, 2022