IP Library Granted Patent US 12,427,409
Granted Patent B2
US 12,427,409 · App. 18/330,639 · Granted Sep 30, 2025

Interactive audiovisual synchronization for venues

Inventors: Andrey Dobrikov (Brooklyn, NY); Sarah Huth (Edison, NJ); Aaron Pulkka (New York, NY); Benjamin Poynter (New York, NY)
Assignee: Sphere Entertainment Group, LLC
A63F13/44A63F13/215A63F13/216A63F13/217A63F13/22A63F13/27H04W4/025H04W4/33A63F2300/403A63F2300/5573A63F2300/8047
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,427,409
App. No.
18/330,639
Granted
Sep 30, 2025
Kind
B2
Abstract

Exemplary venues allow for members of an audience at different locations within these venues to simultaneously interact with an interactive content. The interactive content can convey one or more requisite actions to be performed by the members of the audience. However, the one or more requisite actions can reach members of the audience at different instances in time. These exemplary venues can effectively compensate for these different instances in time such that the accuracy and/or the synchronization of one or more response actions, which are performed by the members of the audience in response to the one or more requisite actions, can be characterized as no longer being dependent upon their distance from the interactive content. Rather, the accuracy and/or the synchronization of the one or more response actions by the members of the audience to the one or more requisite actions can be considered as being related to the performance, for example, timing, of the one or more response actions themselves.

Claims (52)

1. A portable electronic device for interacting with interactive content conveyed to a member of an audience within a venue, the portable electronic device comprising:

a memory configured to store instructions; and

a processor configured to execute the instructions, the instructions, when executed by the processor, configuring the processor to:

generate a response action that was performed by the member of the audience in response to the interactive content conveying a requisite action to be performed by the member of the audience,

identify a location of the member of the audience within the venue,

request a flight time for the requisite action to reach the location of the member of the audience,

time-shift the response action by the flight time to provide a time-shifted response action, and

estimate accuracy or synchronization of the time-shifted response action in relation to the requisite action.

2. The portable electronic device of claim 1 , wherein the interactive content comprises a video game, an interactive survey, or an interactive poll.

3. The portable electronic device of claim 1 , wherein the portable electronic device further comprises one or more action buttons or one or more omnidirectional control sticks or buttons,

wherein the requisite action comprises performing one or more predetermined sequences of the one or more action buttons or the one or more omnidirectional control sticks or buttons by the member of the audience, and

wherein the response action comprises which action buttons from among the one or more action buttons have been pressed by the member of the audience and/or which omnidirectional control sticks from among the one or more omnidirectional control sticks or buttons have been moved by the member of the audience to perform the requisite action.

4. The portable electronic device of claim 1 , wherein the instructions, when executed by the processor, configure the processor to request an audible flight time for the requisite action to reach the member of the audience.

5. The portable electronic device of claim 1 , wherein the instructions, when executed by the processor, configure the processor to:

receive a response action timeline specifying the requisite action to be performed by the member of the audience and when the requisite action is to be performed by the member of the audience; and

compare the time-shifted response action to the response action timeline to estimate the accuracy or the synchronization of the time-shifted response action in relation to the requisite action.

6. The portable electronic device of claim 1 , wherein the instructions, when executed by the processor, further configure the processor to grant the member of the audience with an award for the accuracy or the synchronization of the time-shifted response action.

7. The portable electronic device of claim 1 , wherein the portable electronic device is further configured to be manipulated by the member of the audience to perform the response action.

8. A method for interacting with interactive content conveyed to a member of an audience within a venue, the method comprising:

generating, by a portable electronic device within the venue, a response action that was performed by the member of the audience in response to the interactive content conveying a requisite action to be performed by the member of the audience;

identifying a location of the member of the audience within the venue;

requesting, by the portable electronic device, a flight time for the requisite action to reach the location of the member of the audience;

time-shifting, by the portable electronic device, the response action by the flight time to provide a time-shifted response action; and

estimating, by the portable electronic device, accuracy or synchronization of the time-shifted response action in relation to the requisite action.

9. The method of claim 8 , wherein the interactive content comprises a video game, an interactive survey, or an interactive poll.

10. The method of claim 8 , wherein the portable electronic device comprises one or more action buttons or one or more omnidirectional control sticks or buttons,

wherein the requisite action comprises performing one or more predetermined sequences of the one or more action buttons or the one or more omnidirectional control sticks or buttons by the member of the audience, and

wherein the response action comprises which action buttons from among the one or more action buttons have been pressed by the member of the audience and/or which omnidirectional control sticks from among the one or more omnidirectional control sticks or buttons have been moved by the member of the audience to perform the requisite action.

11. The method of claim 8 , wherein the requesting comprises requesting an audible flight time for the requisite action to reach the member of the audience.

12. The method of claim 8 , wherein the estimating comprises:

receiving a response action timeline specifying the requisite action to be performed by the member of the audience and when the requisite action is to be performed by the member of the audience; and

comparing the time-shifted response action to the response action timeline to estimate the accuracy or the synchronization of the time-shifted response action in relation to the requisite action.

13. The method of claim 8 , further comprising granting the member of the audience with an award for the accuracy or the synchronization of the time-shifted response action.

14. The method of claim 8 , wherein the generating comprises manipulating the portable electronic device by the member of the audience to perform the response action.

15. A venue for interacting with interactive content conveyed to a member of an audience within the venue, the venue comprising:

a portable electronic device configured to:

generate a response action that was performed by the member of the audience in response to the interactive content conveying a requisite action to be performed by the member of the audience,

identify a location of the member of the audience within the venue,

request a flight time for the requisite action to reach the location of the member of the audience; and

a content server configured to provide the flight time to reach the member of the audience,

wherein the portable electronic device is further configured to:

time-shift the response action by the flight time to provide a time-shifted response action, and

estimate accuracy or synchronization of the time-shifted response action in relation to the requisite action.

16. The venue of claim 15 , wherein the interactive content comprises a video game, an interactive survey, or an interactive poll.

17. The venue of claim 15 , wherein the portable electronic device comprises one or more action buttons or one or more omnidirectional control sticks or buttons,

wherein the requisite action comprises performing one or more predetermined sequences of the one or more action buttons or the one or more omnidirectional control sticks or buttons by the member of the audience, and

wherein the response action comprises which action buttons from among the one or more action buttons have been pressed by the member of the audience and/or which omnidirectional control sticks from among the one or more omnidirectional control sticks or buttons have been moved by the member of the audience to perform the requisite action.

18. The venue of claim 15 , wherein the portable electronic device is further configured to:

receive a response action timeline specifying the requisite action to be performed by the member of the audience and when the requisite action is to be performed by the member of the audience; and

compare the time-shifted response action to the response action timeline to estimate the accuracy or the synchronization of the time-shifted response action in relation to the requisite action.

19. The venue of claim 15 , wherein the portable electronic device is further configured to grant the member of the audience with an award for the accuracy or the synchronization of the time-shifted response action.

20. The venue of claim 15 , wherein the portable electronic device is further configured to be manipulated by the member of the audience to perform the response action.

Assignments (2)
CHANGE OF NAME Recorded Apr 29, 2024
From: MSG ENTERTAINMENT GROUP, LLC
To: SPHERE ENTERTAINMENT GROUP, LLC
Reel/Frame 067260/0192 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2023
From: DOBRIKOV, ANDREY; HUTH, SARAH; PULKKA, AARON; POYNTER, BENJAMIN
To: MSG ENTERTAINMENT GROUP, LLC
Reel/Frame 063882/0707 →
Continuity (2)
Continuation 17237808 · Apr 22, 2021
Related Publication 20230330529A1 · Oct 19, 2023
References Cited (20)
US 5552839A · Kuhl · 1996 [cited by examiner]
US 7320643B1 · Brosius · 2008 [cited by examiner]
US 8149530B1 · Lockton · 2012 [cited by examiner]
US 8606958B1 · Evans · 2013 [cited by examiner]
US 8861925B1 · Ohme · 2014 [cited by applicant]
US 11202162B2 · Elby et al. · 2021 [cited by applicant]
US 11247125B2 · Kamphuis · 2022 [cited by examiner]
US 20030130039A1 · Nelson · 2003 [cited by applicant]
US 20070249420A1 · Randall · 2007 [cited by applicant]
US 20140274415A1 · Benzon · 2014 [cited by examiner]
US 20150133173A1 · Edge · 2015 [cited by examiner]
US 20160353252A1 · Krasadakis · 2016 [cited by applicant]
US 20170135057A1 · Cugini et al. · 2017 [cited by applicant]
US 20170180438A1 · Persson · 2017 [cited by examiner]
US 20180249359A1 · Woods · 2018 [cited by examiner]
US 20190105568A1 · Platt et al. · 2019 [cited by applicant]
US 20190200436A1 · Den Hartog et al. · 2019 [cited by applicant]
US 20210379470A1 · Matonti · 2021 [cited by examiner]
US 20220108358A1 · Sun · 2022 [cited by examiner]
US 20220339536A1 · Dobrikov · 2022 [cited by examiner]