IP Library Granted Patent US 11,623,138
Granted Patent B2
US 11,623,138 · App. 17/372,787 · Granted Apr 11, 2023

Scalable interactive video systems and methods

Inventors: Wei Cheng Yeh (Orlando, FL); Travis Jon Cossairt (Celebration, FL)
Assignee: Universal City Studios LLC
A63F13/33A63F13/335
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,623,138
App. No.
17/372,787
Granted
Apr 11, 2023
Kind
B2
Abstract

Present embodiments are directed to a distributed control system of an interactive video system. The distributed control system includes a switched fabric network, which includes an input node implemented to collect scanning data for a participant. The switched fabric network also includes a set of processing nodes implemented to generate a virtual representation for the participant based at least in part on the scanning data for the participant. Further, the switched fabric network includes an output node, which includes an output device implemented to present the virtual representation of the participant in a virtual environment.

Claims (53)

1. An interactive video system, comprising:

a switched fabric network including a plurality of switches interconnecting a plurality of nodes, wherein the plurality of nodes comprises:

at least one input node comprising a sensing unit configured to collect scanning data of a participant in a participation area of the interactive video system;

at least one artificial intelligence (AI) processing node configured to identify an in-game action of the participant based at least in part on the scanning data of the participant and determine an in-game effect corresponding to the in-game action;

at least one audio processing node configured to determine an audio effect corresponding to the in-game effect; and

at least one audio output node comprising an audio output device configured to present the audio effect to the participant in the participation area of the interactive video system, wherein each node of the plurality of nodes is coupled to at least two switches of the plurality of switches of the switched fabric network.

2. The interactive video system of claim 1 , wherein the plurality of nodes comprises:

at least one visual processing node configured to generate a virtual representation of the participant based at least in part on the scanning data of the participant; and

at least one visual output node comprising a visual output device configured to present the virtual representation to the participant in the participation area of the interactive video system.

3. The interactive video system of claim 2 , wherein the at least one visual processing node is configured to determine a visual effect corresponding to the in-game effect, and wherein the at least one visual output node is configured to update the presentation of the virtual representation of the participant on the visual output device based on the visual effect.

4. The interactive video system of claim 1 , wherein the plurality of nodes comprises:

at least one physical effect processing node configured to determine a physical effect corresponding to the in-game effect; and

at least one physical effect output node comprising a physical effect output device configured to present the physical effect to the participant in the participation area of the interactive video system.

5. The interactive video system of claim 4 , wherein the at least one physical effect processing node comprises a field-programmable gate array (FPGA).

6. The interactive video system of claim 1 , wherein the plurality of nodes comprises:

a plurality of input nodes, each comprising a respective sensing unit configured to collect a respective portion of the scanning data of the participant in the participation area of the interactive video system; and

an input fusion processing node configured to aggregate the respective portion of the scanning data collected by each respective sensing unit of the plurality of input nodes, and wherein the input fusion processing node comprises an application-specific integrated circuit (ASIC).

7. The interactive video system of claim 1 , wherein the plurality of nodes comprises:

a plurality of audio output nodes, each comprising a respective audio output device configured to present a respective portion of the audio effect to the participant in the participation area of the interactive video system; and

an output fusion processing node configured to determine the respective portion of the audio effect to be presented by the respective audio output device of each of the plurality of audio output nodes.

8. The interactive video system of claim 1 , wherein the at least one AI processing node is disposed within a first chassis and the at least one audio processing node is disposed within a second chassis distinct from the first chassis.

9. The interactive video system of claim 1 , wherein the at least one AI processing node comprises a tensor processing unit (TPU), a first vector processing unit (VPU), or a combination thereof, and wherein the at least one audio processing node comprises a second VPU that is distinct from the first VPU.

10. The interactive video system of claim 1 , wherein the at least one AI processing node is configured to access the at least one input node via remote direct memory access (RDMA).

11. The interactive video system of claim 1 , wherein the switched fabric network is implemented using peripheral component interconnect express (PCIe) connectivity.

12. A method of operating an interactive video system having a switched fabric network that includes a plurality of nodes, the method comprising:

collecting, via at least one input node of the plurality of nodes, scanning data of a participant in a participation area of the interactive video system;

identifying, via at least one artificial intelligence (AI) processing node of the plurality of nodes, an in-game action of the participant based at least in part on the scanning data of the participant;

determining, via the at least one AI processing node, an in-game effect corresponding to the in-game action;

determining, via at least one audio processing node of the plurality of nodes, an audio effect corresponding to the in-game effect;

presenting, via an audio output device of at least one audio output node of the plurality of nodes, the audio effect to the participant in the participation area of the interactive video system;

determining, via at least one physical effect processing node of the plurality of nodes, a physical effect corresponding to the in-game effect; and

presenting, via a physical effect output device of at least one physical effect output node of the plurality of nodes, the physical effect to the participant in the participation area of the interactive video system.

13. The method of claim 12 , wherein each node of the plurality of nodes is coupled to at least two switches of a plurality of switches of the switched fabric network.

14. The method of claim 12 , comprising:

generating, via at least one visual processing node of the plurality of nodes, a virtual representation of the participant based at least in part on the scanning data of the participant; and

presenting, via a visual output device of a visual output node of the plurality of nodes, the virtual representation to the participant in the participation area of the interactive video system.

15. The method of claim 14 , comprising:

determining, via the at least one visual processing node, a visual effect corresponding to the in-game effect; and

updating, via the visual output device of the visual output node, the virtual representation of the participant based on the visual effect.

16. An interactive video system, comprising:

a switched fabric network having a plurality of nodes, including:

at least one input node comprising a sensing unit configured to collect scanning data of a participant in a participation area of the interactive video system;

at least one artificial intelligence (AI) processing node configured to identify an in-game action of the participant based at least in part on the scanning data of the participant and to determine an in-game effect corresponding to the in-game action;

at least one visual processing node configured to generate a virtual representation of the participant based at least in part on the scanning data of the participant and to determine a visual effect corresponding to the in-game effect; and

at least one visual output node comprising a visual output device configured to present the virtual representation to the participant in the participation area of the interactive video system and to update the presentation of the virtual representation based on the visual effect;

at least one audio processing node configured to determine an audio effect corresponding to the in-game effect; and

at least one audio output node comprising an audio output device configured to present the audio effect to the participant in the participation area of the interactive video system.

17. The interactive video system of claim 16 , wherein each node of the plurality of nodes is coupled to at least two switches of the plurality of switches of the switched fabric network.

18. The interactive video system of claim 16 , wherein the plurality of nodes comprises:

at least one physical effect processing node configured to determine a physical effect corresponding to the in-game effect; and

at least one physical effect output node comprising a physical effect output device configured to present the physical effect to the participant in the participation area of the interactive video system.

19. The interactive video system of claim 16 , wherein the at least one input node comprises a radio-frequency (RF) sensor, and wherein the scanning data comprises data indicating an identity, a location, or a combination thereof, collected at the RF sensor for the participant.

20. The interactive video system of claim 16 , wherein the at least one input node comprises a plurality of input nodes having a respective plurality of sensing units configured to collect respective scanning data for each of a plurality of participants within the participation area of the interactive video system.

Continuity (3)
Continuation 16268129 · Feb 5, 2019
Provisional Application 62783544 · Dec 21, 2018
Related Publication 20210339128A1 · Nov 4, 2021
Cited By (7)
US 12,267,482 US 12,282,604 US 12,322,052 US 12,417,593 US 12,449,891 US 12,519,924 US 12,718,494