Multi-user perspective projection in location-based entertainment
Tracking and displaying personalized views of participants including: a plurality of pairs of active shutter glasses to be worn by the participants and is synchronized to an LED screen, wherein a shutter for each eye of each pair of the active shutter glasses is configured to allow light to transmit to each eye only during a correct sub-frame and block the light during all other sub-frames; a motion capture system to detect positions of the participants by tracking the plurality of pairs of active shutter glasses to generate tracking data; a plurality of render nodes coupled to the LED screen; a central controller to receive the tracking data to trigger discrete render processes of the plurality of render nodes for unique perspective of each participant, wherein the triggered discrete render processes render and transmit video in parallel to display video streams as sub-frames on the LED screen.
1 . A system for tracking and displaying personalized views of participants in a shared environment, the system comprising:
an LED screen;
a plurality of pairs of active shutter glasses to be worn by a plurality of participants in the shared environment and is synchronized to the LED screen,
wherein a shutter for each eye of each pair of the active shutter glasses is configured to allow light to transmit to each eye of each participant only during a correct sub-frame and block the light during all other sub-frames;
a motion capture system to detect positions of the plurality of participants by tracking the plurality of pairs of active shutter glasses to generate tracking data;
a plurality of render nodes coupled to the LED screen;
a central controller to receive the tracking data to trigger discrete render processes of the plurality of render nodes for unique perspective of each participant,
wherein the triggered discrete render processes render and transmit video in parallel to display video streams as sub-frames on the LED screen.
2 . The system of claim 1 , wherein the plurality of pairs of active shutter glasses includes one of an active 3-D glasses or monoscopic glasses.
3 . The system of claim 1 , wherein the unique perspective of each participant includes location, orientation, and inter-pupilar distance of each participant.
4 . The system of claim 1 , wherein the motion capture system includes optical motion capture sensors positioned on a perimeter of the shared environment to capture configurations of emitters disposed on the plurality of pairs of active shutter glasses and to determine head positions, orientations, and inter-pupilar distances of the plurality of participants with respect to the LED screen.
5 . The system of claim 1 , wherein the motion capture system detects head position, orientation, and inter-pupilar distance of each participant.
6 . The system of claim 5 , wherein the motion capture system is a marker-less system which identifies each participant based on features of each participant and solves a skeleton to determine the head position, the orientation, and the inter-pupilar distance of each participant.
7 . The system of claim 1 , wherein the central controller relays the tracking data to appropriate render nodes to render the video streams for gaze and position of each eye of each participant in relation to the LED screen.
8 . The system of claim 1 , further comprising an LED controller to receive the video streams transmitted in parallel by the plurality of render nodes and to display the video streams as sub-frames on the LED screen.
9 . The system of claim 8 , wherein the LED controller receives the video streams from the plurality of render nodes over Internet protocol (IP) video using real-time transport protocol (RTP).
10 . The system of claim 8 , wherein the LED controller receives the video streams from the plurality of render nodes through bare-metal display port connections between the plurality of render nodes and the LED controller.
11 . The system of claim 8 , further comprising
a timing device to transmit a timing signal to the plurality of pairs of active shutter glasses, the central controller, and the LED controller to synchronize the video streams to the triggered discrete render processes and to the LED screen.
12 . The system of claim 11 , wherein the video streams are synchronized using one of precision time protocol version 2, precision time protocol version 2.1, tri-level sync, or transistor-transistor logic.
13 . The system of claim 1 , wherein the plurality of pairs of active shutter glasses includes one of radio frequency (RF) or infrared (IR) emitters to synchronize left and right eyes to respective sub-frames.
14 . The system of claim 1 , wherein the LED screen includes LED panels and integrated circuit (IC) drivers capable of operating at high frequencies to drive the LED screen to a target brightness specified by the video and to maintain high refresh rates for the specified target brightness.
15 . The system of claim 14 , wherein a viewer target brightness is determined by dividing the target brightness by a per-viewer duty cycle.
16 . The system of claim 14 , wherein a viewer target brightness is determined by dividing the target brightness by a per-viewer duty cycle, and then dividing by a transmittance percentage of the shutter.
17 . The system of claim 14 , wherein a viewer target brightness is determined by dividing the target brightness by a per-viewer duty cycle, and then dividing by a transmittance percentage of the shutter combined with a perceptual luminance compensation model to improve the perceived luminance and contrast.
18 . A system for tracking and displaying personalized views of participants on an LED screen, the system comprising:
a plurality of pairs of active shutter glasses to be worn by a plurality of participants in a shared environment and is synchronized to the LED screen,
wherein a shutter for each eye of each pair of the active shutter glasses is to allow light to transmit to each eye of each participant only during a correct sub-frame and block the light during all other sub-frames;
a motion capture system to detect positions of the plurality of participants by tracking the plurality of pairs of active shutter glasses to generate tracking data;
a plurality of render nodes coupled to the LED screen;
a central controller to receive the tracking data to trigger discrete render processes of the plurality of render nodes for unique perspective of each participant including location, orientation, and inter-pupilar distance of each participant,
wherein the triggered discrete render processes render and transmit video in parallel to display video streams as sub-frames on the LED screen.
19 . The system of claim 18 , wherein the plurality of pairs of active shutter glasses includes one of radio frequency (RF) or infrared (IR) emitters to synchronize left and right eyes to respective sub-frames.
20 . The system of claim 18 , wherein the LED screen includes LED panels and integrated circuit (IC) drivers capable of operating at high frequencies to drive the LED screen to a target brightness specified by the video and to maintain high refresh rates for the specified target brightness.