Distributed command execution in multi-location studio environments
A distributed studio management system includes a computing system having a computer readable memory and a processor. The computing system is associated with a first production facility that is remote to a second production facility. The processor is configured to perform the operations of receiving a set of device commands having commands targeting first and second devices in the first production facility and where the set of device commands are related to the second production facility, enqueuing a first command from the device commands into a first command queue assigned to the first device and a second command from the device commands into a second command queue assigned to the second device according to each device command's synchronized execution times, and causing the first and second devices to execute commands from their respective command queues relative to each other according to the commands' respective synchronized execution times.
1 . A computer-based content production management system comprising:
at least one non-transitory computer-readable memory storing software instructions;
at least one processor coupled with the at least one non-transitory computer-readable memory;
at least one physical camera deployed in at least one content production volume, the at least one physical camera configured to store captured content in the at least one memory; and
a command queue management module that, upon execution of the software instruction by the at least one processor, performs the following operations:
generating at least one camera command based on received virtual camera control instructions, wherein the at least one camera command relates to operation of a virtual camera based on the captured content in a production environment of the at least one content production volume;
assigning a synchronized execution time to the at least one camera command;
enqueueing the at least one camera command into a camera command queue according to the synchronized execution time; and
rendering content associated with the virtual camera based on execution of the at least one camera command from the camera command queue according to the synchronized execution time.
2 . The content production management system of claim 1 , wherein the operation of rendering content associated with the virtual camera is performed by a game engine.
3 . The content production management system of claim 2 , wherein the game engine is selected from the group consisting of: an UnReal game engine, a Unity game engine, a Godot game engine, and a Blender renderer.
4 . The content production management system of claim 1 , further comprising a display module configured to display the rendered content associated with the virtual camera.
5 . The content production management system of claim 1 , wherein the at least one camera command comprises a post-production related command.
6 . The content production management system of claim 1 , wherein:
the at least one physical camera is deployed at a first studio; and
the system further comprises at least one second physical camera deployed at a second studio remote from the first studio, wherein captured content from the at least one physical camera is transmitted to the second studio.
7 . The content production management system of claim 6 , wherein the operations further include:
determining a first latency between the first studio and the content production management system;
determining a second latency between the second studio and the content production management system; and
adjusting the synchronized execution time of the at least one camera command based on the first latency and the second latency.
8 . The content production management system of claim 7 , wherein the first latency and the second latency are measured using at least one technique selected from the group consisting of: GPS sensors, network time protocol (NTP), ping times, round trip times (RTT), and time to first byte (TTFB).
9 . The content production management system of claim 1 , wherein the operation of rendering content associated with the virtual camera includes rendering on an LED wall of the at least one content production volume.
10 . The content production management system of claim 1 , wherein the operation of rendering content associated with the virtual camera includes adjusting the captured content by at least one adjustment selected from the group consisting of: scaling the captured content, rotating the captured content, skewing the captured content, adjusting lighting of the captured content, adjusting color of the captured content, adjusting contrast of the captured content, adjusting brightness of the captured content, and moving the captured content.
11 . The content production management system of claim 1 , wherein the operations further include integrating the captured content from at least two studios via an implementation of at least one computer vision algorithm.
12 . The content production management system of claim 11 , wherein the at least one computer vision algorithm comprises at least one algorithm selected from the group consisting of: scale-invariant feature transform (SIFT), speeded-up robust features (SURF), FAST Features from Accelerated Segment Test, BRIEF Binary Independent Elementary Features, ORB Object FAST and Rotated BRIEF, Canny Operator, and Canny edge detector.
13 . The content production management system of claim 1 , wherein the at least one camera command relates to at least one camera property selected from the group consisting of: camera angle, camera latitudinal position, camera longitudinal position, camera orientation, camera elevation, camera zoom position, camera ISO setting, camera shutter speed, camera aperture setting, camera frame rate, camera white balance setting, and camera focus.
14 . The content production management system of claim 1 , wherein the operation of rendering content associated with the virtual camera includes updating rendered content based on transformation matrices or projection matrices.
15 . The content production management system of claim 1 , wherein the command queue management module automatically generates the at least one camera command in response to movement of the at least one physical camera.
16 . The content production management system of claim 1 , wherein the content production volume is implemented in at least one environment selected from the group consisting of: physical reality (PR), mixed reality (MR), mixed physical reality (MPR), augmented reality (AR), virtual reality (VR), and projected reality (PrR).
17 . The content production management system of claim 1 , further comprising at least one sensor deployed in the content production volume, wherein the command queue management module is configured to generate the at least one camera command based on data received from the at least one sensor.
18 . The content production management system of claim 1 , wherein the at least one virtual camera command includes a triggering criterion in addition to the synchronized execution time.
19 . The content production management system of claim 1 , wherein the at least one virtual command is generated based on a previs.
20 . The content production management system of claim 1 , wherein the operations further include recording information associate with execution of the at least one wherein the camera command on a notarized ledger.
21 . A computer-based content production management method, the method comprising:
generating at least one camera command based on received virtual camera control instructions, wherein the at least one camera command relates to operation of a virtual camera based on captured content from at least one physical camera in a production environment of at least one content production volume;
assigning a synchronized execution time to the at least one camera command;
enqueueing the at least one camera command into a camera command queue according to the synchronized execution time; and
rendering content associated with the virtual camera based on execution of the at least one camera command from the camera command queue according to the synchronized execution time.
22 . A non-transitory computer readable medium storing computer readable instructions, which when executed by processor hardware, causes a command queue management module to:
generate at least one camera command based on received virtual camera control instructions, wherein the at least one camera command relates to operation of a virtual camera based on captured content from at least one physical camera in a production environment of at least one content production volume;
assign a synchronized execution time to the at least one camera command;
enqueue the at least one camera command into a camera command queue according to the synchronized execution time; and
render content associated with the virtual camera based on execution of the at least one camera command from the camera command queue according to the synchronized execution time.