IP Library Granted Patent US 12,267,614
Granted Patent B1
US 12,267,614 · App. 18/960,035 · Granted Apr 1, 2025

Distributed command execution in multi-location studio environments

Inventors: Patrick Soon-Shiong (Los Angeles, CA); Gary Marshall (Los Angeles, CA); Keaton Heinrichs (Los Angeles, CA); John Wiacek (Los Angeles, CA); Nicholas James Witchey (Laguna Hills, CA)
Assignees: NantStudios, LLC; Nant Holdings IP, LLC
H04N5/2228G06F9/4881G06F9/546G06Q10/101G06F2209/548
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,267,614
App. No.
18/960,035
Granted
Apr 1, 2025
Kind
B1
Abstract

A distributed studio management system includes a computing system having a computer readable memory and a processor. The computing system is associated with a first production facility that is remote to a second production facility. The processor is configured to perform the operations of receiving a set of device commands having commands targeting first and second devices in the first production facility and where the set of device commands are related to the second production facility, enqueuing a first command from the device commands into a first command queue assigned to the first device and a second command from the device commands into a second command queue assigned to the second device according to each device command's synchronized execution times, and causing the first and second devices to execute commands from their respective command queues relative to each other according to the commands' respective synchronized execution times.

Claims (39)

1. A computer-based voxel management system for a distributed studio environment, the computer-based voxel management system comprising:

at least one non-transitory computer-readable memory storing software instructions; and

at least one processor coupled with the at least one memory that, upon execution of the software instruction perform the following operations:

dividing a filming volume into a set of voxels;

monitoring the set of voxels to determine if a voxel is occupied based on presence of entities within the filming volume;

receiving a set of commands controlling choreographing movement of the entities within the filming volume;

identifying potential conflicts of the entities in the voxels of the monitored set of voxels by simulation of execution of commands in the set of commands; and

generating new commands controlling the entities and resolving the identified potential conflicts.

2. The computer-based voxel management system of claim 1 , wherein the operations further include setting execution times for the new commands.

3. The computer-based voxel management system of claim 1 , wherein the operations further include generating a heat map indicating frequencies of execution of the set of commands in the set of voxels.

4. The computer-based voxel management system of claim 1 , wherein the operations further include assigning unique identifiers to individual voxels or groups of voxels.

5. The computer-based voxel management system of claim 4 , wherein the unique identifiers comprise at least one of the following: an IP address, a UUID, a GUID, a network endpoint, a location ID, and a voxel ID.

6. The computer-based voxel management system of claim 1 , wherein the operations further include forming a voxel or group of voxels as a virtual device.

7. The computer-based voxel management system of claim 1 , wherein the operations further include delaying execution of one of the new commands until presence of a target entity of the entities within a specific voxel of the set of voxels is detected.

8. The computer-based voxel management system of claim 1 , wherein the operations further include mapping the set of voxels to different set of voxels in a different filming volume.

9. The computer-based voxel management system of claim 8 , wherein the operations further include using a transform function to map the set of voxels to the different set of voxels.

10. The computer-based voxel management system of claim 1 , wherein the operations further include integrating multiple sets of voxels from different filming volumes into a virtual production volume.

11. The computer-based voxel management system of claim 1 , wherein the entities comprise at least one of the following: a prop, an actor, a camera, camera tracking equipment, a microphone, a light, a sensor, a speaker, an LED panel, a robot, an extra, stage crew, and a boom.

12. The computer-based voxel management system of claim 1 , wherein the entities include entities distributed across geographically distributed studios.

13. The computer-based voxel management system of claim 1 , wherein the operation of monitoring the set of voxels is conducted in real-time computer-based voxel management during filming.

14. The computer-based voxel management system of claim 1 , wherein the operations further include generating an alert of when at least one entity of the entities is about to enter an occupied voxel of the monitored set of voxels.

15. The computer-based voxel management system of claim 1 , wherein one or more voxels of the set of voxels have different sizes or shapes within the filming volume.

16. The computer-based voxel management system of claim 1 , wherein the operations further include associating command queues with specific voxels or groups of voxels of the set of voxels.

17. The computer-based voxel management system of claim 1 , wherein the simulation comprises a game engine simulating the execution of set of commands associated with the monitored set of voxels.

18. The computer-based voxel management system of claim 1 , wherein the operations of generating new commands includes adjusting timing of command execution of the set of commands to avoid conflicts.

19. The computer-based voxel management system of claim 1 , wherein the operation of generating new commands includes back-chaining through execution times of the set of commands to the resolve the potential conflicts.

20. The computer-based voxel management system of claim 1 , wherein the operations further include archiving a record of execution of the new commands on a notarized ledger.

21. A method for managing voxels for a distributed studio environment, the method comprising:

dividing a filming volume into a set of voxels;

monitoring the set of voxels to determine if a voxel is occupied based on presence of entities within the filming volume;

receiving a set of commands controlling choreographing movement of the entities within the filming volume;

identifying potential conflicts of the entities in the voxels of the monitored set of voxels by simulation of execution of commands in the set of commands; and

generating new commands controlling the entities and resolving the identified potential conflicts.

22. A non-transitory computer readable medium storing computer readable instructions, which when executed by processor hardware, causes a voxel management system including at least one processor to:

divide a filming volume into a set of voxels;

monitor the set of voxels to determine if a voxel is occupied based on presence of entities within the filming volume;

receive a set of commands controlling choreographing movement of the entities within the filming volume;

identify potential conflicts of the entities in the voxels of the monitored set of voxels by simulation of execution of commands in the set of commands; and

generate new commands controlling the entities and resolving the identified potential conflicts.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 26, 2024
From: MARSHALL, GARY; HEINRICHS, KEATON
To: NANTSTUDIOS, LLC
Reel/Frame 069410/0171 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 26, 2024
From: NANTWORKS, LLC
To: NANT HOLDINGS IP, LLC
Reel/Frame 069410/0330 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 26, 2024
From: WITCHEY, NICHOLAS JAMES; WIACEK, JOHN
To: NANTWORKS, LLC
Reel/Frame 069410/0221 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 26, 2024
From: SOON-SHIONG, PATRICK
To: NANT HOLDINGS IP, LLC
Reel/Frame 069410/0297 →
Continuity (5)
Continuation 18787107 · Jul 29, 2024
Continuation 18637937 · Apr 17, 2024
Continuation 18229867 · Aug 3, 2023
Continuation 17874728 · Jul 27, 2022
Provisional Application 63229674 · Aug 5, 2021
References Cited (27)
US 6178223B1 · Solomon · 2001 [cited by examiner]
US 6813221B1 · Barr · 2004 [cited by applicant]
US 6996261B2 · deCharms · 2006 [cited by examiner]
US 7313810B1 · Bell et al. · 2007 [cited by applicant]
US 7852372B2 · Sohmers · 2010 [cited by applicant]
US 8761860B2 · Peacock, III · 2014 [cited by examiner]
US 8964327B2 · Abe et al. · 2015 [cited by applicant]
US 9256384B2 · Bert et al. · 2016 [cited by applicant]
US 9264678B2 · Nuyttens et al. · 2016 [cited by applicant]
US 9304952B2 · Nango et al. · 2016 [cited by applicant]
US 9454789B2 · Lord · 2016 [cited by applicant]
US 9589479B1 · Regnier · 2017 [cited by applicant]
US 9602853B2 · Naggar et al. · 2017 [cited by applicant]
US 9734621B2 · Kuga · 2017 [cited by examiner]
US 10062141B2 · Lifshitz et al. · 2018 [cited by applicant]
US 10228880B2 · Berman et al. · 2019 [cited by applicant]
US 10652590B2 · Barnich et al. · 2020 [cited by applicant]
US 11461030B2 · Chen et al. · 2022 [cited by applicant]
US 12088949B2 · Soon-Shiong et al. · 2024 [cited by applicant]
US 20230046002A1 · Soon-Shiong et al. · 2023 [cited by applicant]
US 20230388439A1 · Soon-Shiong et al. · 2023 [cited by applicant]
WO 2015144014A1 · 2015 [cited by applicant]
International Search Report and Written Opinion from PCT Application No. PCT/US2022/038485 dated Oct. 13, 2022. [cited by applicant]
Anonymous (2021). AWS Step Functions Developer Guide, first 400 pages. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 18/229,867 dated Feb. 1, 2024. [cited by applicant]
Office Action from U.S. Appl. No. 18/637,937 dated May 22, 2024. [cited by applicant]
Office Action from U.S. Appl. No. 18/787,107 dated Sep. 26, 2024. [cited by applicant]