IP Library Granted Patent US 11,599,385
Granted Patent B2
US 11,599,385 · App. 16/530,734 · Granted Mar 7, 2023

System and method for distribution of dependent builds across orchestration job scheduler slaves

Inventors: Robert A. Ballantyne (Mansfield, MA); Robert J. Bell (Mont Vernon, NH); Andrew Daolong Fan (Shanghai, CN); Moshe Fried (Raanana, IL); Henrik Koren (Petach Tikva, IL); Tadd V. Ottman (Hayward, CA)
Assignee: EMC IP Holding Company LLC
G06F9/4881G06F8/36G06F8/70G06F11/3688
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,599,385
App. No.
16/530,734
Granted
Mar 7, 2023
Kind
B2
Abstract

A method, computer program product, and computer system for obtaining an input for a build. An initial orchestration job scheduler object may be obtained based upon the input for the build. A directed acyclic graph (DAG) may be determined based upon, at least in part, a dependency engine preprocessing. The DAG may be stored in a format. An array of steps may be built based upon, at least in part, the object, wherein the DAG may be translated from the object into a format readable by an initial orchestration job scheduler to build the array of steps. The array of steps may be executed to perform the build.

Claims (46)

1. A computer-implemented method comprising:

obtaining an input for a build, wherein a source code management repository, including one or more pointers, is used to provide a consistent snapshot in time across one or more repositories to obtain the input for the build, wherein each of the one or more pointers are associated with a respective component repository, wherein obtaining the input for the build includes updating at least one pointer of the one or more pointers only when the build is achieved;

obtaining an initial orchestration job scheduler object based upon the input for the build;

determining a directed acyclic graph (DAG) based upon, at least in part, a dependency engine preprocessing;

storing the DAG in a format;

building an array of steps based upon, at least in part, the initial orchestration job scheduler object;

translating information in the DAG from the initial orchestration job scheduler object into a format readable by an initial orchestration job scheduler to build the array of steps, wherein the building of the array of steps includes:

passing the information in the DAG translated into the readable format to a pipeline and dynamically generating a collection of nodes required for the building of the array of steps, wherein each of the array of steps is associated with at least one label configured to specify on which node, of the collection of nodes, each of the array of steps should be executed on; and

sequencing the array of steps using the pipeline according to the DAG, wherein the array of steps according to the DAG includes one or more orchestration job scheduler slaves; and

executing the array of steps to perform the build.

2. The computer-implemented method of claim 1 , wherein a repository is cloned from the consistent snapshot to obtain the initial orchestration job scheduler object.

3. The computer-implemented method of claim 2 , wherein at least one component repository is skipped in the cloning based upon, at least in part, the DAG.

4. The computer-implemented method of claim 1 , further comprising aggregating the array of steps.

5. The computer-implemented method of claim 1 , further comprising initializing one or more systems associated with the build for testing.

6. The computer-implemented method of claim 5 , further comprising executing the testing.

7. The computer-implemented method of claim 1 , wherein the DAG is stored using low level preprocess data from the dependency engine preprocessing.

8. The computer-implemented method of claim 1 , wherein the pipeline processes the DAG translated into the readable format to achieve a distributed build pipeline before the build execution.

9. A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising:

obtaining an input for a build, wherein a source code management repository, including one or more pointers, is used to provide a consistent snapshot in time across one or more repositories to obtain the input for the build, wherein each of the one or more pointers are associated with a respective component repository, wherein obtaining the input for the build includes updating at least one pointer of the one or more pointers only when the build is achieved;

obtaining an initial orchestration job scheduler object based upon the input for the build;

determining a directed acyclic graph (DAG) based upon, at least in part, a dependency engine preprocessing;

storing the DAG in a format;

building an array of steps based upon, at least in part, the initial orchestration job scheduler object;

translating information in the DAG from the initial orchestration job scheduler object into a format readable by an initial orchestration job scheduler to build the array of steps, wherein the building of the array of steps includes:

passing the information in the DAG translated into the readable format to a pipeline and dynamically generating a collection of nodes required for the building of the array of steps, wherein each of the array of steps is associated with at least one label configured to specify on which node, of the collection of nodes, each of the array of steps should be executed on; and

sequencing the array of steps using the pipeline according to the DAG, wherein the array of steps according to the DAG includes one or more orchestration job scheduler slaves; and

executing the array of steps to perform the build.

10. The computer program product of claim 9 , wherein a repository is cloned from the consistent snapshot to obtain the initial orchestration job scheduler object.

11. The computer program product of claim 10 , wherein at least one component repository is skipped in the cloning based upon, at least in part, the DAG.

12. The computer program product of claim 9 , wherein the operations further comprise aggregating the array of steps.

13. The computer program product of claim 9 , wherein the operations further comprise initializing one or more systems associated with the build for testing.

14. The computer program product of claim 13 , wherein the operations further comprise executing the testing.

15. A computing system including one or more processors and one or more memories configured to perform operations comprising:

obtaining an input for a build, wherein a source code management repository, including one or more pointers, is used to provide a consistent snapshot in time across one or more repositories to obtain the input for the build, wherein each of the one or more pointers are associated with a respective component repository, wherein obtaining the input for the build includes updating at least one pointer of the one or more pointers only when the build is achieved;

obtaining an initial orchestration job scheduler object based upon the input for the build;

determining a directed acyclic graph (DAG) based upon, at least in part, a dependency engine preprocessing;

storing the DAG in a format;

building an array of steps based upon, at least in part, the initial orchestration job scheduler object;

translating information in the DAG from the initial orchestration job scheduler object into a format readable by an initial orchestration job scheduler to build the array of steps, wherein the building of the array of steps includes:

passing the information in the DAG translated into the readable format to a pipeline and dynamically generating a collection of nodes required for the building of the array of steps, wherein each of the array of steps is associated with at least one label configured to specify on which node, of the collection of nodes, each of the array of steps should be executed on; and

sequencing the array of steps using the pipeline according to the DAG, wherein the array of steps according to the DAG includes one or more orchestration job scheduler slaves; and

executing the array of steps to perform the build.

16. The computing system of claim 15 , wherein a repository is cloned from the consistent snapshot to obtain the initial orchestration job scheduler object.

17. The computing system of claim 16 , wherein at least one component repository is skipped in the cloning based upon, at least in part, the DAG.

18. The computing system of claim 15 , wherein the operations further comprise aggregating the array of steps.

19. The computing system of claim 15 , wherein the operations further comprise initializing one or more systems associated with the build for testing and executing the testing.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0571) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0088 →
RELEASE OF SECURITY INTEREST AT REEL 050406 FRAME 421 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058213/0825 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 15, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 050724/0571 →
SECURITY AGREEMENT Recorded Sep 17, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 050406/0421 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2019
From: BALLANTYNE, ROBERT A; BELL, ROBERT J; FAN, ANDREW DAOLONG; FRIED, MOSHE; KOREN, HENRIK; OTTMAN, TADD V
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 049946/0801 →