System and method for processing recursive invocations within a program build
View Patent ↗A method for executing program builds is described comprising: executing jobs for a program build in parallel according to a first job schedule; detecting a recursive build invocation in one of the jobs; analyzing dependency information associated with the recursive build invocation; and based on the analysis, supplementing the first job schedule with additional job schedule data.
1. A method for executing program builds comprising:
executing jobs for a program build in parallel according to a first job schedule;
detecting a recursive Make invocation in one of the jobs;
analyzing dependency information associated with the recursive Make invocation to generate additional job schedule data;
based on the analysis, supplementing the first job schedule with the additional job schedule data; and
executing additional jobs according to the additional job schedule data.
2. The method as in claim 1 wherein the dependency information is a Makefile.
3. The method as in claim 1 further comprising:
inhibiting the detected recursive Make invocation prior to performing the analysis of the dependency information associated with the recursive Make invocation.
4. The method as in claim 3 further comprising:
dividing the job which contained the recursive Make invocation into multiple jobs.
5. The method as in claim 4 wherein dividing comprises dividing the job at a point within the job where the recursive Make invocation was detected.
6. The method as in claim 1 further comprising:
detecting whether a command within the job depends on a result of the recursive Make invocation; and
dividing the job into multiple jobs only if a command within the job depends on the result of the recursive Make invocation.
7. A system having at least one processor comprising:
a plurality of nodes to execute a plurality of jobs for a program build in parallel according to a job schedule;
a recursive Make invocation redirector configured on one or more of the nodes to detect recursive Make invocations contained within the jobs to generate additional job schedule data;
one or more worker modules to analyze the dependency information associated with the recursive Make invocation and, based on the analysis, to supplement the first job schedule with the additional job schedule data, wherein the plurality of nodes execute additional jobs according to the additional job schedule data.
8. The system as in claim 7 wherein the dependency information is a Makefile.
9. The system as in claim 7 wherein the recursive Make invocation redirector inhibits the detected recursive Make invocation before the worker modules perform the analysis of the dependency information associated with the recursive Make invocation.
10. The system as in claim 9 wherein the worker modules or the recursive Make invocation redirector divide the job which contained the recursive Make invocation into multiple jobs.
11. The system as in claim 10 wherein dividing comprises dividing the job at a point within the job where the recursive Make invocation was detected.
12. The system as in claim 10 wherein the recursive Make invocation redirector or the worker modules detect whether a command within the job depends on a result of the recursive Make invocation and divide the job into multiple jobs only if the command within the job depends on the result of the recursive Make invocation.
13. An article of manufacture having program code stored thereon which, when executed by a machine, causes the machine to perform the operations of:
executing jobs for a program build in parallel according to a first job schedule;
detecting a recursive Make invocation in one of the jobs;
analyzing dependency information associated with the recursive Make invocation to generate additional job schedule data;
supplementing the first job schedule with the additional job schedule data based on the analysis of the dependency information; and
executing additional jobs according to the additional job schedule data.
14. The article of manufacture as in claim 13 wherein the dependency information is a Makefile.
15. The article of manufacture as in claim 13 having program code stored thereon to cause said machine to perform the additional operations of:
inhibiting the detected recursive Make invocation prior to performing the analysis of the dependency information associated with the recursive Make invocation.
16. The article of manufacture as in claim 15 having program code stored thereon to cause said machine to perform the additional operations of:
dividing the job which contained the recursive Make invocation into multiple jobs.
17. The article of manufacture as in claim 16 wherein dividing comprises dividing the job at a point within the job where the recursive Make invocation was detected.
18. The article of manufacture as in claim 13 having program code stored thereon to cause said machine to perform the additional operations of:
detecting whether a command within the job depends on a result of the recursive Make invocation; and
dividing the job into multiple jobs only if a command within the job depends on the result of the recursive Make invocation.