Determining a job group status based on a relationship between a generation counter value and a ticket value for scheduling the job group for execution
A job scheduler system includes one or more hardware processors, a memory including a job group queue stored in the memory, and a job scheduler engine configured to create a first job group in the job group queue, the first job group includes a generation counter having an initial value, receive a first request to steal the first job group, determine a state of the first job group based at least in part on the generation counter, the state indicating that the first job group is available to steal, based on the determining the state of the first job group, atomically increment the generation counter, thereby making the first job group unavailable for stealing, and alter an execution order of the first job group ahead of at least one other job group in the job group queue.
1. A system comprising:
one or more computer processors;
one or more computer memories;
a set of instructions stored in the one or more computer memories, the set of instructions configuring the one or more computer processors to perform operations, the operations comprising:
adding one or more jobs to a queue, the one or more jobs associated with a generation counter;
receiving a request to steal the one or more jobs, wherein the request to steal the one or more jobs is received by a first thread and a causing of the one or more jobs to be unavailable for stealing relates to a second thread;
modifying a value of the generation counter, the modifying signifying that the one or more jobs are unavailable for stealing; and
altering an execution order of the one or more jobs in the queue.
2. The system of claim 1 , wherein the value of the generation counter represents a state of the one or more jobs, wherein the state includes a queued state, a pushed state, or a finished state.
3. The system of claim 1 , wherein the modifying of the generation counter is performed atomically.
4. The system of claim 1 , the operations further comprising, based on a determining of one or more dependencies of one or more additional jobs on the one or more jobs, stealing the one or more additional jobs.
5. A system comprising:
one or more computer processors;
one or more computer memories;
a set of instructions stored in the one or more computer memories, the set of instructions configuring the one or more computer processors to perform operations, the operations comprising:
adding one or more jobs to a queue, the one or more jobs associated with a generation counter, wherein only one thread has access to the queue at a given time;
receiving a request to steal the one or more jobs;
modifying a value of the generation counter, the modifying signifying that the one or more jobs are unavailable for stealing; and
altering an execution order of the one or more jobs in the queue.
6. A system comprising:
one or more computer processors;
one or more computer memories;
a set of instructions stored in the one or more computer memories, the set of instructions configuring the one or more computer processors to perform operations, the operations comprising:
adding one or more jobs to a queue, the one or more jobs associated with a generation counter;
receiving a request to steal the one or more jobs;
modifying a value of the generation counter, the modifying signifying that the one or more jobs are unavailable for stealing, wherein the modifying of the value of the generation counter includes changing the generation counter with respect to a finished generation count; and
altering an execution order of the one or more jobs in the queue.
7. A method comprising:
adding one or more jobs to a queue, the one or more jobs associated with a generation counter;
receiving a request to steal the one or more jobs, wherein the request to steal the one or more jobs is received by a first thread and a causing of the one or more jobs to be unavailable for stealing relates to a second thread;
modifying a value of the generation counter, the modifying signifying that the one or more jobs are unavailable for stealing; and
altering an execution order of the one or more jobs in the queue.
8. The method of claim 7 , wherein the value of the generation counter represents a state of the one or more jobs, wherein the state includes a queued state, a pushed state, or a finished state.
9. The method of claim 7 , wherein the modifying of the generation counter is performed atomically.
10. The method of claim 7 , further comprising, based on a determining of one or more dependencies of one or more additional jobs on the one or more jobs, stealing the one or more additional jobs.
11. A method comprising:
adding one or more jobs to a queue, the one or more jobs associated with a generation counter, wherein only one thread has access to the queue at a given time;
receiving a request to steal the one or more jobs;
modifying a value of the generation counter, the modifying signifying that the one or more jobs are unavailable for stealing; and
altering an execution order of the one or more jobs in the queue.
12. A method comprising:
adding one or more jobs to a queue, the one or more jobs associated with a generation counter;
receiving a request to steal the one or more jobs;
modifying a value of the generation counter, the modifying signifying that the one or more jobs are unavailable for stealing, wherein the modifying of the value of the generation counter includes changing the generation counter with respect to a finished generation count; and
altering an execution order of the one or more jobs in the queue.
13. A non-transitory computer-readable storage medium including a set of instructions that, when executed by one or more computer processors, cause the one or more computer processors to perform operations, the operations comprising:
adding one or more jobs to a queue, the one or more jobs associated with a generation counter;
receiving a request to steal the one or more jobs, wherein the request to steal the one or more jobs is received by a first thread and a causing of the one or more jobs to be unavailable for stealing relates to a second thread;
modifying a value of the generation counter, the modifying signifying that the one or more jobs are unavailable for stealing; and
altering an execution order of the one or more jobs in the queue.
14. The non-transitory computer-readable storage medium of claim 13 , wherein the value of the generation counter represents a state of the one or more jobs, wherein the state includes a queued state, a pushed state, or a finished state.
15. The non-transitory computer-readable storage medium of claim 13 , wherein the modifying of the generation counter is performed atomically.
16. The non-transitory computer-readable storage medium of claim 13 , the operations further comprising, based on a determining of one or more dependencies of one or more additional jobs on the one or more jobs, stealing the one or more additional jobs.
17. A non-transitory computer-readable storage medium including a set of instructions that, when executed by one or more computer processors, cause the one or more computer processors to perform operations, the operations comprising:
adding one or more jobs to a queue, the one or more jobs associated with a generation counter, wherein only one thread has access to the queue at a given time;
receiving a request to steal the one or more jobs;
modifying a value of the generation counter, the modifying signifying that the one or more jobs are unavailable for stealing; and
altering an execution order of the one or more jobs in the queue.
18. The system of claim 5 , wherein the value of the generation counter represents a state of the one or more jobs, wherein the state includes a queued state, a pushed state, or a finished state.
19. The system of claim 5 , wherein the modifying of the generation counter is performed atomically.
20. The system of claim 5 , the operations further comprising, based on a determining of one or more dependencies of one or more additional jobs on the one or more jobs, stealing the one or more additional jobs.
21. The method of claim 11 , wherein the value of the generation counter represents a state of the one or more jobs, wherein the state includes a queued state, a pushed state, or a finished state.
22. The method of claim 11 , wherein the modifying of the generation counter is performed atomically.
23. The method of claim 11 , further comprising, based on a determining of one or more dependencies of one or more additional jobs on the one or more jobs, stealing the one or more additional jobs.
24. The non-transitory computer-readable storage medium of claim 17 , wherein the value of the generation counter represents a state of the one or more jobs, wherein the state includes a queued state, a pushed state, or a finished state.
25. The non-transitory computer-readable storage medium of claim 17 , wherein the modifying of the generation counter is performed atomically.
26. The non-transitory computer-readable storage medium of claim 17 , wherein the value of the generation counter represents a state of the one or more jobs, wherein the state includes a queued state, a pushed state, or a finished state.