Hierarchical dynamic scheduling
Hierarchical dynamic scheduling is disclosed. A plurality of physical nodes is included in a computer system. Each node includes a plurality of processors. Each processor includes a plurality of hyperthreads. An abstraction of the nodes, processors, and hyperthreads forms a hierarchy. Upon receiving an indication that a hyperthread should be assigned, a dynamic search of the hierarchy is performed, beginning at the leaf level, for a process to assign to the hyperthread.
1. A computer system, comprising:
a plurality of physical nodes, wherein each node includes a plurality of processors, and wherein an operating system is run collectively across the plurality of physical nodes;
wherein an abstraction of a configuration of the physical nodes and processors forms a hierarchy;
wherein, in response to an indication that a hyperthread included in a core of a processor is available for assignment, a dynamic search of the hierarchy is performed for continuations that are ready to run, wherein a continuation comprises a representation of a state of a suspended virtual processor, wherein the continuation comprises processor state including a set of saved registers, and wherein a virtual processor comprises a computing engine visible to the operating system;
wherein a node in the hierarchy is associated with a queue comprising a set of continuations that are ready to run, wherein the dynamic search begins at a leaf level of the hierarchy, and wherein the leaf level of the hierarchy corresponds to hyperthreads included in cores of the processors in the configuration;
wherein performing the dynamic search includes evaluating a cost function to determine which continuation to assign to the hyperthread, wherein evaluating the cost function includes determining an amount of time that a continuation has been queued, and wherein in response to determining that a continuation comprising a state of a suspended virtual processor is not identified in a queue at the leaf level of the hierarchy corresponding to the hyperthreads included in the cores of the processors of the configuration the dynamic search proceeds up the hierarchy; and
wherein a continuation to assign to the hyperthread is selected based at least in part on the dynamic search of the hierarchy, wherein the hyperthread is configured to resume execution of the selected continuation, and wherein resuming execution of the selected continuation includes implementing, on the hyperthread, a virtual processor associated with the selected continuation.
2. The computer system of claim 1 wherein the hyperthread is available for assignment subsequent to becoming blocked.
3. The computer system of claim 2 wherein the blocked hyperthread is designated an anonymous processor in response to becoming blocked.
4. The computer system of claim 2 wherein a continuation is dynamically created and stored in an event table in response to an indication that the hyperthread is blocked.
5. The computer system of claim 4 wherein the event table is stored on the node on which the hyperthread is located.
6. The computer system of claim 4 wherein the event table includes a plurality of continuations.
7. The computer system of claim 1 wherein the dynamic search is performed by a hyper-kernel.
8. The computer system of claim 1 , wherein the hierarchy comprises a set of scheduler objects, and wherein the node in the hierarchy comprises a scheduler object including the queue.
9. A method, comprising:
in response to an indication that a hyperthread included in a core of a processor is available for assignment, dynamically searching a hierarchy for continuations that are ready to run wherein the hierarchy comprises an abstraction of a configuration of a plurality of physical nodes and processors running on the physical nodes, wherein an operating system is run collectively across the plurality of physical nodes, wherein a continuation comprises a representation of a state of a suspended virtual processor, wherein the continuation comprises processor state including a set of saved registers, and wherein a virtual processor comprises a computing engine visible to the operating system;
wherein a node in the hierarchy is associated with a queue comprising a set of continuations that are ready to run, wherein the dynamic search begins at a leaf level of the hierarchy, and wherein the leaf level of the hierarchy corresponds to hyperthreads included in cores of the processors in the configuration;
wherein performing the dynamic search includes evaluating a cost function to determine which continuation to assign to the hyperthread, wherein evaluating the cost function includes determining an amount of time that a continuation has been queued, and wherein in response to determining that a continuation comprising a state of a suspended virtual processor is not identified in a queue at the leaf level of the hierarchy corresponding to the hyperthreads included in the cores of the processors of the configuration the dynamic search proceeds up the hierarchy; and
selecting, based at least in part on the dynamic search of the hierarchy, a continuation to assign to the hyperthread, wherein the hyperthread is configured to resume execution of the selected continuation, and wherein resuming execution of the selected continuation includes implementing, on the hyperthread, a virtual processor associated with the selected continuation.
10. The method of claim 9 , wherein the hyperthread is available for assignment subsequent to becoming blocked.
11. The method of claim 10 , wherein a continuation is dynamically created and stored in an event table in response to receiving an indication that the hyperthread is blocked.
12. The method of claim 11 , wherein the event table includes a plurality of continuations.
13. The method of claim 9 , wherein the dynamic search is performed by a hyper-kernel.
14. The method of claim 9 , wherein the hierarchy comprises a set of scheduler objects, and wherein the node in the hierarchy comprises a scheduler object including the queue.