Methods and systems for dynamically optimizing and modifying allocation of virtual resources to processes
A method for dynamically optimizing and modifying allocation of virtual resources to processes includes allocating, by a first hypervisor, a first amount of a first virtual resource to a process executing in a virtual machine on a first machine. An agent, in communication with a resource allocation process executing in the virtual machine, determines a second amount of the first virtual resource to be utilized by the process. A scheduler receives an identification of the determined second amount and directs migration of the process to a second machine. A second hypervisor executing on the second machine allocates a third amount of the first virtual resource, the third amount substantially similar to the second amount. The method includes communicating, by the resource allocation process, to the process, that the first amount of the first virtual resource is allocated to the at least one process.
1 . A method for dynamically optimizing and modifying allocation of virtual resources to containerized processes, the method comprising:
allocating, by a first hypervisor executing on a first machine, a first amount of a first virtual resource to a container image executing on the first machine and including a containerized process, the first virtual resource associated with at least one physical resource of the first machine;
determining, by an agent in communication with a resource allocation process executing in an instance of the container image, a second amount of the first virtual resource to be utilized by the containerized process;
transmitting, by the agent to a scheduler, an identifier of the determined second amount;
determining, by the scheduler, that the determined second amount is different than the allocated first amount;
directing, by the scheduler, migration of the containerized process, during execution of the containerized process, to a second machine based upon the determined second amount;
allocating, by a second hypervisor executing on the second machine, a third amount of the first virtual resource, wherein the third amount is the same as the determined second amount;
directing, by the scheduler, a pause in execution of a first subset of threads in a plurality of threads of the containerized process;
directing, by the scheduler, during continued execution of a second subset of threads in the plurality of threads of the containerized process, migration of the containerized process to the second machine;
directing, by the scheduler, continued execution of the first subset and the second subset of threads in the plurality of threads of the containerized process upon completion of the migration of the containerized process to the second machine; and
communicating, by the resource allocation process, to the containerized process, that the first amount of the first virtual resource is allocated to the containerized process.
2 . The method of claim 1 , wherein determining the second amount further comprises determining by an agent executing in a user space of the instance of the container image.
3 . The method of claim 1 , wherein determining the second amount further comprises determining by an agent executing in a kernel space of the instance of the container image.
4 . The method of claim 1 , wherein determining the second amount further comprises receiving, by the agent, user input from a user of the containerized process providing data for use in determining the second amount.
5 . The method of claim 1 , wherein determining the second amount further comprises receiving, by the agent, from the containerized process, data for use in determining the second amount.
6 . The method of claim 1 further comprising:
monitoring, by the agent in communication with the resource allocation process, utilization of the first virtual resource by the containerized process;
identifying, by the agent, a modification to a utilization rate by the containerized process of the first virtual resource;
communicating, by the agent, to the scheduler, the identified modification;
directing, by the scheduler, a pause in execution of a first subset of threads in a plurality of threads of the containerized process;
directing, by the scheduler, during continued execution of a second subset of threads in the plurality of threads of the containerized process, migration of the containerized process to a third machine; and
directing, by the scheduler, continued execution of the first subset and the second subset of threads in the plurality of threads of the containerized process upon completion of the migration of the containerized process to the third machine.
7 . A method for dynamically optimizing and modifying allocation of virtual resources to a process executing in a virtual machine, the method comprising:
allocating, by a first hypervisor executing on a first machine, a first amount of a first virtual resource to a process executing in a virtual machine, the first virtual resource associated with at least one physical resource of the first machine;
determining, by an agent in communication with a resource allocation process executing in the virtual machine, a second amount of the first virtual resource to be utilized by the process;
transmitting, by the agent to a scheduler, an identifier of the determined second amount;
determining, by the scheduler, that the determined second amount is different than the allocated first amount;
directing, by the scheduler, migration of the process to a second machine based upon the determined second amount;
allocating, by a second hypervisor executing on the second machine, a third amount of the first virtual resource, wherein the third amount is the same as the second amount;
directing, by the scheduler, a pause in execution of a first subset of threads in a plurality of threads of the containerized process;
directing, by the scheduler, during continued execution of a second subset of threads in the plurality of threads of the containerized process, migration of the containerized process to the second machine;
directing, by the scheduler, continued execution of the first subset and the second subset of threads in the plurality of threads of the containerized process upon completion of the migration of the containerized process to the second machine; and
communicating, by the resource allocation process, to the process, that the first amount of the first virtual resource is allocated to the process.
8 . The method of claim 7 , wherein determining the second amount further comprises determining by an agent executing in a user space of the virtual machine.
9 . The method of claim 7 , wherein determining the second amount further comprises determining by an agent executing in a kernel space of the virtual machine.
10 . The method of claim 7 , wherein determining the second amount further comprises receiving, by the agent, user input from a user of the process providing data for use in determining the second amount.
11 . The method of claim 7 , wherein determining the second amount further comprises receiving, by the agent, from the process, data for use in determining the second amount.
12 . The method of claim 7 further comprising:
monitoring, by the agent in communication with the resource allocation process, utilization of the first virtual resource by the process;
identifying, by the agent, a modification to a utilization rate by the process of the first virtual resource;
communicating, by the agent, to the scheduler, the identified modification;
directing, by the scheduler, a pause in execution of a first subset of threads in a plurality of threads of the process;
directing, by the scheduler, during continued execution of a second subset of threads in the plurality of threads of the process, migration of the process to a third machine; and
directing, by the scheduler continued execution of the first subset and the second subset of threads in the plurality of threads of the process upon completion of the migration of the process to the third machine.
13 . A system for dynamically optimizing and modifying allocation of virtual resources to containerized processes comprising:
first hypervisor executing on a first machine allocating a first amount of a first virtual resource to a container image executing on the first machine and including a process, the first virtual resource associated with at least one physical resource of the first machine;
an agent determining a second amount of the first virtual resource to be utilized by the process;
a scheduler receiving, from the agent, an identifier of the determined second amount, determining that the determined second amount is different than the allocated first amount, directing migration of the process, during execution of the process, to a second machine based upon the determined second amount, wherein directing further comprises:
directing a pause in execution of a first subset of threads in a plurality of threads of the containerized process,
directing during continued execution of a second subset of threads in the plurality of threads of the containerized process, migration of the containerized process to the second machine, and
directing continued execution of the first subset and the second subset of threads in the plurality of threads of the containerized process upon completion of the migration of the containerized process to the second machine;
a second hypervisor executing on the second machine allocating a third amount of the first virtual resource, wherein the third amount is the same as the determined second amount; and
a resource allocation process, executing in the second virtual machine and in communication with the agent, communicating, to the process on the second machine, that the first amount of the first virtual resource is allocated to the process.
14 . The system of claim 13 , wherein the agent further comprises an agent executing in the first machine.
15 . The system of claim 13 , wherein the scheduler executes on a third machine.
16 . The system of claim 13 , wherein the agent and the scheduler execute on a third machine.
17 . The system of claim 13 , wherein the resource allocation process is a kernel of the second machine.
18 . The system of claim 13 , wherein the resource allocation process is a driver executed by a kernel of the second machine.