System and method for process and data observation in a networked service environment
Embodiments as disclosed herein provide computing systems and methods that effectively serve to isolate processes in a computing environment. The isolation of such processes may serve additionally to substantially increase the observability of such processes, allowing a granular insight into data associated with those processes and the performing of individual tasks.
1. A system, comprising:
a non-transitory computer readable medium, comprising instructions for a task handler, the task handler comprising:
a parent portion adapted for executing in a parent process to:
initialize a first task;
receive a first request for the first task over a first connection to a first communication channel;
accept the first request for the first task over the first connection to the first communication channel without reading data from the first request;
create a first child process and providing the first connection to the first communication channel associated with the first request to the first child process without reading data from the first connection to the first communication channel associated with the first request, wherein the first child process is a copy of the parent process executing in a first separate process space from the parent process and the parent process configures the first child process to start execution at a child entry point associated with a child portion of the task handler;
create a first child tracking entry associated with the first child process in a process map;
receive first data associated with the execution of the first child process from the first child process over a second communication channel;
store the received first data associated with the execution of the first child process in the first child tracking entry; and
the child portion of the task handler is adapted for executing in the first child process to:
read the first request over the first connection to the first communication channel to identify the requested first task;
invoke the identified requested first task to perform the first request;
provide a first response to the first request directly from the first child process over the first connection to the first communication channel without involvement of the parent process;
determine the first data associated with the execution of the first child process; and
send the first data associated with the execution of the first child process to the parent process over the second communication channel.
2. The system of claim 1 , wherein creating the first child process comprises forking the parent process.
3. The system of claim 1 , wherein the first communication channel and the second communication are different.
4. The system of claim 3 , wherein the first communication channel is a TCP channel and the second communication channel is a UDP channel.
5. The system of claim 1 , wherein the parent portion is further adapted for executing in the parent process to:
receive a second request for a second task over a second connection to the first communication channel;
accept the second request for the second task over the second connection to the first communication channel without reading data from the second request;
create a second child process and provide the second connection to the first communication channel associated with the first request to the second child process without reading data from the second connection to the first communication channel associated with second request, wherein the second child process is a copy of the parent process executing in a second separate process space from the parent process and the parent process configures the second child process to start execution at the child entry point associated with the child portion of the task handler;
create a second child tracking entry associated with the second child process in the process map;
receive second data associated with the execution of the second child process from the second child process over the second communication channel;
store the received second data associated with the execution of the second child process in the second child tracking entry; and
the child portion of the task handler is adapted for executing in the second child process to:
read the second request over the second connection to the first communication channel to identify the requested second task;
invoke the identified second task to perform the second request;
provide a second response to the second request directly from the second child process over the second connection to the first communication channel without involvement of the parent process;
determine the second data associated with the execution of the second child process; and
send the second data associated with the execution of the second child process to the parent process over the second communication channel.
6. The system of claim 5 , wherein the second task is different than the first task.
7. The system of claim 1 , wherein first data associated with execution of the first child process comprises memory usage statistics, I/O statistics, or timing statistics on the first child process obtained from an operating system by the first child process.
8. A non-transitory computer readable medium, comprising instructions for:
a task handler, the task handler comprising:
a parent portion adapted for executing in a parent process to:
initialize a first task;
receive a first request for the first task over a first connection to a first communication channel;
accept the first request for the first task over the first connection to the first communication channel without reading data from the first request;
create a first child process and providing the first connection to the first communication channel associated with the first request to the first child process without reading data from the first connection to the first communication channel associated with first request, wherein the first child process is a copy of the parent process executing in a first separate process space from the parent process and the parent process configures the first child process to start execution at a child entry point associated with a child portion of the task handler;
create a first child tracking entry associated with the first child process in a process map;
receive first data associated with the execution of the first child process from the first child process over a second communication channel;
store the received first data associated with the execution of the first child process in the first child tracking entry; and
the child portion of the task handler is adapted for executing in the first child process to:
read the first request over the first connection to the first communication channel to identify the requested first task;
invoke the identified requested first task to perform the first request;
provide a first response to the first request directly from the first child process over the first connection to the first communication channel without involvement of the parent process;
determine the first data associated with the execution of the first child process; and
send the first data associated with the execution of the first child process to the parent process over the second communication channel.
9. The non-transitory computer readable medium of claim 8 , wherein creating the first child process comprises forking the parent process.
10. The non-transitory computer readable medium of claim 8 , wherein the first communication channel and the second communication are different.
11. The non-transitory computer readable medium of claim 10 , wherein the first communication channel is a TCP channel and the second communication channel is a UDP channel.
12. The non-transitory computer readable medium of claim 8 , wherein the parent portion is further adapted for executing in the parent process to:
receive a second request for a second task over a second connection to the first communication channel;
accept the second request for the second task over the second connection to the first communication channel without reading data from the second request;
create a second child process and provide the second connection to the first communication channel associated with the first request to the second child process without reading data from the second connection to the first communication channel associated with second request, wherein the second child process is a copy of the parent process executing in a second separate process space from the parent process and the parent process configures the second child process to start execution at the child entry point associated with the child portion of the task handler;
create a second child tracking entry associated with the second child process in the process map;
receive second data associated with the execution of the second child process from the second child process over the second communication channel;
store the received second data associated with the execution of the second child process in the second child tracking entry; and
the child portion of the task handler is adapted for executing in the second child process to:
read the second request over the second connection to the first communication channel to identify the requested second task;
invoke the identified second task to perform the second request;
provide a second response to the second request directly from the second child process over the second connection to the first communication channel without involvement of the parent process;
determine the second data associated with the execution of the second child process; and
send the second data associated with the execution of the second child process to the parent process over the second communication channel.
13. The non-transitory computer readable medium of claim 12 , wherein the second task is different than the first task.
14. The non-transitory computer readable medium of claim 8 , wherein first data associated with execution of the first child process comprises memory usage statistics, I/O statistics, or timing statistics on the first child process obtained from an operating system by the first child process.
15. A method, comprising:
providing a task handler, the task handler comprising:
a parent portion adapted for executing in a parent process to:
initialize a first task;
receive a first request for the first task over a first connection to a first communication channel;
accept the first request for the first task over the first connection to the first communication channel without reading data from the first request;
create a first child process and providing the first connection to the first communication channel associated with the first request to the first child process without reading data from the first connection to the first communication channel associated with first request, wherein the first child process is a copy of the parent process executing in a first separate process space from the parent process and the parent process configures the first child process to start execution at a child entry point associated with a child portion of the task handler;
create a first child tracking entry associated with the first child process in a process map;
receive first data associated with the execution of the first child process from the first child process over a second communication channel;
store the received first data associated with the execution of the first child process in the first child tracking entry; and
the child portion of the task handler is adapted for executing in the first child process to:
read the first request over the first connection to the first communication channel to identify the requested first task;
invoke the identified requested first task to perform the first request;
provide a first response to the first request directly from the first child process over the first connection to the first communication channel without involvement of the parent process;
determine the first data associated with the execution of the first child process; and
send the first data associated with the execution of the first child process to the parent process over the second communication channel.
16. The method of claim 15 , wherein creating the first child process comprises forking the parent process.
17. The method of claim 15 , wherein the first communication channel and the second communication are different.
18. The method of claim 17 , wherein the first communication channel is a TCP channel and the second communication channel is a UDP channel.
19. The method of claim 15 , wherein the parent portion is further adapted for executing in the parent process to:
receive a second request for a second task over a second connection to the first communication channel;
accept the second request for the second task over the second connection to the first communication channel without reading data from the second request;
create a second child process and provide the second connection to the first communication channel associated with the first request to the second child process without reading data from the second connection to the first communication channel associated with second request, wherein the second child process is a copy of the parent process executing in a second separate process space from the parent process and the parent process configures the second child process to start execution at the child entry point associated with the child portion of the task handler;
create a second child tracking entry associated with the second child process in the process map;
receive second data associated with the execution of the second child process from the second child process over the second communication channel;
store the received second data associated with the execution of the second child process in the second child tracking entry; and
the child portion of the task handler is adapted for executing in the second child process to:
read the second request over the second connection to the first communication channel to identify the requested second task;
invoke the identified second task to perform the second request;
provide a second response to the second request directly from the second child process over the second connection to the first communication channel without involvement of the parent process;
determine the second data associated with the execution of the second child process; and
send the second data associated with the execution of the second child process to the parent process over the second communication channel.
20. The method of claim 19 , wherein the second task is different than the first task.
21. The method of claim 15 , wherein first data associated with execution of the first child process comprises memory usage statistics, I/O statistics, or timing statistics on the first child process obtained from an operating system by the first child process.