Pre-computed dynamic instrumentation
A system and method for instrumenting program instructions. A processing system includes a compiler and a profiler. The compiler is configured to notify the profiler of a compilation event corresponding to first program instructions. In response to detecting the event, the profiler is configured to intercept compilation of the first program instructions, determine whether an instrumented version of the first program instructions is currently available, instruct the compiler to compile the instrumented version of the first program instructions if available, and retrieve and instrument the first program instructions if not available. The profiler may maintain an instrumentation cache for storing instrumented versions of program instructions. The instrumentation cache may further include metadata which identifies portions of program code which have been instrumented and their location. The profiler may generally instrument program instructions once during the resident life of a corresponding application.
1. A computer system comprising:
a processing system comprising a compiler and a profiler;
a non-volatile storage device configured to store program instructions including first program instructions; and
an instrumentation cache on the non-volatile storage device, wherein the instrumentation cache is configured to store instrumented versions of instructions included in the first program instructions in an uncompiled state;
wherein the compiler is configured to notify the profiler of a compilation event corresponding to the first program instructions;
wherein the profiler is configured to:
detect the event and intercept compilation first instructions of the first program instructions;
determine whether an instrumented version of the first instructions is currently available on the non-volatile storage device;
in response to determining the instrumented version of the first instructions is available, instruct the compiler to compile the instrumented version of the first instructions; and
in response to determining the instrumented version is not available:
retrieve and instrument the first instructions;
store the instrumented first instructions in the instrumentation cache in an uncompiled state; and
provide the instrumented first instructions to the compiler for compilation;
wherein in response to receiving the instrumented first instructions provided by the profiler, the compiler is configured to compile the instrumented first instructions.
2. The system as recited in claim 1 , wherein the profiler is configured to access the instrumentation cache on the non-volatile storage device to determine whether the instrumented version of the first program instructions is currently available.
3. The system as recited in claim 2 , wherein the first program instructions comprise an intermediate language, and wherein the compiler comprises a just in time compiler.
4. The system as recited in claim 3 , wherein the profiler is configured to register with the processing system to be notified of the event via a callback.
5. The system as recited in claim 2 , wherein the profiler is further configured to:
maintain first metadata which indicates whether an instrumented version of program instructions is available, and a location of such an instrumented version of program instructions within the instrumentation cache.
6. The system as recited in claim 5 , wherein the profiler is further configured to store second metadata which identifies a relationship between given uninstrumented program instructions and an instrumented version of the given uninstrumented program instructions, wherein the second metadata comprises a mapping of an original offset of given uninstrumented program instructions within an assembly to an offset of an instrumented version of the given program instructions.
7. The system as recited in claim 2 , further comprising a profiling API of a Microsoft .NET framework, and wherein the event comprises a JITCompilationStarted event.
8. The system as recited in claim 7 , wherein the first instructions correspond to a method, and wherein the profiler is configured to:
retrieve the first instructions using a GetILFunctionBody method; and
associate the instrumented version of the first instructions with the method using a SetILFunctionBody method.
9. The system as recited in claim 1 , wherein the profiler is further operable to instrument program instructions and store instrumented program instructions in the instrumentation cache on the non-volatile storage device prior to loading a corresponding application for execution.
10. A method for instrumenting program instructions comprising:
maintaining an instrumentation cache on a non-volatile storage device, wherein the instrumentation cache is configured to store instrumented versions of instructions included in first program instructions in an uncompiled state;
notifying a profiler of a compilation event corresponding to first instructions of the first program instructions;
detecting the event and intercepting the compilation of the first instructions;
determining whether an instrumented version of the first instructions is currently available on the non-volatile storage device;
in response to determining the instrumented version of the first instructions is available, instructing a compiler to compile the instrumented version of the first instructions; and
in response to determining the instrumented version is not available:
retrieving and instrumenting the first instructions;
storing the instrumented first instructions in the instrumentation cache in an uncompiled state; and
providing the instrumented first instructions to the compiler for compilation;
wherein in response to receiving the instrumented first instructions provided by the profiler, the compiler compiling the instrumented first instructions.
11. The method as recited in claim 10 , further comprising accessing the instrumentation cache on the non-volatile storage device to determine whether the instrumented version of the first instructions is currently available.
12. The method as recited in claim 11 , wherein the first program instructions comprise an intermediate language, and the method comprises using a just in time compiler to compile program instructions.
13. The method as recited in claim 12 , further comprising a profiler registering to be notified of the event via a callback.
14. The method as recited in claim 11 , further comprising:
maintaining first metadata which indicates whether an instrumented version of program instructions is available, and a location of such an instrumented version of program instructions within the instrumentation cache.
15. The method as claim 14 , further comprising storing second metadata which identifies a relationship between given uninstrumented program instructions and an instrumented version of the given uninstrumented program instructions, wherein the second metadata comprises a mapping of an original offset of given uninstrumented program instructions within an assembly to an offset of an instrumented version of the given program instructions.
16. The method as recited in claim 11 , further comprising a profiling API of a Microsoft .NET framework, and wherein the event comprises a JITCompilationStarted event.
17. The method as recited in claim 16 , wherein the first instructions correspond to a method, and wherein the method further comprises:
retrieving the first instructions using a GetILFunctionBody method; and
associating the instrumented version of the first instructions with the method using a SetILFunctionBody method.
18. The method as recited in claim 10 , further comprising instrumenting program instructions of an application and storing instrumented program instructions in an instrumentation cache on the non-volatile storage device prior to loading the application for execution.
19. A computer readable medium comprising program instructions, wherein when executed the program instructions are operable to:
maintain an instrumentation cache on a non-volatile storage device, wherein the instrumentation cache is configured to store instrumented versions of instructions included in first program instructions in an uncompiled state;
notify a profiler of a compilation event corresponding to first instructions of the first program instructions;
detect the event and intercept the compilation of the first instructions;
determine whether an instrumented version of the first instructions is currently available on a non-volatile storage device;
in response to determining the instrumented version of the first instructions is available, instruct a compiler to compile the instrumented version of the first instructions; and
in response to determining the instrumented version is not available:
retrieve and instrumenting the first instructions;
store the instrumented first instructions in the instrumentation cache in an uncompiled state; and
provide the instrumented first instructions to the compiler for compilation;
in response to receiving the instrumented first instructions provided by the profiler, compile the instrumented first instructions.
20. The computer readable medium as recited in claim 19 , wherein the program instructions are further operable to access the instrumentation cache on the non-volatile storage device to determine whether the instrumented version of the first instructions is currently available.
21. The computer readable medium as recited in claim 20 , wherein the program instructions are further operable to:
maintain first metadata which indicates whether an instrumented version of program instructions is available, and a location of such an instrumented version of program instructions within the instrumentation cache.
22. The computer readable medium as claim 21 , wherein the program instructions are further operable to store second metadata which identifies a relationship between given uninstrumented program instructions and an instrumented version of the given uninstrumented program instructions, wherein the second metadata comprises a mapping of an original offset of given uninstrumented program instructions within an assembly to an offset of an instrumented version of the given program instructions.
23. The computer readable medium as recited in claim 19 , wherein the program instructions are further operable to instrument program instructions of an application and store instrumented program instructions in an instrumentation cache prior to loading the application for execution.