System and method for data payload collection monitoring and analysis in a transaction processing environment
A self-describing data format capable of carrying payload information, such as Tuxedo payload information, as well as filter information. The data format can allow for expression of some or all of Tuxedo Typed Buffers, including STRING, CARRAY, MBSTRING, VIEW, VIEW32, FML, and FML32. The data format is also capable of supporting nesting and error-checking. The proposal of user payload collection can allow customers to siphon off user/payload data to be used in applications, such as Business Intelligence applications, without the need for additional information to be passed with the payload data.
1. A method for supporting data payload collection in a transactional middleware machine environment, comprising:
providing, a monitoring framework, including a data collection engine, the monitoring framework monitoring a transaction within the middleware machine environment;
capturing, at the monitoring framework, transactional procedure data of the monitored transaction;
writing the transactional procedure data in a self-describing format to a buffer, wherein the self-describing format carries filter information and user payload data; and
filtering, based on the filter information, the user payload data from the self-describing data format;
wherein the self-describing data format expresses a plurality of typed buffers, the plurality of typed buffers comprising both self-describing and non-self-describing formats; and
wherein the self-describing data format provides an error checking mechanism for the user payload data carried by the self-describing data format.
2. The method of claim 1 , further comprising:
passing the filtered user payload data to an analysis application.
3. The method of claim 1 ,
wherein the self-describing format comprises a header.
4. The method of claim 3 , wherein the header comprises a block holding a fixed value used to determine if the user payload data is corrupt, a block identifying a data type and a block identifying a sub-data type.
5. The method of claim 1 , further comprising:
providing, at the monitoring framework, a user interface; and
receiving the filter information from an instruction received at the user interface.
6. A system for supporting data payload collection in a transaction processing environment, the system comprising:
one or more microprocessors; and
a processor, running on the one or more microprocessors, wherein the processor operates to perform steps comprising:
providing, a monitoring framework, including a data collection engine, the monitoring framework monitoring a transaction within the middleware machine environment;
capturing, at the monitoring framework, transactional procedure data of the monitored transaction;
writing the transactional procedure data in a self-describing format to a buffer, wherein the self-describing format carries filter information and user payload data; and
filtering, based on the filter information, the user payload data from the self-describing data format;
wherein the self-describing data format expresses a plurality of typed buffers, the plurality of typed buffers comprising both self-describing and non-self-describing formats; and
wherein the self-describing data format provides an error checking mechanism for the user payload data carried by the self-describing data format.
7. The system of claim 6 , the steps further comprising:
passing the filtered user payload data to an analysis application.
8. The system of claim 6 ,
wherein the self-describing format comprises a header.
9. The system of claim 8 , wherein the header comprises a block holding a fixed value used to determine if the user payload data is corrupt, a block identifying a data type and a block identifying a sub-data type.
10. The system of claim 6 , further comprising:
providing, at the monitoring framework, a user interface; and
receiving the filter information from an instruction received at the user interface.
11. A non-transitory machine readable storage medium having instructions stored thereon for supporting data payload collection in a transaction processing environment that when executed cause a system to perform steps comprising:
providing, a monitoring framework, including a data collection engine, the monitoring framework monitoring a transaction within the middleware machine environment;
capturing, at the monitoring framework, transactional procedure data of the monitored transaction;
writing the transactional procedure data in a self-describing format to a buffer, wherein the self-describing format carries filter information and user payload data; and
filtering, based on the filter information, the user payload data from the self-describing data format;
wherein the self-describing data format expresses a plurality of typed buffers, the plurality of typed buffers comprising both self-describing and non-self-describing formats; and
wherein the self-describing data format provides an error checking mechanism for the user payload data carried by the self-describing data format.
12. The non-transitory machine readable storage medium of claim 11 , the steps further comprising:
passing the filtered user payload data to an analysis application.
13. The non-transitory machine readable storage medium of claim 11 ,
wherein the self-describing format comprises a header.
14. The non-transitory machine readable storage medium of claim 13 , wherein the header comprises a block holding a fixed value used to determine if the user payload data is corrupt, a block identifying a data type and a block identifying a sub-data type.