AUTOMATICALLY MEASURING THE QUALITY OF PRODUCT MODULES
Various embodiments of systems and methods for measuring the quality of individual product modules over a lifecycle of a product are described herein. The method involves integrating error reports received from an internal incident management system and a customer incident management system. The method further includes associating the quality information in the error reports to a corresponding one or more product modules of a product and storing the association in a metadata repository. Using the quality information from the metadata repository, an automated evaluation of the quality of a product module is performed. In an aspect, the quality of a product module is represented as a quality indicator which is normalized with respect to a usage index of the product module. The generated quality indicator for the product module is associated with the product module and stored in the metadata repository with a time stamp for later access.
1 . A computer-implemented method of detecting quality of product modules of a product, the method comprising:
integrating, by a computer, error reports received from an internal incident management system and a customer incident management system, wherein the error reports include quality information relating to the product modules;
associating, by the computer, the quality information in the error reports to a respective one of the product modules of the product;
storing the association in a metadata repository; and
evaluating, by the computer, a quality of at least one of the product modules based on the association stored in the metadata repository by:
counting, from the error reports, a number of errors associated with the at least one product module;
measuring a usage index of the at least one product module, wherein the usage index represents a count of code processing during runtime;
determining a relative weight associated with the at least one product module; and
generating a quality indicator for the at least one product module by calculating a quotient of the number of errors and the usage index, and determining a product of the calculated quotient and the relative weight.
2 . (canceled)
3 . The method of claim 1 further comprising:
storing the generated quality indicator with the respective product modules in the metadata repository with a timestamp;
performing periodic evaluation of the quality information in the metadata repository by:
extracting the quality indicators associated with each of the product modules for a particular stage of a lifecycle of the product modules;
aggregating the quality indicators associated with each of the product modules;
detecting that the aggregated quality indicators for at least one of the product modules exceeds a pre-defined threshold; and
triggering one or more actions, for quality improvement, in response to the detecting.
4 . The method of claim 1 further comprising generating a quality report based on the quality indicator(s) in the metadata repository according to one or more schemas.
5 . The method of claim 4 , wherein the one or more schemas include, product family, product lifecycle, product significance, products with high quality, products with low quality.
6 . The method of claim 1 further comprising generating a quality report including quality indicators for each of the product modules over a lifecycle of the product.
7 . The method of claim 1 , wherein counting, from the error reports, the number of errors associated with the product module comprises classifying the errors into various stages of a lifecycle of the product and counting the number of errors under each classification.
8 . The method of claim 7 , wherein the various stages of the product lifecycle includes development, ramp-up, testing, release-to-customer, operation, and customer service.
9 . The method of claim 1 , wherein the customer incident management system receives information about errors occurring in a test system or productive system at a customer premise.
10 . An article of manufacture, comprising:
a non-transitory computer readable storage medium having instructions which when executed by a computer causes the computer to:
integrate, at a central quality system, error reports received from an internal incident management system and a customer incident management system, wherein the error reports include quality information relating to product modules of a product;
associate the quality information in the error reports to a respective one of the product modules of the product and store the association in a metadata repository; and
perform automated evaluation of a quality of at least one of the product modules using the association stored in the metadata repository, comprising:
counting, from the error reports, a number of errors associated with the at least one product module;
measuring a usage index of the at least one product module, wherein the usage index represents a count of code processing during runtime;
determining a relative weight associated with the at least one product module; and
generating a quality indicator for the at least one product module by calculating a quotient of the number of errors and the usage index, and determining a product of the calculated quotient and the relative weight.
11 . The article of manufacture in claim 10 , wherein the computer readable storage medium further comprises instructions, which when executed by the computer causes the computer to:
store the generated quality indicator with the respective one of the product modules in the metadata repository with a timestamp;
perform periodic evaluation of the quality information in the metadata repository by:
extracting the quality indicators associated with each of the product modules across all hierarchical levels;
aggregating the quality indicators associated with each of the product modules;
detecting that the aggregated quality indicators for at least one of the product modules exceeds a pre-defined threshold; and
triggering one or more actions, for quality improvement, in response to the detecting.
12 . The article of manufacture in claim 10 , wherein the computer readable storage medium further comprises instructions, which when executed by the computer causes the computer to:
generate an analytical report based on the quality indicators in the metadata repository according to one or more schemas.
13 . The article of manufacture in claim 12 , wherein the one or more schemas include, product family, product lifecycle, product significance, products with high quality, products with low quality.
14 . The article of manufacture in claim 10 , wherein the computer readable storage medium further comprises instructions, which when executed by the computer causes the computer to generate a quality report including quality indicators for each of the product modules over a lifecycle of the product.
15 . The article of manufacture in claim 10 , wherein the product modules include hardware components, electronic components, software applications, and software development packages.
16 . (canceled)
17 . An integrated system operating in a communication network, the system comprising:
one or more data source systems; and
a computer communicatively coupled to the data source systems, comprising a memory to store a program code, and a processor to execute the program code to:
integrate, at a central quality system, error reports received from an internal incident management system and a customer incident management system, wherein the error reports include quality information relating to product modules of a product;
associate the quality information in the error reports to a respective one of the product modules of the product and store the association in a metadata repository; and
perform automated evaluation of a quality of a at least one of the product modules using the association stored in the metadata repository, comprising:
counting, from the error reports, a number of errors associated with the at least one product module;
measuring a usage index of the at least one product module, wherein the usage index represents a count of code processing during runtime;
determining a relative weight associated with the at least one product module; and
generating a quality indicator for the at least one product module by calculating a quotient of the number of errors and the usage index, and determining a product of the calculated quotient and the relative weight.
18 . The system of claim 17 , wherein the integrated system is an integrated on-demand Enterprise Resource Planning (ERP) system having one or more business modules integrated over the communication network.
19 . The system of claim 17 , wherein the one or more data source systems includes at least one of an internal test system, a customer system, an incident reporting system, web service, and a data warehouse.
20 . The system of claim 17 , wherein the internal incident management system is in a hosted environment or an on-demand environment.