Method and system for determination of data completeness for analytic data calculations
View Patent ↗A system, method and computer program product capable of determining data completeness associated with an analysis based on a data model at the same time that the data in the data model is being analyzed. A root node may be determined, and all paths from the root node discovered. Each path is decomposed into steps, and a ratio is calculated for each step. The ratios may be multiplied for each path, and the aggregate of the paths may determine a measure of the data completeness corresponding to the analysis and return the results of the analysis and the measure of data completeness at the same time.
1. A system for determining data completeness, comprising:
a processor;
a metric calculation module configured to access a data model and calculate a metric relating to costs or revenues of an enterprise based on data in the data model;
a data completeness module configured to evaluate the data model to determine a data completeness measure of the data model corresponding to the calculation of the metric relating to the costs or revenues of the enterprise, by:
identifying at least one root node and at least one leaf node in the data model,
identifying a set of paths to each leaf node based on the root node,
decomposing each path in the set of paths into one or more steps,
determining a data completeness measure for each step in the one or more steps,
calculating a data completeness measure for each path in the set of paths based on the data completeness measure for each step in the one or more steps,
aggregating the data completeness measure for each path in the set of paths for the root node to determine the data completeness measure of the data model, wherein the data completeness measure of the data model corresponds to the completeness of the data used to calculate the metric relating to costs or revenues of the enterprise, and
wherein the calculation of the metric relating to the costs or revenues of the enterprise is performed in parallel to determining the data completeness measure; and
a memory, comprising instructions for:
presenting the data completeness measure of the data model to a user in conjunction with the metric relating to the costs or revenues of the enterprise.
2. The system of claim 1 , wherein the data completeness measure of the data model is determined by accessing the data model at the same time that the data in the data model is being accessed for calculating the metric relating to the costs or revenues of the enterprise.
3. The system of claim 1 , further comprising:
receiving data from a plurality of sources in a network; and
populating the received data into the data model.
4. A system for determining data completeness, comprising:
a processor;
a metric calculation module configured to access a data model and calculate a metric relating to costs or revenues of an enterprise based on data in the data model;
a data completeness module configured to evaluate the data model to determine a data completeness measure of the data model corresponding to the calculation of the metric relating to the costs or revenues of the enterprise by calculating a data completeness measure for each path in a set of paths based on a data completeness measure of one or more steps of each path in the set of paths by multiplying two or more data completeness measures of two or more steps of the each path in the set of paths,
wherein the calculation of the metric relating to the costs or revenues of the enterprise is performed in parallel to determining the data completeness measure of the data model and the data completeness measure of the data model reflects the completeness of the data used to calculate the metric relating to the costs or revenues of the enterprise; and
a memory, comprising instructions for:
presenting the data completeness measure of the data model to a user in conjunction with the metric relating to the costs or revenues of the enterprise.
5. The system of claim 4 , wherein the data completeness measure of the data model associated is determined by accessing the data model at the same time that the data in the data model is being accessed for calculating the metric relating to the costs or revenues of the enterprise.
6. The system of claim 4 , wherein the metric of interest includes one of an impact of an asset on an enterprise or energy use of an asset.
7. A system for determining data completeness, comprising:
a processor;
a metric calculation module configured to access a data model and calculate a metric relating to costs or revenues of an enterprise based on data in the data model;
a data completeness module configured to evaluate the data model to determine a data completeness measure of the data model corresponding to the calculation of the metric relating to the costs or revenues of the enterprise by calculating a data completeness measure for each path in a set of paths based on a data completeness measure of one or more steps of the each path in the set of paths by multiplying the data completeness measure for one of the one or more steps of the each path in the set of paths by a factor,
wherein the calculation of the metric relating to the costs or revenues of the enterprise is performed in parallel to determining the data completeness measure of the data model and wherein the data completeness measure of the data model reflects the completeness of the data used to calculate the metric relating to the costs or revenues of the enterprise; and
a memory, comprising instructions for:
presenting the data completeness measure of the data model to a user in conjunction with the metric relating to the costs or revenues of the enterprise.
8. The system of claim 7 , wherein the data completeness measure of the data model associated is determined by accessing the data model at the same time that the data in the data model is being accessed for calculating the metric relating to the costs or revenues of the enterprise.
9. A computer program product stored on a tangible, non-transitory medium in a computer system, the computer program product comprising a set of instructions executable to perform:
accessing a data model;
calculating a metric relating to costs or revenues of an enterprise based on data in the data model;
evaluating the data model to determine a data completeness measure of the data model corresponding to the calculation of the metric relating to the costs or revenues of the enterprise by calculating a data completeness measure for each path in a set of paths based on a data completeness measure of one or more steps of the each path in the set of paths by multiplying two or more data completeness measures of two or more steps of at least one path in the set of paths, wherein the calculation of the metric relating to the costs or revenues of the enterprise is performed in parallel to determining the data completeness measure of the data model and wherein the data completeness measure of the data model reflects the completeness of the data used to calculate the metric relating to the costs or revenues of the enterprise; and
presenting the data completeness measure of the data model to a user in conjunction with the metric relating to the costs or revenues of the enterprise.
10. The computer program product of claim 9 , wherein the data completeness measure of the data model is determined by accessing the data model at the same time that the data in the data model is being accessed for calculating the metric relating to the costs or revenues of the enterprise.
11. The computer program product of claim 9 , the set of computer instructions further executable to perform:
receiving data from a plurality of sources in a network; and
populating the received data into the data model.
12. A computer program product stored on a tangible, non-transitory medium in a computer system, the computer program product comprising a set of instructions executable to perform:
accessing a data model;
calculating a metric relating to costs or revenues of an enterprise based on data in the data model;
evaluating the data model to determine a data completeness measure of the data model corresponding to the calculation of the metric relating to the costs or revenues of the enterprise by calculating a data completeness measure for each path in a set of paths based on a data completeness measure of one or more steps of each path in the set of paths including multiplying the data completeness measure for one of the one or more steps of the at least one path in the set of paths by a factor; and
presenting the data completeness measure of the data model to a user in conjunction with the metric relating to the costs or revenues of the enterprise.
13. The computer program product of claim 12 , wherein the data completeness measure of the data model associated is determined by accessing the data model at the same time that the data in the data model is being accessed for calculating the metric relating to the costs or revenues of the enterprise.
14. The computer program product of claim 12 , wherein the metric of interest includes one of an impact of an asset on an enterprise or energy use of an asset.
15. A method of determining data completeness for a data model, comprising:
at a data completeness system for use in data modeling, the data completeness system embodied on a non-transitory computer memory including instructions translatable by at least one processor for determining data completeness for analytic data calculations, the method comprises:
accessing a data model;
calculating a metric relating to costs or revenues of an enterprise based on data in the data model;
evaluating the data model to determine a data completeness measure of the data model corresponding to calculation of the metric relating to the costs or revenues of the enterprise by
identifying at least one root node and at least one leaf node in the data model,
identifying a set of paths to each leaf node based on the root node,
analyzing data in the data model,
decomposing each path in the set of paths into one or more steps,
determining a data completeness measure for each step in the one or more steps,
calculating a data completeness measure for each path in the set of paths based on a data completeness measure for each step in the one or more steps;
aggregating the data completeness measure for each path in the set of paths for the root node, wherein the aggregated data completeness measure for the root node is the data completeness measure of the data model and the calculation of the metric relating to the costs or revenues of the enterprise is performed in parallel to determining the data completeness measure of the data model and wherein the data completeness measure of the data model reflects the completeness of the data used to calculate the metric relating to the costs or revenues of the enterprise; and
presenting the data completeness measure of the data model to a user in conjunction with the metric relating to the costs or revenues of the enterprise.
16. The method of claim 15 , further comprising the steps of:
receiving data from a plurality of sources in a network; and
populating the received data into the data model.
17. A method of determining data completeness for a data model, comprising:
at a data completeness system for use in data modeling, the data completeness system embodied on a non-transitory computer memory including instructions translatable by at least one processor for determining data completeness for analytic data calculations, the method comprises:
accessing a data model;
calculating a metric relating to costs or revenues of an enterprise based on data in the data model;
evaluating the data model to determine a data completeness measure of the data model corresponding to calculation of the metric relating to the costs or revenues of the enterprise by calculating a data completeness measure for each path in a set of paths based on a data completeness measure of one or more steps of the each path in the set of paths including multiplying two or more data completeness measures of two or more steps of at least one path in the set of paths, wherein the calculation of the metric relating to the costs or revenues of the enterprise is performed in parallel to determining the data completeness measure of the data model and wherein the data completeness measure of the data model reflects the completeness of the data used to calculate the metric relating to the costs or revenues of the enterprise; and
presenting the data completeness measure of the data model to a user in conjunction with the metric relating to the costs or revenues of the enterprise.
18. The method of claim 17 , wherein the data completeness measure of the data model associated is determined by accessing the data model at the same time that the data in the data model is being accessed for calculating the metric relating to the costs or revenues of the enterprise.
19. The method of claim 17 , wherein the metric of interest includes one of an impact of an asset on an enterprise or energy use of an asset.
20. A computer program product stored on a tangible, non-transitory medium in a computer system, the computer program product comprising a set of instructions executable to perform:
accessing a data model;
calculating a metric relating to costs or revenues of an enterprise based on data in the data model;
evaluating the data model to determine a data completeness measure of the data model corresponding to the calculation of the metric relating to the costs or revenues of the enterprise by
identifying at least one root node and at least one leaf node in the data model;
identifying a set of paths to each leaf node based on the root node;
decomposing each path in the set of paths into one or more steps;
for each step in the one or more steps, determining a data completeness measure;
calculating a data completeness measure for each path in the set of paths based on the data completeness measure for each step in the one or more steps; and
aggregating the data completeness measure for each path in the set of paths for the root node to determine the data completeness measure corresponding to the calculation of the metric relating to costs or revenues of the enterprise, wherein the calculation of the metric relating to the costs or revenues of the enterprise is performed in parallel to determining the data completeness measure of the data model and wherein the data completeness measure of the data model reflects the completeness of the data used to calculate the metric relating to the costs or revenues of the enterprise; and
presenting the data completeness measure of the data model to a user in conjunction with the metric relating to the costs or revenues of the enterprise.