Performance improvement recommendations for machine learning models
Techniques are provided for generating performance improvement recommendations for machine learning models. One method comprises evaluating performance metrics for multiple implementations of a machine learning model; computing a performance score that aggregates the performance metrics for a given machine learning model implementation; and recommending a modification to the given machine learning model implementation based on the performance score by evaluating one or more performance metrics for the given implementation relative to at least one additional performance metric for the given implementation, wherein the recommended modification is based on a performance with the recommended modification for another implementation. A given performance metric may be weighted based on an expected improvement from modifying a factor related to the given performance metric. The recommended modification to the given machine learning model implementation may comprise an indication of the expected improvement for the modification.
1. A method comprising:
evaluating a plurality of performance metrics for a first implementation of a machine learning model and for a second implementation of the machine learning model, wherein the first implementation is associated with a first entity and the second implementation is associated with a second entity;
computing a performance score that aggregates the plurality of performance metrics for the first implementation of the machine learning model;
recommending to a user at least one modification to the first implementation of the machine learning model based at least in part on the performance score by evaluating one or more of the plurality of performance metrics for the first implementation of the machine learning model, wherein the at least one recommended modification is to change a factor associated with a first metric of the plurality of performance metrics for an expected improvement based at least in part on a performance of the first metric for the second implementation,
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.
2. The method of claim 1 , wherein the performance metrics are grouped by category and a different performance score is computed for each category.
3. The method of claim 2 , wherein the performance score is computed for a given category by summing the performance metrics for the given category.
4. The method of claim 3 , further comprising providing the performance score for each category in a sorted list.
5. The method of claim 1 , wherein each of the plurality of performance metrics are weighted based, at least in part, on an expected improvement for a modification of a factor related to each performance metric.
6. The method of claim 5 , wherein different weightings are obtained for multiple groupings of implementations having similar characteristics based on one or more predefined similarity criteria.
7. The method of claim 1 , wherein the recommending the at least one modification to the first implementation of the machine learning model further comprises providing an indication of the expected improvement.
8. The method of claim 1 , wherein the evaluating the plurality of performance metrics for the first implementation of the machine learning model relative to one or more additional ones of the plurality of performance metrics for the second implementation of the machine learning model further comprises determining one or more reasons for a lower score.
9. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured to implement the following steps:
evaluating a plurality of performance metrics for a first implementation of a machine learning model and for a second implementation of the machine learning model, wherein the first implementation is associated with a first entity and the second implementation is associated with a second entity;
computing a performance score that aggregates the plurality of performance metrics for the first implementation of the machine learning model; and
recommending to a user at least one modification to the first implementation of the machine learning model based at least in part on the performance score by evaluating one or more of the plurality of performance metrics for the first implementation of the machine learning model, wherein the at least one recommended modification is to change a factor associated with a first metric of the plurality of performance metrics for an expected improvement based at least in part on a performance of the first metric for the second implementation.
10. The apparatus of claim 9 , wherein the performance metrics are grouped by category and a different performance score is computed for each category, and wherein the performance score is computed for a given category by summing the performance metrics for the given category.
11. The apparatus of claim 9 , wherein each of the plurality of performance metrics are weighted based, at least in part, on an expected improvement for a modification of a factor related to each performance metric.
12. The apparatus of claim 9 , wherein the evaluating the plurality of performance metrics for the first implementation of the machine learning model relative to one or more additional ones of the plurality of performance metrics for the second implementation of the machine learning model further comprises determining one or more reasons for a lower score.
13. A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform the following steps:
evaluating a plurality of performance metrics for a first implementation of a machine learning model and for a second implementation of the machine learning model, wherein the first implementation is associated with a first entity and the second implementation is associated with a second entity;
computing a performance score that aggregates the plurality of performance metrics for the first implementation of the machine learning model; and
recommending to a user at least one modification to the first implementation of the machine learning model based at least in part on the performance score by evaluating one or more of the plurality of performance metrics for the first implementation of the machine learning model, wherein the at least one recommended modification is to change a factor associated with a first metric of the plurality of performance metrics for an expected improvement based at least in part on a performance of the first metric for the second implementation.
14. The non-transitory processor-readable storage medium of claim 13 , wherein the performance metrics are grouped by category and a different performance score is computed for each category, and wherein the performance score is computed for a given category by summing the performance metrics for the given category.
15. The non-transitory processor-readable storage medium of claim 13 , wherein each of the plurality of performance metrics are weighted based, at least in part, on an expected improvement for a modification of a factor related to each performance metric.
16. The non-transitory processor-readable storage medium of claim 13 , wherein the at least one modification to the first implementation of the machine learning model further comprises providing an indication of the expected improvement.
17. The non-transitory processor-readable storage medium of claim 13 , wherein the evaluating the plurality of performance metrics for the first implementation of the machine learning model relative to one or more additional ones of the plurality of performance metrics for the second implementation of the machine learning model further comprises determining one or more reasons for a lower score.