Ranking computing resources
A system and method for ranking computing resources in a distributed computing marketplace is disclosed. Ranking may be based on the performance factors that the system predicts will have the greatest impact on the particular application the user plans to run. A performance database stores historical performance data for applications that have been executed on multiple different computer systems. The database is checked to see if the application, or one similar, has already been run on any of the computing systems participating in the distributed computing marketplace. If so, the existing performance data is used to predict which performance factors will have the greatest impact on the application. Those factors are then used to rank the available computing systems options for the user.
1. A non-transitory, computer-readable storage medium storing instructions executable by a processor of a computational device, which when executed cause the computational device to:
maintain a performance database comprising historical performance data for a plurality of prior applications executed on a plurality of different computer systems;
present a user with a control to specify an application to instantiate;
identify whether a match for the application or a similar application is present in the performance database, and if the match is present, rank a set of available computing system options for executing the application based on one or more most impactful factor identified by the match's historical performance data;
when the match for the application or the similar application is missing, identify whether a test run of the application is feasible and indicative of runtime performance; and
in response to the test run of the application being feasible and indicative of runtime performance, run at least one test of the application to collect performance data for the application.
2. The non-transitory, computer-readable storage medium of claim 1 storing further instructions to cause the computational device to rank a set of available resources based on the at least one test of the application when the test run is feasible and indicative of the runtime performance, wherein the test run of the application is feasible when a testing system for the application is available, and wherein the match for the application or the similar application is present in the performance database when the performance data for the application or the similar application is present the performance database.
3. The non-transitory, computer-readable storage medium of claim 1 , wherein the ranking of the set of available resources is further based on historical performance data for the similar application in the performance database.
4. The non-transitory, computer-readable storage medium of claim 3 , wherein the ranking is performed based on an application performance spectrometer.
5. The non-transitory, computer-readable storage medium of claim 2 , wherein the ranking is performed based a per-phase performance assessment.
6. The non-transitory, computer-readable storage medium of claim 1 storing further instructions to cause the computational device to display an estimated cost for executing the application on available computing resources.
7. A system comprising at least one processor and memory, the system configured to:
receive a selection, from a user, of an application to instantiate;
identify whether historical performance data for the application or a similar application is in a performance database;
when the historical performance data for the application or the similar application is in the performance database, rank available computing system options for executing the application based on one or more most impactful performance factors determined from the historical performance data;
when the performance database is free of the historical performance data for the application or the similar application, identify, via the at least one processor, whether a test run of the application is feasible and indicative of runtime performance; and
when the test run for the application is feasible and indicative of runtime performance, run, via the at least one processor, at least one test of the application to collect performance data for the application.
8. The system of claim 7 , further configured to rank a set of available resources based on the performance data collected via the test run.
9. The system of claim 7 , wherein the test run of the application is feasible when a testing system for the application is available.