Evaluation of set of representative query performance using robustness mapping

1. A computer-implemented system comprising:

a logic circuit to:

evaluate robustness of a selected atomic query by measuring performance of atomic query execution in a selected range of runtime conditions in a multi-dimensional parameter space, the multi-dimensional parameter space including at least one of data characteristics or an availability of a resource;

produce a set of measurements to be displayed in at least one performance map, the at least one performance map indicating the measured performance in the selected range of runtime conditions; and

analyze the measured performance to identify landmarks indicative of database atomic query performance degradation greater than a selected amount.

2. The system according to claim 1 , wherein the logic circuit is to:

access a query plan from a query optimizer;

execute the query using the query plan to measure a plurality of performance characteristics under the runtime conditions; and

create a set comprising the query plan, the runtime conditions, and measurements.

3. The system according to claim 2 , wherein the logic circuit is to:

identify regions in the at least one performance map for which performance of the query plan degrades more than a selected amount;

identify coordinates in an arrangement of the identified regions as landmarks; and

create a set of atomic query maps that include the identified regions and coordinates.

4. The system according to claim 3 , wherein the logic circuit is to:

access the set of atomic query maps indicating atomic query performance in the runtime conditions, and

analyze the atomic query maps to identify landmarks in relation to a selected query plan wherein query performance degrades in a manner different from a desired manner.

5. The system according to claim 3 , wherein the logic circuit is to:

access, for atomic subgraphs of the query plan, expected conditions from a set of system configuration and contention information; and

calculate data characteristics for expected runtime conditions and a risk of encountering error in cardinality estimation during usage of database operators.

6. The system according to claim 5 , wherein the logic circuit is to:

look up second landmarks from the atomic query maps in a second range of conditions in the multi-dimensional parameter space;

look up cardinality specified in the set of system configuration and contention information; and

create a landmarks set comprising the second landmarks and a probability of complying with the conditions.

7. A computer-implemented system comprising:

a logic circuit to:

evaluate database performance of a selected query plan;

create a set of performance maps to indicate performance of a selected database system following the selected query plan under a selected range of measured runtime conditions in a multi-dimensional parameter space, the multi-dimensional parameter space including at least one of data characteristics or an availability of a resource, at least one of the performance maps comprising a landmark indicative of database performance degradation greater than a selected amount;

measure the database performance in the selected range of runtime conditions; and

map the measured runtime conditions to the set of performance maps.

8. The system according to claim 7 , wherein the logic circuit is to:

execute a query using the selected query plan;

measure a plurality of performance characteristics for selected runtime resource conditions and a plurality of data characteristics; and

create a set comprising the query plan, the conditions, and measurements.

9. The system according to claim 8 , wherein the logic circuit is to:

identify regions in the performance maps for which performance of the selected query plan degrades more than a threshold amount;

identify coordinates in an arrangement of the identified regions as landmarks; and

create a performance map of query plan performance that includes landmark coordinates in terms of cardinality, resource conditions, and performance of the selected query plan.

10. A computer-implemented system comprising:

a logic circuit to:

access a set of atomic query maps indicating atomic query performance in a plurality of runtime conditions in a multi-dimensional parameter space; and

analyze the atomic query maps to identify landmarks in relation to a selected query plan, wherein the landmarks are to be identified by identifying a set of runtime conditions in which performance of the selected query plan degrades in a manner different from a predetermined manner, the multi-dimensional parameter space including at least one of data characteristics or an availability of a resource.

11. The system according to claim 10 , wherein the logic circuit is to:

access, for atomic subgraphs of the query plan, expected conditions from a set of system configuration and contention information; and

calculate data characteristics for expected runtime conditions and a risk of encountering error in cardinality estimation during usage of database operators.

12. The system according to claim 11 , wherein the logic circuit is to:

look up second landmarks from the atomic query maps in a second range of conditions in the multi-dimensional parameter space;

look up cardinality specified in the set of system configuration and contention information; and

create a landmarks set comprising the second landmarks and a probability of complying with the conditions.

13. The system according to claim 1 , wherein the runtime conditions include at least one of an amount of memory, a central processing unit load, a potential hardware configuration, an estimated cardinality, or an estimated selectivity.

14. The system according to claim 7 , wherein the runtime conditions include at least one of an amount of memory, a central processing unit load, a potential hardware configuration, an estimated cardinality, or an estimated selectivity.

15. The system according to claim 10 , wherein the runtime conditions include at least one of an amount of memory, a central processing unit load, a potential hardware configuration, an estimated cardinality, or an estimated selectivity.

16. The system according to claim 1 , wherein the selected range of runtime conditions comprises at least two metrics.

17. The system according to claim 1 , wherein each of the landmarks comprises a subset of the runtime conditions and a performance characteristic.