Automated asymptotic analysis
Some embodiments provide a method for identifying runtime complexity of a policy. The method receives, through a user interface (UI), a set of code defining a particular policy. For each variable in the particular policy, the method identifies a first occurrence of the variable in the particular policy to determine a number of values assigned to the variable. Variables determined to be assigned one value are separated from variables determined to be assigned more than one value. Based on the determinations for each variable, the method calculates a set of metrics that include at least time complexity, size complexity, and count complexity for the particular policy. The method then displays, through the UI, the calculated set of metrics along with a set of one or more suggestions for optimizing the particular policy based on the calculated set of metrics.
1. A method for identifying runtime complexity of a policy, the method comprising:
receiving, through a user interface (UI), a set of code defining a particular policy;
for each variable in the particular policy, identifying a first occurrence of the variable in the particular policy to determine a number of values assigned to the variable, wherein variables determined to be assigned one value are separated from variables determined to be assigned more than one value;
based on the determinations for each variable, calculating a set of metrics comprising at least time complexity, size complexity, and count complexity for the particular policy, wherein time complexity comprises an expression over input representing a maximum number of elements from the input that are evaluated, size complexity comprises an expression over input representing a slice of data to which a variable evaluates, and count complexity comprises a number of values assigned to a variable within one of an array, a set, and an object; and
displaying, through the UI, the calculated set of metrics along with a set of one or more suggestions for optimizing the particular policy based on the calculated set of metrics.
2. The method of claim 1 , wherein variables that are determined to be assigned one value are further determined to be noniterative and variables that are determined to be assigned more than one value are further determined to be iterative.
3. The method of claim 2 further comprising for each iterative variable, identifying (i) a number of iterations for the variable and (ii) a set of values assigned to the variable.
4. The method of claim 2 , wherein noniterative variables are binned in a first data structure and iterative variables are binned in a second data structure.
5. The method of claim 4 , wherein at least one variable appears in at least two expressions of the particular policy.
6. The method of claim 1 , wherein only a first occurrence of the at least one variable is processed.
7. The method of claim 4 , wherein calculating the set of metrics for the particular policy further comprises using data from the first and second data structures to calculate the set of metrics.
8. The method of claim 1 further comprising receiving, through the UI, an optimized set of code defining the particular policy, wherein the optimized set of code comprises at least one implemented suggestion from the set of one or more suggestions.
9. The method of claim 1 , wherein each metric in the set of metrics is reported separately.
10. A non-transitory machine readable medium storing a program that when executed by a set of processing units, identifies runtime complexity of a policy, the program comprising sets of instructions for:
receiving, through a user interface (UI), a set of code defining a particular policy;
for each variable in the particular policy, identifying a first occurrence of the variable in the particular policy to determine a number of values assigned to the variable, wherein variables determined to be assigned one value are separated from variables determined to be assigned more than one value;
based on the determinations for each variable, calculating a set of metrics comprising at least time complexity, size complexity, and count complexity for the particular policy, wherein time complexity comprises an expression over input representing a maximum number of elements from the input that are evaluated, size complexity comprises an expression over input representing a slice of data to which a variable evaluates, and count complexity comprises a number of values assigned to a variable within one of an array, a set, and an object; and
displaying, through the UI, the calculated set of metrics along with a set of one or more suggestions for optimizing the particular policy based on the calculated set of metrics.
11. The non-transitory machine readable medium of claim 10 , wherein variables that are determined to be assigned one value are further determined to be noniterative and variables that are determined to be assigned more than one value are further determined to be iterative.
12. The non-transitory machine readable medium of claim 11 further comprising a set of instructions for identifying, for each iterative variable, (i) a number of iterations for the variable and (ii) a set of values assigned to the variable.
13. The non-transitory machine readable medium of claim 11 , wherein noniterative variables are binned in a first data structure and iterative variables are binned in a second data structure.
14. The non-transitory machine readable medium of claim 13 , wherein at least one variable appears in at least two expressions of the particular policy.
15. The non-transitory machine readable medium of claim 10 , wherein only a first occurrence of the at least one variable is processed.
16. The non-transitory machine readable medium of claim 13 , wherein the set of instructions for calculating the set of metrics for the particular policy further comprises a set of instructions for using data from the first and second data structures to calculate the set of metrics.
17. The non-transitory machine readable medium of claim 10 further comprising a set of instructions for receiving, through the UI, an optimized set of code defining the particular policy, wherein the optimized set of code comprises at least one implemented suggestion from the set of one or more suggestions.
18. The non-transitory machine readable medium of claim 10 , wherein each metric in the set of metrics is reported separately.