Enhanced processing of time series data via parallelization of instructions
Systems and methods are provided for enhanced processing of time series data via parallelization of instructions. An example method includes receiving a query indicating time series datasets and operations to be performed on the time series datasets. Nodes associated with the query are identified, with each node associated with a time series dataset. Nodes associated with operations to be performed are generated. The nodes are assembled into query tree, with parent nodes of the query tree indicating operations that are to be applied to children nodes. Instructions for processing the query tree are generated. At least a subset of the instructions is provided to one or more compute systems for processing in parallel. Results are received, and presented in a user interface.
1. A computerized method implemented by one or more processors, the method comprising:
generating, based at least in part on a query, a plurality of nodes associated with respective operations to be performed on a plurality of time series datasets, wherein a particular generated node indicates an operation to be applied to at least two time series datasets, wherein at least some of the operations include transformations to be applied to the respective at least two time series datasets, wherein the nodes are identified based on the query, wherein the query indicates metadata, and wherein identifying the nodes comprises:
accessing metadata information associated with the nodes; and
searching for nodes which satisfy the indicated metadata;
generating instructions associated with processing one or more query trees assembled based on the nodes, whereby generating instructions based on the nodes decouples the at least two time series datasets from the query so as to enable increased processing efficiency and responsiveness to the query;
receiving results associated with the generated instructions associated with processing the one or more query trees, wherein the results are generated based in part on the identified nodes satisfying the indicated metadata; and
in response to receiving results associated with the generated instructions associated with processing the one or more query trees, presenting, in a user interface of a user device, the results of processing the one or more query trees,
wherein the results of processing the one or more query trees are streamed to the user device, wherein one or more functions to be applied to the results of processing the one or more query trees are defined on the user device.
2. The computerized method of claim 1 , wherein the operations include at least one of: interpolating between different time series datasets, shifting time series datasets, scaling time series datasets, performing mathematical operations on time series datasets, or filtering time series datasets.
3. The computerized method of claim 1 , wherein the nodes are identified based on the query, wherein the query indicates metadata, and wherein identifying the nodes comprises:
accessing metadata information associated with nodes; and
searching for nodes which satisfy the indicated metadata.
4. The computerized method of claim 1 further comprising:
providing the generated instructions to a plurality of computer systems for processing the one or more query trees in parallel.
5. The computerized method of claim 1 , wherein the one or more query trees comprise parent nodes and children nodes, and wherein the parent nodes indicate operations which are to be applied to the children nodes.
6. The computerized method of claim 1 , wherein the generated nodes are assembled into the one or more query trees, and wherein assembling the one or more query trees comprises:
identifying time series datasets to be included in each of the nodes; and
assembling the respective nodes into respective query trees, wherein each query tree includes same nodes associated with operations to be performed.
7. The computerized method of claim 1 , wherein the user device presents a user interface which includes the results as an interactive table responsive to user input, and wherein the user input causes adjustment to the stream.
8. The computerized method of claim 1 , wherein the query indicates an extent to which the instructions are to be parallelized.
9. A system comprising one or more computers and computer storage media storing instructions that, when executed by the system, cause the system to perform operations comprising:
generating, based at least in part on a query, a plurality of nodes associated with respective operations to be performed on a plurality of time series datasets, wherein a particular generated node indicates an operation to be applied to at least two time series datasets, wherein at least some of the operations include transformations to be applied to the respective at least two time series datasets, wherein the nodes are identified based on the query, wherein the query indicates metadata, and wherein identifying the nodes comprises:
accessing metadata information associated with the nodes; and
searching for nodes which satisfy the indicated metadata;
generating instructions associated with processing one or more query trees assembled based on the nodes, whereby generating instructions based on the nodes decouples the at least two time series datasets from the query so as to enable increased processing efficiency and responsiveness to the query;
receiving results associated with the generated instructions associated with processing the one or more query trees, wherein the results are generated based in part on the identified nodes satisfying the indicated metadata; and
in response to receiving results associated with the generated instructions associated with processing the one or more query trees, presenting, in a user interface of a user device, the results of processing the one or more query trees,
wherein the results of processing the one or more query trees are streamed to the user device, wherein one or more functions to be applied to the results of processing the one or more query trees are defined on the user device.
10. The system of claim 9 , wherein the operations include at least one of:
interpolating between different time series datasets, shifting time series datasets, scaling time series datasets, performing mathematical operations on time series datasets, or filtering time series datasets.
11. The system of claim 9 , wherein the nodes are identified based on the query, wherein the query indicates metadata, and wherein identifying the nodes comprises:
accessing metadata information associated with nodes; and
searching for nodes which satisfy the indicated metadata.
12. The system of claim 9 , wherein the operations further comprise:
providing the generated instructions to a plurality of computer systems for processing the one or more query trees in parallel.
13. The system of claim 9 , wherein the one or more query trees comprise parent nodes and children nodes, and wherein the parent nodes indicate operations which are to be applied to the children nodes.
14. The system of claim 9 , wherein the generated nodes are assembled into the one or more query trees, and wherein assembling the one or more query trees comprises:
identifying time series datasets to be included in each of the nodes; and
assembling the respective nodes into respective query trees, wherein each query tree includes same nodes associated with operations to be performed.
15. The system of claim 9 , wherein the user device presents a user interface which includes the results as an interactive table responsive to user input, and wherein the user input causes adjustment to the stream.
16. The system of claim 9 , wherein the query indicates an extent to which the instructions are to be parallelized.
17. Non-transitory computer storage media storing instructions that when executed by a system of one or more computers, cause the system to perform operations comprising:
generating, based at least in part on a query, a plurality of nodes associated with respective operations to be performed on a plurality of time series datasets, wherein a particular generated node indicates an operation to be applied to at least two time series datasets, wherein at least some of the operations include transformations to be applied to the respective at least two time series datasets, wherein the nodes are identified based on the query, wherein the query indicates metadata, and wherein identifying the nodes comprises:
accessing metadata information associated with the nodes; and
searching for nodes which satisfy the indicated metadata;
generating instructions associated with processing one or more query trees assembled based on the nodes, whereby generating instructions based on the nodes decouples the at least two time series datasets from the query so as to enable increased processing efficiency and responsiveness to the query;
receiving results associated with the generated instructions associated with processing the one or more query trees, wherein the results are generated based in part on the identified nodes satisfying the indicated metadata; and
in response to receiving results associated with the generated instructions associated with processing the one or more query trees, presenting, in a user interface of a user device, the results of processing the one or more query trees,
wherein the results of processing the one or more query trees are streamed to the user device, wherein one or more functions to be applied to the results of processing the one or more query trees are defined on the user device.
18. The computer storage media of claim 17 , wherein the operations include at least one of: interpolating between different time series datasets, shifting time series datasets, scaling time series datasets, performing mathematical operations on time series datasets, or filtering time series datasets.
19. The computer storage media of claim 17 , wherein the nodes are identified based on the query, wherein the query indicates metadata and wherein identifying the nodes comprises:
accessing metadata information associated with nodes; and
searching for nodes which satisfy the indicated metadata.
20. The computer storage media of claim 17 , wherein the operations further comprise:
providing the generated instructions to a plurality of computer systems for processing the one or more query trees in parallel.