Database system for time series data storage, processing, and analysis
A system includes a communications interface configured to receive a plurality of data series captured by a plurality of sensors. A first database includes at least a first data series of the plurality of data series. A second database includes metadata related to the first data series. One or more processors are configured to receive an instruction including an indication of a computation to perform and metadata filter criteria, query the second database to determine at least a portion of the first data series that satisfies the metadata filter criteria by reference to at least the metadata related to the first data series, access, from the first database and based on results of the query of the second database, the portion of the first data series, and perform the computation on the portion of first data series accessed from the first database.
1. A system comprising:
one or more storage devices configured to store:
a first database comprising a plurality of sets of time series data, the time series data captured by one or more sensors; and
a second database storing metadata related to the sets of time series data, the metadata including information for locating the sets of time series data in the first database and properties of the sets of time series data; and
one or more processors configured to:
receive, via a user input to a user interface, an indication of an analysis to perform based on one or more of the sets of time series data;
access the second database to identify, based on the stored metadata, a first one or more subsets of the sets of time series data that satisfy at least a part of the indication of the analysis and information for locating the first one or more subsets in the first database;
access the first one or more subsets from the first database;
analyze the first one or more subsets to determine a second one or more subsets of the sets of time series data that satisfy at least a part of the indication of the analysis;
access the second database to identify, based on the stored metadata, the second one or more subsets of the sets of time series data and information for locating the identified second one or more subsets in the first database;
access the second one or more subsets from the first database; and
perform at least a part of the analysis using at least the second one or more subsets of the sets of time series data.
2. The system of claim 1 , wherein the indication of the analysis includes at least one of: a filter criteria, an analysis criteria, or a type of analysis.
3. The system of claim 2 , wherein the indication of the analysis includes the filter criteria, the analysis criteria, and the type of analysis, and wherein:
the filter criteria comprises a time indication,
the analysis criteria comprises a threshold, and
the type of analysis comprises an average.
4. The system of claim 3 , wherein the first one or more subsets are accessed from the first database based on the time indication.
5. The system of claim 4 , wherein analyzing the first one or more subsets comprises applying the threshold to the first one or more subsets to determine the second one or more subsets.
6. The system of claim 5 , wherein determining the second one or more subsets comprises determining time periods of interest based on the application of the threshold of the first one or more subsets.
7. The system of claim 6 , wherein the second one or more subsets are determined based on metadata indicating the time periods of interest.
8. The system of claim 6 , wherein performing the part of the analysis comprises determining an average of values of the second one or more subsets.
9. The system of claim 1 , wherein analyzing the first one or more subsets comprises determining one or more time periods, and wherein the second one or more subsets are associated with the determined one or more time periods.
10. The system of claim 1 , wherein analyzing the first one or more subsets comprises applying a threshold criteria, and wherein the second one or more subsets are associated with the time periods in which values of the first one or more subsets satisfy the threshold criteria.
11. The system of claim 1 , wherein the part of the analysis includes determining at least one of: a maximum, average, count, specific values, correlation, or standard deviation.
12. A computer-implemented method comprising:
by one or more processors configured to execute computer-executable instructions:
communicating with one or more storage devices configured to store:
a first database comprising a plurality of sets of time series data, the time series data captured by one or more sensors; and
a second database storing metadata related to the sets of time series data, the metadata including information for locating the sets of time series data in the first database and properties of the sets of time series data;
receiving, via a user input to a user interface, an indication of an analysis to perform based on one or more of the sets of time series data;
accessing the second database to identify, based on the stored metadata, a first one or more subsets of the sets of time series data that satisfy at least a part of the indication of the analysis and information for locating the first one or more subsets in the first database;
accessing the first one or more subsets from the first database;
analyzing the first one or more subsets to determine a second one or more subsets of the sets of time series data that satisfy at least a part of the indication of the analysis;
accessing the second database to identify, based on the stored metadata, the second one or more subsets of the sets of time series data and information for locating the identified second one or more subsets in the first database;
accessing the second one or more subsets from the first database; and
performing at least a part of the analysis using at least the second one or more subsets of the sets of time series data.
13. The computer-implemented method of claim 12 , wherein the indication of the analysis includes at least one of: a filter criteria, an analysis criteria, or a type of analysis.
14. The computer-implemented method of claim 13 , wherein the indication of the analysis includes the filter criteria, the analysis criteria, and the type of analysis, and wherein:
the filter criteria comprises a time indication,
the analysis criteria comprises a threshold, and
the type of analysis comprises an average.
15. The computer-implemented method of claim 14 , wherein the first one or more subsets are accessed from the first database based on the time indication.
16. The computer-implemented method of claim 15 , wherein analyzing the first one or more subsets comprises applying the threshold to the first one or more subsets to determine the second one or more subsets.
17. The computer-implemented method of claim 16 , wherein determining the second one or more subsets comprises determining time periods of interest based on the application of the threshold of the first one or more subsets.
18. The computer-implemented method of claim 17 , wherein the second one or more subsets are determined based on metadata indicating the time periods of interest.
19. The computer-implemented method of claim 17 , wherein performing the part of the analysis comprises determining an average of values of the second one or more subsets.
20. The computer-implemented method of claim 12 , wherein analyzing the first one or more subsets comprises determining one or more time periods, and wherein the second one or more subsets are associated with the determined one or more time periods.