Methods, systems, and products for maintaining data consistency in a stream warehouse
Methods, systems, and products characterize consistency of data in a stream warehouse. A warehouse table is derived from a continuously received a stream of data. The warehouse table is stored in memory as a plurality of temporal partitions, with each temporal partition storing data within a contiguous range of time. A level of consistency is assigned to each temporal partition in the warehouse table.
1. A method, comprising:
receiving, by a network device comprising a processor, a stream of data records associated with a data source;
partitioning, by the network device, the stream of data records into partitions;
determining, by the network device, respective consistencies of the partitions, wherein the respective consistencies are associated with respective unique inference rules for inference of the respective consistencies;
determining, by the network device, respective update preferences for the partitions;
receiving, by the network device, a query from a client device; and
pre-computing, by the network device, an answer to the query based on the respective consistencies and the respective update preferences of the partitions.
2. The method of claim 1 , further comprising sending, by the network device, the answer to the client device.
3. The method of claim 1 , further comprising receiving, by the network device, the stream of data records describing router measurements.
4. The method of claim 1 , further comprising receiving, by the network device, the stream of data records describing packet delay measurements.
5. The method of claim 1 , further comprising receiving, by the network device, the stream of data records describing packet loss measurements.
6. The method of claim 1 , further comprising determining, by the network device, the query specifies a lowest level of the respective consistencies.
7. The method of claim 6 , further comprising pre-computing, by the network device, the answer to the query based on the lowest level of the respective consistencies.
8. The method of claim 1 , further comprising receiving, by the network device, a revised stream of data records associated with the data source.
9. The method of claim 1 , further comprising determining, by the network device, a hierarchy of the respective consistencies.
10. A system, comprising:
a processor; and
a memory device, that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
receiving a stream of data records associated with a data source;
partitioning the stream of data records into partitions;
determining respective consistencies of the partitions, wherein the respective consistencies are based on different inference rules usable to infer the respective consistencies;
determining respective update schedules for the partitions;
receiving a query from a user device; and
pre-computing an answer to the query, the answer being based on the respective consistencies and the respective update schedules of the partitions.
11. The system of claim 10 , wherein the operations further comprise sending the answer to the user device.
12. The system of claim 10 , wherein the operations further comprise receiving the stream of data records describing router measurements.
13. The system of claim 10 , wherein the operations further comprise receiving the stream of data records describing packet delay measurements.
14. The system of claim 10 , wherein the operations further comprise receiving the stream of data records describing packet loss measurements.
15. The system of claim 10 , wherein the operations further comprise determining the query specifies use of a lowest level of the respective consistencies.
16. The system of claim 15 , wherein the operations further comprise pre-computing the answer to the query based the lowest level of the respective consistencies.
17. A non-transitory machine-readable medium, comprising executable instructions that when executed by a processor facilitate performance of operations, comprising:
receiving a stream of data records associated with a data source;
partitioning the stream of data records into partitions;
determining respective consistencies of the partitions, wherein each consistency of the respective consistencies is inferred based on a distinct inference rule applicable to inferring the consistency;
determining respective update processes for the partitions;
receiving a query from a client device; and
pre-computing an answer to the query based on the respective consistencies and the respective update processes of the partitions.
18. The non-transitory machine-readable medium of claim 17 , wherein the operations further comprise sending the answer to the client device.
19. The non-transitory machine-readable medium of claim 17 , wherein the operations further comprise receiving the stream of data records describing router measurements.
20. The non-transitory machine-readable medium of claim 17 , wherein the operations further comprise receiving the stream of data records describing packet delay measurements.