Complex dependencies for efficient data warehouse updates
View Patent ↗The invention relates to a method of updating a data storage system. The method updates a raw database using an input data stream based on an input temporal value associated with the input data stream and a raw temporal value associated with the raw database. The method includes updating a derived database associated with the data storage system using the updated raw database based on the input temporal value, a derived temporal value and a user-defined relationship, the derived temporal value being associated with the derived database. The invention also relates to a computer-readable medium. The computer readable medium including instructions, wherein execution of the instructions by at least one computing device updates a data storage system. The invention further relates to a data storage system. The system includes a raw database, a derived database and a computing device operatively coupled to the raw database and the derived database.
1. A method of updating a data storage system comprising:
updating a raw database using an input data stream based on an input temporal value associated with the input data stream, wherein the input temporal value is used to update a raw temporal value associated with the raw database; and
updating a derived temporal value associated with a derived database using the updated raw temporal value, wherein the derived temporal value and the updated raw temporal value are correlated using a user-defined relationship that includes a range defined by an upper and lower bound of partitioned data in the derived database.
2. A method according to claim 1 , wherein the user-defined relationship range is a temporal range predicate of the partitioned data.
3. A method according to claim 1 , wherein the user-defined relationship defines an association between a plurality of temporal values and the updated raw temporal value.
4. A method according to claim 1 , wherein the user-defined relationship defines a number of partitions included in the partitioned data.
5. A method according to claim 1 , wherein the derived temporal value is updated using an intermediate database appended from the updated raw database.
6. A method according to claim 1 , wherein the derived database is partitioned into portions and at least one portion is dropped from consideration as part of updating the derived temporal value.
7. A computer-readable medium comprising instructions, wherein execution of the instructions by at least one computing device updates a data storage system by:
updating a raw database associated with the data storage system using an input data stream based on an input temporal value associated with the input data stream, wherein the input temporal value is used to update a raw temporal value associated with the raw database; and
updating a derived temporal value associated with a derived database using the updated raw temporal value, wherein the derived temporal value and the updated raw temporal value are correlated using a user-defined relationship that includes a range defined by an upper and lower bound of partitioned data in the derived database.
8. A computer-readable medium comprising instructions defined by 7, wherein the user-defined relationship range is a temporal range predicate of the partitioned data.
9. A computer-readable medium comprising instructions defined by 7, wherein the user-defined relationship defines an association between a plurality of temporal values and the updated raw temporal value.
10. A computer-readable medium comprising instructions defined by 7, wherein the user-defined relationship defines a number of partitions included in the partitioned data.
11. A computer-readable medium comprising instructions defined by 7, wherein the derived temporal value is updated using an intermediate database appended from the updated raw database.
12. A computer-readable medium comprising instructions defined by 7, wherein the derived database is partitioned into portions and at least one portion is dropped from consideration as part of updating the derived temporal value.
13. A data storage system comprising:
a raw database;
a derived database; and
a computing device operatively coupled to the raw database and the derived database, the computing device updating the raw database using an input data stream based on an input temporal value associated with the input data stream, wherein the input temporal value is used to update a raw temporal value associated with the raw database, updating a derived temporal value using the updated raw temporal value, wherein the derived temporal value and the updated raw temporal value are correlated using a user-defined relationship that includes a range defined by an upper and lower bound of partitioned data in the derived database.
14. The system as defined by claim 13 , wherein the user-defined relationship range is a temporal range predicate of the partitioned data.
15. The system as defined by claim 13 , wherein the user-defined relationship defines an association between a plurality of temporal values and the updated raw temporal value.
16. The system as defined by claim 13 , wherein the user-defined relationship defines a number of partitions included in the partitioned data.
17. The system as defined by claim 13 , wherein the derived temporal value is updated using an intermediate database appended from the updated raw database.
18. The system as defined by claim 13 , wherein the derived database is partitioned into portions and at least one portion is dropped from consideration as part of updating the derived temporal value.