Systems and methods for optimized database sampling
In one embodiment, a method includes receiving a request to execute a database statement in satisfaction of a time constraint. The method further includes determining a pattern of the database statement. Additionally, the method includes comparing the pattern to pattern metadata associated with cached samples of the distributed database. Also, the method includes, responsive to a determination that the comparing has resulted in one or more matches, selecting a target sample and causing the database statement to be executed on the target sample. The method further includes, responsive to a determination that the target sample resolves the database statement in satisfaction of the time constraint, returning a resulting dataset to a requestor. Moreover, the method includes, responsive to a determination that the target sample does not resolve the database statement in satisfaction of the time constraint, causing a new real-time sampling of the distributed database to be executed.
1. A method comprising, by a computer system:
receiving a request to execute a database statement in satisfaction of a time constraint, wherein the database statement specifies a distributed database as a data source;
determining a pattern of the database statement based, at least in part, on an analysis of syntax in the database statement;
comparing the pattern to stored pattern metadata associated with cached samples of the distributed database;
wherein, for each cached sample of the cached samples, the stored pattern metadata characterizes an assortment of data values stored in the cached sample;
responsive to a determination that the comparing has resulted in one or more matches between the pattern and the stored pattern metadata, selecting a target sample from among the cached samples;
causing the database statement to be executed on the target sample;
responsive to a determination that the target sample resolves the database statement in satisfaction of the time constraint, returning a resulting dataset to a requestor; and
responsive to a determination that the target sample does not resolve the database statement satisfaction in of the time constraint, causing a new real-time sampling of the distributed database to be executed.
2. The method of claim 1 , wherein the causing of the new real-time sampling comprises:
determining a new sample of the distributed database based, at least in part, on the database statement;
retrieving the new sample;
adding the new sample to the cached samples; and
storing metadata related to the new sample in the stored pattern metadata.
3. The method of claim 1 , comprising:
monitoring storage operations in relation to the distributed database;
responsive to a determination that a storage operation on the distributed database causes at least one cached sample of the cached samples to reach a change threshold:
updating the at least one cached sample; and
refreshing a portion of the stored pattern metadata related to the at least one cached sample.
4. The method of claim 1 , wherein the stored pattern metadata indicates a size of each of the cached samples relative to a size of a complete result set.
5. The method of claim 1 , wherein the pattern comprises information related to columns and operations of the database statement.
6. The method of claim 1 , wherein the comparing comprises:
analyzing an ability of each of the cached samples to satisfy the database statement; and
analyzing an ability of combinations of the cached samples to satisfy the database statement.
7. The method of claim 1 , wherein the target sample comprises a combination of two or more of the cached samples.
8. The method of claim 1 , comprising:
responsive to two or more matches being determined, ranking the two or more matches; and
wherein the selecting is based, at least in part, on the ranking.
9. An information handling system comprising at least one processor, wherein the at least one processor is operable to implement a method comprising:
receiving a request to execute a database statement in satisfaction of a time constraint, wherein the database statement specifies a distributed database as a data source;
determining a pattern of the database statement based, at least in part, on an analysis of syntax in the database statement;
comparing the pattern to stored pattern metadata associated with cached samples of the distributed database;
wherein, for each cached sample of the cached samples, the stored pattern metadata characterizes an assortment of data values stored in the cached sample;
responsive to a determination that the comparing has resulted in one or more matches between the pattern and the stored pattern metadata, selecting a target sample from among the cached samples;
causing the database statement to be executed on the target sample;
responsive to a determination that the target sample resolves the database statement in satisfaction of the time constraint, returning a resulting dataset to a requestor; and
responsive to a determination that the target sample does not resolve the database statement satisfaction in of the time constraint, causing a new real-time sampling of the distributed database to be executed.
10. The information handling system of claim 9 , wherein the causing of the new real-time sampling comprises:
determining a new sample of the distributed database based, at least in part, on the database statement;
retrieving the new sample;
adding the new sample to the cached samples; and
storing metadata related to the new sample in the stored pattern metadata.
11. The information handling system of claim 9 , the method comprising:
monitoring storage operations in relation to the distributed database;
responsive to a determination that a storage operation on the distributed database causes at least one cached sample of the cached samples to reach a change threshold:
updating the at least one cached sample; and
refreshing a portion of the stored pattern metadata related to the at least one cached sample.
12. The information handling system of claim 9 , wherein the stored pattern metadata indicates a size of each of the cached samples relative to a size of a complete result set.
13. The information handling system of claim 9 , wherein the pattern comprises information related to columns and operations of the database statement.
14. The information handling system of claim 9 , wherein the comparing comprises:
analyzing an ability of each of the cached samples to satisfy the database statement; and
analyzing an ability of combinations of the cached samples to satisfy the database statement.
15. The information handling system of claim 9 , wherein the target sample comprises a combination of two or more of the cached samples.
16. The information handling system of claim 9 , the method comprising:
responsive to two or more matches being determined, ranking the two or more matches; and
wherein the selecting is based, at least in part, on the ranking.
17. A computer-program product comprising a non-transitory computer-usable medium having computer-readable program code embodied therein, the computer-readable program code adapted to be executed to implement a method comprising:
receiving a request to execute a database statement in satisfaction of a time constraint, wherein the database statement specifies a distributed database as a data source;
determining a pattern of the database statement based, at least in part, on an analysis of syntax in the database statement;
comparing the pattern to stored pattern metadata associated with cached samples of the distributed database;
wherein, for each cached sample of the cached samples, the stored pattern metadata characterizes an assortment of data values stored in the cached sample;
responsive to a determination that the comparing has resulted in one or more matches between the pattern and the stored pattern metadata, selecting a target sample from among the cached samples;
causing the database statement to be executed on the target sample;
responsive to a determination that the target sample resolves the database statement in satisfaction of the time constraint, returning a resulting dataset to a requestor; and
responsive to a determination that the target sample does not resolve the database statement satisfaction in of the time constraint, causing a new real-time sampling of the distributed database to be executed.
18. The computer-program product of claim 17 , wherein the causing of the new real-time sampling comprises:
determining a new sample of the distributed database based, at least in part, on the database statement;
retrieving the new sample;
adding the new sample to the cached samples; and
storing metadata related to the new sample in the stored pattern metadata.
19. The computer-program product of claim 17 , the method comprising:
monitoring storage operations in relation to the distributed database;
responsive to a determination that a storage operation on the distributed database causes at least one cached sample of the cached samples to reach a change threshold:
updating the at least one cached sample; and
refreshing a portion of the stored pattern metadata related to the at least one cached sample.
20. The computer-program product of claim 17 , wherein the stored pattern metadata indicates a size of each of the cached samples relative to a size of a complete result set.