Query summary generation using row-column data storage
A data storage system includes a column store and a row store. The data storage system may generate a query summary. The data storage system determines query summary fields comprised of a subset of fields from a schema used to store data in the row store. The data storage system searches the column store or the row store for query results in the query summary fields. A query summary field is generated from the query results in the query summary fields.
1. A method comprising:
receiving a query at a data storage system comprising a query engine, a column store, and a row store;
in response to receiving the query, the query engine generating query results and a query summary, wherein generating the query summary comprises:
determining query summary fields comprised of a subset of fields from a schema used to store data in the row store;
determining whether all of the query summary fields are stored in the column store;
in response to a determination that all of the query summary fields are not stored in the column store, searching only the row store instead of the column store for a portion of the query results in the query summary fields; and
generating the query summary from the portion of the query results in the query summary fields.
2. The method of claim 1 , further comprising:
in response to a determination that all of the query summary fields are stored in the column store, searching only the column store for the portion of the query results in the query summary fields.
3. The method of claim 1 , further comprising:
displaying the query results and the query summary on a graphical user interface of the data storage system.
4. The method of claim 3 , further comprising:
receiving, in the graphical user interface, a drill down request identifying a query summary field of the query summary; and
retrieving data matching the query summary field to satisfy the drill down request.
5. The method of claim 1 , further comprising:
determining whether a count of the query summary fields exceeds a maximum field threshold;
in response to a determination that the count of the query summary fields exceeds the maximum field threshold, determining priority information for the query summary fields; and
based on the priority information, determining a subset of the query summary fields included in the query summary.
6. The method of claim 1 , further comprising:
generating a plurality of episodic global summaries by the query engine; and
determining, using the plurality of episodic global summaries, a time range that includes data of the query results.
7. The method of claim 1 , wherein generating the query summary comprises:
determining query result counts in each of the query summary fields; and
providing the query result counts in the query summary.
8. The method of claim 1 , wherein determining the query summary fields comprises retrieving a set of be predetermined query summary fields from a storage device.
9. The method of claim 1 , wherein generating the query summary comprises:
generating a histogram for the portion of the query results in the query summary fields; and
providing the histogram in the query summary.
10. A non-transitory computer readable medium including machine readable instructions that are executable by a processor to:
receive a query at a data storage system comprising a column store and a row store;
in response to a receipt of the query:
generate query results;
determine query summary fields comprised of a subset of fields from a schema used to store data in the row store;
determine whether all of the query summary fields are stored in the column store;
in response to a determination that all of the query summary fields are not stored in the column store, search only the row store instead of the column store for a portion of the query results in the query summary fields; and
generate a query summary from the portion of the query results in the query summary fields.
11. The non-transitory computer readable medium of claim 10 , wherein the machine readable instructions are further executable by the processor to:
display the query results and the query summary on a graphical user interface of the data storage system;
receive, in the graphical user interface, a drill down request identifying a query summary field of the query summary; and
retrieve data matching the query summary field to perform the drill down request.
12. The non-transitory computer readable medium of claim 10 , wherein the machine readable instructions are further executable by the processor to:
determine whether a count of the query summary fields exceeds a maximum field threshold;
in response to a determination that the count of the query summary fields exceeds the maximum field threshold, determine priority information for the query summary fields; and
determine, based on the priority information, a subset of the query summary fields included in the query summary.
13. The non-transitory computer readable medium of claim 10 , wherein the machine readable instructions are further executable by the processor to:
determine query result counts in each of the query summary fields; and
provide the query result counts in the query summary.
14. The non-transitory computer readable medium of claim 10 , wherein the machine readable instructions are further executable by the processor to:
generate a plurality of episodic global summaries; and
determine, using the plurality of episodic global summaries, a time range that includes data of the query results.
15. A data storage system comprising:
a column store and a row store; and
a processor to, in response to a receipt of a query:
generate query results;
determine query summary fields comprised of a subset of fields from a schema used to store data in the row store;
determine whether all of the query summary fields are stored in the column store;
in response to a determination that all of the query summary fields are not stored in the column store, search only the row store instead of the column store for a portion of the query results in the query summary fields; and
generate a query summary from the portion of the query results in the query summary fields.
16. The data storage system of claim 15 , the processor further to:
display the query results and the query summary on a graphical user interface of the data storage system;
receive, in the graphical user interface, a drill down request identifying a query summary field of the query summary; and
retrieve data matching the query summary field to perform the drill down request.
17. The data storage system of claim 15 , the processor further to:
determine whether a count of the query summary fields exceeds a maximum field threshold;
in response to a determination that the count of the query summary fields exceeds the maximum field threshold, determine priority information for the query summary fields; and
determine, based on the priority information, a subset of the query summary fields included in the query summary.
18. The data storage system of claim 15 , the processor further to:
generate a histogram for the portion of the query results in the query summary fields; and
provide the histogram in the query summary.
19. The data storage system of claim 15 , the processor further to:
generate a plurality of episodic global summaries; and
determine, using the plurality of episodic global summaries, a time range that includes data of the query results.
20. The data storage system of claim 15 , the processor further to:
determine query result counts in each of the query summary fields; and
provide the query result counts in the query summary.