Apparatus and method for accelerated query processing using eager aggregation and analytical view matching
A system comprises a computer network and worker machines connected to the computer network. The worker machines store partitions of a distributed database. A master machine is connected to the computer network. The master machine includes a query processor to identify a star query that references a fact table and related dimension tables that characterize attributes of facts in the fact table. Eager aggregation is applied to a query plan associated with the star query. The eager aggregation alters the query plan by moving an aggregation operation before a join operation to form an eager aggregated query plan. An analytical view with data responsive to the eager aggregated query plan is identified. The eager aggregated query plan is revised to form a final query plan. The final query plan references the analytical view. The final query plan is executed to produce query results.
1. A system, comprising:
a computer network;
worker machines connected to the computer network, the worker machines storing partitions of a distributed database;
a master machine connected to the computer network, the master machine including a query processor to:
identify a star query that references a fact table and related dimension tables that characterize attributes of facts in the fact table,
apply eager aggregation to a query plan associated with the star query, wherein the eager aggregation alters the query plan by moving an aggregation operation before a join operation to form an eager aggregated query plan,
identify an analytical view with data responsive to the eager aggregated query plan, wherein the analytical view includes attributes and measures maintained as a data unit separate from the distributed database, wherein the analytical view is constructed prior to receipt of the star query,
revise the eager aggregated query plan to form a final query plan, wherein the final query plan references the analytical view, and
execute the final query plan to produce query results.
2. The system of claim 1 where each worker machine stores a partial function module to initialize a database dimension, increment an aggregate of the database dimension in response to a data change and to serialize a last aggregate of the database dimension in response to a refresh operation to form partial results of an analytical view, wherein the query processor merges partial results from the worker machines.
3. The system of claim 1 wherein the query processor is configured to apply a merge rewrite to the eager aggregated query plan.
4. The system of claim 1 further comprising a client machine connected to the network to secure the query results from the master machine.