Systems and methods for an end-to-end visual analytics system for massive-scale geospatial data

1. A method for a computer-implemented system associated with geovisualization analytics, comprising:

configuring a computing device, for:

combining data preparation and map visualization for a spatial dataset in a same distributed cluster of nodes such that the data preparation and map visualization is co-optimized in a distributed and parallel data system, by executing a query language that defines a plurality of operators configured for application to the spatial dataset, the plurality of operators integrally including database query operators for data preparation and map visualization operators for map visualization, the plurality of operators including a partitioner operator that fragments a given pixel dataset across the same distributed cluster such that pixels that fall inside a logical space partition go to a same physical data partition and stay at a common machine;

accessing a query, the query referencing the spatial dataset and an attribute associated with the spatial dataset and further defining one or more functions; and

returning a set of map tiles associated with a subset of the spatial dataset that satisfies the query, including implementing a pixelize operator process to return the set of map tiles for visualization, comprising:

inputting the spatial dataset,

creating a list L in a format including a pixel and an initial aggregate, the list L being initially empty, and

generating a distributed dataset defined by L, by, for each spatial object in a data partition associated with the spatial dataset

coordinating transformation on all vertexes,

transformation on all vertexes,

decomposing each object into line segments,

finding all pixels mapped by line segments or points, and

placing pixels and their initial aggregate in the List L.

2. The method of claim 1 , wherein the one or more functions are predefined and associated with respective visual effects.

3. The method of claim 2 , further comprising:

visualizing the set of map tiles associated with a subset of the spatial dataset along a display device and the respective visual effects associated with the one or more functions defined by the query.

4. The method of claim 1 , further comprising:

creating a new function and a corresponding visualization effect based on information of the query.

5. The method of claim 1 , wherein the query is a SQL query that defines a SELECT, FROM, and WHERE clause.

6. The method of claim 1 , further comprising:

executing a first operator for mapping spatial objects to corresponding pixels of the set of map tiles for visualization along a display;

executing a second operator for calculating a user-defined aggregate value for each pixel to determine an intensity of each pixel corresponding to each of the set of map tiles; and

executing a third operator for determining a color for each pixel corresponding to each of the set of map tiles according to the user-defined aggregate value for rendering an image associated with the query as applied to the spatial dataset.

7. The method of claim 1 , wherein the spatial dataset is partitioned and distributed among a plurality of cluster nodes.

8. A computer-implemented system for geovisualization analytics, comprising:

a cluster of nodes associated with at least one processor;

a spatial dataset associated with the cluster of nodes;

a plurality of operators associated with the spatial dataset, the plurality of operators integrally including database query operators for data preparation and map visualization operators for map visualization including a pixelize operator such that spatial data preparation and map visualization associated with the spatial dataset is combined in the cluster of nodes;

a spatial partitioner that fragments the spatial dataset across the cluster of nodes and balances load among the cluster of nodes such that pixels that fall inside a logical space partition go to a same physical data partition and stay at a common machine; and

an optimizer that takes an input a task and generates an execution plan that co-optimizes the plurality of operators.

9. The computer-implemented system of claim 8 , wherein execution of each of the plurality of operators is parallelized among the cluster of nodes.

10. The computer-implemented system of claim 8 , wherein the plurality of operators comprises a pixelize query operator, a pixel aggregate query operator, a render query operator and an overlay query operator.