System and methods for mapping and searching objects in multidimensional space
This invention relates to a system and methods for determining the placement of an object in a distributed key-value store by mapping the object to nodes in multidimensional hyperspace. A search function supports efficient object retrieval, even when the search query requests multiple objects and specifies them through non-primary keys. In response to a search query, the search is translated into hyperregions in the hyperspace to determine the set of nodes that hold the queried data object. The number of contacted nodes and the number of scanned objects are significantly reduced in comparison to prior art techniques.
1. A method for mapping a data object in a key-value store within a distributed computing environment such that the data object can be retrieved using a search query, comprising the steps of:
dividing a hyperspace into regions to obtain a plurality of hyperspace regions;
distributing a plurality of storage nodes within the hyperspace;
assigning a hyperspace region to a storage node to obtain an assigned hyperspace region;
obtaining a plurality of data objects, each data object including one or more attribute values;
computing a coordinate for each data object, wherein the coordinate corresponds to the one or more attribute values of the data object;
mapping each data object to the storage node whose assigned hyperspace region encapsulates the coordinate for the data object;
storing each data object including the one or more attribute values on a computer readable memory of the data storage node;
reviewing a search query that includes a defined coordinate, wherein the defined coordinate corresponds to one or more specific attribute values of a desired data object;
searching the hyperspace for at least a portion of the defined coordinate to obtain a set of searched hyperspace regions;
finding an intersection of two or more searched hyperspace regions to obtain a query hyperregion;
determining a set of resultant data storage nodes of the query hyperregion, wherein each resultant data storage node of the set has an assigned hyperspace region that intersects the query hyperregion;
finding the one or more data objects within the set of resultant data storage nodes that corresponds to the search query to obtain one or more matched data objects;
retrieving the one or more matched data objects from the set of resultant data storage nodes to obtain a result; and
communicating the result including one or more attribute values of each matched data object.
2. The method according to claim 1 , wherein said computing step further comprises the step of hashing the one or more attribute values of the data object to compute the coordinate.
3. The method according to claim 1 , wherein said computing step further comprises the step of calculating an order-preserving function of the one or more attribute values of the data object to compute the coordinate.
4. The method according to claim 1 wherein the hyperspace consists of three dimensions.
5. The method according to claim 4 wherein the hyperspace is a cube shape.