System and method for facilitating deduplication of operations to be performed
A system, computer-readable storage medium storing at least one program, and a computer-implemented method for facilitating deduplication of operations to be performed is presented. An operation to be performed is received. A mapping function is applied to at least one parameter of the operation to produce a mapping value in a target mapping space, the target mapping space being partitioned between target servers in a set of target servers proportional to resource capacities of the target servers in the set of target servers. A target server in the set of target servers whose portion of the target mapping space includes the mapping value is identified. The operation is issued to the target server.
1. A computer-implemented method for facilitating deduplication of operations, performed on a server having at least one processor and memory, comprising:
receiving an operation to be performed within a distributed computing system;
in response to receiving the operation, obtaining a first mapping value for the operation by applying a mapping function to at least one parameter of the operation, the at least one parameter selected from a group consisting of:
a type of the operation;
data included in the operation;
an identifier for data associated with the operation;
a network address of a computer directing the operation to the server; and
a network address of the server;
identifying a portion of a target mapping space corresponding to the first mapping value, wherein the target mapping space is partitioned between a plurality of target servers in the distributed computing system such that each target server of the plurality of target servers is allocated a respective portion of the target mapping space;
identifying a target server in the plurality of target servers containing the identified portion of the target mapping space; and
issuing the operation to the identified target server.
2. The computer-implemented method of claim 1 , wherein prior to applying the mapping function to the at least one parameter of the operation, the method includes:
obtaining resource capacities of the plurality of target servers in the distributed computing system; and
partitioning the target mapping space between the plurality of target servers proportional to resource capacities of the target servers in the set of target servers.
3. The computer-implemented method of claim 2 , further comprising:
determining that at least one target server in the plurality of target servers has become unavailable; and
partitioning the portion of the target mapping space associated with the at least one target server between the remaining target servers in the plurality of target servers proportional to resource capacities of the remaining target servers in the plurality of target servers.
4. The computer-implemented method of claim 1 , wherein the mapping function is usable to map respective parameters of an operation to a respective mapping value in the target mapping space.
5. The computer-implemented method of claim 1 , wherein the mapping function comprises a hash function.
6. The computer-implemented method of claim 1 , wherein the operation includes a request to perform a search query, and wherein the at least one parameter includes the search query.
7. The computer-implemented method of claim 1 , wherein the operation includes a request to perform a search query, and wherein resource capacities of target server include a number of queries per second that the target server can process.
8. The computer-implemented method of claim 1 , wherein the operation includes a request to write data to the target server, and wherein the at least one parameter includes the data.
9. The computer-implemented method of claim 1 , wherein the operation includes a request to write data to the target server, and wherein resource capacities of the target server include a remaining amount of available storage space on the target server.
10. A system to facilitate deduplication of operations to be performed, comprising:
at least one processor;
memory; and
at least one program stored in the memory and executable by the at least one processor, the at least one program comprising instructions to:
receive an operation to be performed within a distributed computing system;
in response to receiving the operation, obtain a first mapping value for the operation by applying a mapping function to at least one parameter of the operation, the at least one parameter selected from a group consisting of:
a type of the operation;
data included in the operation;
an identifier for data associated with the operation;
a network address of a computer directing the operation to the system; and
a network address of the system;
identify a portion of a target mapping space corresponding to the first mapping value, wherein the target mapping space is partitioned between a plurality of target servers in the distributed computing system such that each target server of the plurality of target servers is allocated a respective portion of the target mapping space;
identify a target server in the plurality of target servers containing the identified portion of the target mapping space; and
issue the operation to the identified target server.
11. The system of claim 10 , wherein the at least one program further comprises instructions to, prior to applying the mapping function to the at least one parameter of the operation:
obtain resource capacities of the plurality of target servers in the distributed computing system; and
partition the target mapping space between the plurality of target servers proportional to resource capacities of the target servers in the set of target servers.
12. The system of claim 11 , wherein the at least one program further comprises instructions to:
determine that at least one target server in the plurality of target servers has become unavailable; and
partition the portion of the target mapping space associated with the at least one target server between the remaining target servers in the plurality of target servers proportional to resource capacities of the remaining target servers in the plurality of target servers.
13. The system of claim 10 , wherein the mapping function is usable to map respective parameters of an operation to a respective mapping value in the target mapping space.
14. The system of claim 10 , wherein the mapping function comprises a hash function.
15. The system of claim 10 , wherein the operation includes a request to perform a search query, and wherein the at least one parameter includes the search query.
16. The system of claim 10 , wherein the operation includes a request to perform a search query, and wherein resource capacities of the target server include a number of queries per second that the target server can process.
17. The system of claim 10 , wherein the operation includes a request to write data to the target server, and wherein the at least one parameter includes the data.
18. The system of claim 10 , wherein the operation includes a request to write data to the target server, and wherein resource capacities of the target server include a remaining amount of available storage space on the target server.
19. A non-transitory computer readable storage medium storing at least one program configured for execution by at least one processor of a computer system, the at least one program comprising instructions to:
receive an operation to be performed within a distributed computing system;
in response to receiving the operation, obtain a first mapping value for the operation by applying a mapping function to at least one parameter of the operation, the at least one parameter selected from a group consisting of:
a type of the operation;
data included in the operation;
an identifier for data associated with the operation;
a network address of a computer directing the operation to the computing system; and
a network address of the computing system;
identify a portion of a target mapping space corresponding to the first mapping value, wherein the target mapping space is partitioned between a plurality of target servers in the distributed computing system such that each target server of the plurality of target servers is allocated a respective portion of the target mapping space;
identify a target server in the plurality of target servers containing the identified portion of the target mapping space; and
issue the operation to the identified target server.
20. The non-transitory computer readable storage medium of claim 19 , the at least one program further comprising instructions to:
prior to applying the mapping function to the at least one parameter of the operation,
obtain resource capacities of the plurality of target servers in the distributed computing system; and
partition the target mapping space between the plurality of target servers proportional to resource capacities of the target servers in the set of target servers.
21. The non-transitory computer readable storage medium of claim 20 , the at least one program further comprising instructions to:
determine that at least one target server in the plurality of target servers has become unavailable; and
partition the portion of the target mapping space associated with the at least one target server between the remaining target servers in the plurality of target servers proportional to resource capacities of the remaining target servers in the plurality of target servers.