Database access request processing distribution
Database access request processing distribution is performed by receiving requests from a plurality of worker servers, the requests including database access requests, and maintaining a queue of the requests. Queues are maintained by adding each request to a queue in response to receiving the request, assigning, for each request, a master server among a plurality of master servers to process the request, and removing each request from the queue in response to processing of the request. The assigning includes assigning the first master server among the plurality of master servers to process the database access requests until the database access requests in the queue exceed a first threshold, and then distributing assignments to process the database access requests among the plurality of master servers.
1. A non-transitory computer-readable medium including instructions executable by a processor to cause the processor to perform operations comprising:
receiving requests from a plurality of worker servers, the requests including database access requests and outgoing transmission requests; and
maintaining a queue of the requests by
adding each request to a queue in response to receiving the request,
assigning, for each request, a master server among a plurality of master servers to process the request, wherein the assigning includes:
assigning a first master server among the plurality of master servers to process the outgoing transmission requests,
assigning the first master server among the plurality of master servers to process the database access requests until the database access requests in the queue exceed a first threshold, and
distributing assignments to process the database access requests among the plurality of master servers in response to the database access requests in the queue exceeding the first threshold, and
removing each request from the queue in response to processing of the request.
2. The computer-readable medium of claim 1 , wherein the first threshold is one of
a proportion of a number of database access requests in the queue to a number of requests in the queue,
a number of database access requests in the queue, or
a number of database access requests added to the queue in a time period.
3. The computer-readable medium of claim 1 , wherein the distributing includes
assigning the first master server among the plurality of master servers to process fewer database access requests than any other master server among the plurality of master servers.
4. The computer-readable medium of claim 1 , wherein the distributing includes, for each database access request,
determining which master server among the plurality of master servers to assign based on a load balancing scheme, and
assigning the determined master server among the plurality of master servers to process the database access request.
5. The computer-readable medium of claim 4 , wherein the determining includes, for each database access request,
determining which master server among the plurality of master servers is assigned fewest requests in the queue.
6. The computer-readable medium of claim 1 , wherein
the assigning includes assigning the first master server among the plurality of master servers to process the database access requests in response to the database access requests in the queue falling below a second threshold while distributing assignments, and
the second threshold is lower than the first threshold.
7. The computer-readable medium of claim 1 , wherein
the requests from the plurality of workers further include internal state change requests, and
the assigning includes assigning the first master server among the plurality of master servers to process the internal state change requests.
8. A method comprising:
receiving requests from a plurality of worker servers, the requests including database access requests and outgoing transmission requests; and
maintaining a queue of the requests by
adding each request to a queue in response to receiving the request,
assigning, for each request, a master server among a plurality of master servers to process the request, wherein the assigning includes:
assigning a first master server among the plurality of master servers to process the outgoing transmission requests,
assigning the first master server among the plurality of master servers to process the database access requests until the database access requests in the queue exceed a first threshold, and
distributing assignments to process the database access requests among the plurality of master servers in response to the database access requests in the queue exceeding the first threshold, and
removing each request from the queue in response to processing of the request.
9. The method of claim 8 , wherein the first threshold is one of
a proportion of a number of database access requests in the queue to a number of requests in the queue,
a number of database access requests in the queue, or
a number of database access requests added to the queue in a time period.
10. The method of claim 8 , wherein the distributing includes
assigning the first master server among the plurality of master servers to process fewer database access requests than any other master server among the plurality of master servers.
11. The method of claim 8 , wherein the distributing includes, for each database access request,
determining which master server among the plurality of master servers to assign based on a load balancing scheme, and
assigning the determined master server among the plurality of master servers to process the database access request.
12. The method of claim 11 , wherein the determining includes, for each database access request,
determining which master server among the plurality of master servers is assigned fewest requests in the queue.
13. The method of claim 8 , wherein
the assigning includes assigning the first master server among the plurality of master servers to process the database access requests in response to the database access requests in the queue falling below a second threshold while distributing assignments, and
the second threshold is lower than the first threshold.
14. The method of claim 8 , wherein
the requests from the plurality of workers further include internal state change requests, and
the assigning includes assigning the first master server among the plurality of master servers to process the internal state change requests.
15. An apparatus comprising:
a controller including circuitry configured to:
receive requests from a plurality of worker servers, the requests including database access requests and outgoing transmission requests; and
maintain a queue of the requests by
adding each request to a queue in response to receiving the request,
assigning, for each request, a master server among a plurality of master servers to process the request, wherein the assigning includes:
assigning a first master server among the plurality of master servers to process the outgoing transmission requests,
assigning the first master server among the plurality of master servers to process the database access requests until the database access requests in the queue exceed a first threshold, and
distributing assignments to process the database access requests among the plurality of master servers in response to the database access requests in the queue exceeding the first threshold, and
removing each request from the queue in response to processing of the request.
16. The apparatus of claim 15 , wherein the first threshold is one of
a proportion of a number of database access requests in the queue to a number of requests in the queue,
a number of database access requests in the queue, or
a number of database access requests added to the queue in a time period.
17. The apparatus of claim 15 , wherein the distributing includes
assigning the first master server among the plurality of master servers to process fewer database access requests than any other master server among the plurality of master servers.
18. The apparatus of claim 15 , wherein the distributing includes, for each database access request,
determining which master server among the plurality of master servers to assign based on a load balancing scheme, and
assigning the determined master server among the plurality of master servers to process the database access request.
19. The apparatus of claim 18 , wherein the determining includes, for each database access request,
determining which master server among the plurality of master servers is assigned fewest requests in the queue.
20. The apparatus of claim 15 , wherein
the assigning includes assigning the first master server among the plurality of master servers to process the database access requests in response to the database access requests in the queue falling below a second threshold while distributing assignments, and
the second threshold is lower than the first threshold.