Client side backoff filter for rate limiting
A method in a client backoff filter. The method includes receiving, from a server, a backoff data packet having backoff metadata. The method also includes saving the backoff metadata in a cache local to the client backoff filter. The method also includes receiving a subsequent request for service. The method also includes checking whether an attribute of the subsequent request for service matches the backoff metadata in the cache. The method also includes performing, responsive to checking, an action including at least one of the group including: blocking, responsive to the attribute matching the backoff metadata in the cache, transmission of the subsequent request for service to a server, and transmitting, responsive to the attribute failing to match the backoff metadata in the cache, the subsequent request for service to the server.
1. A method in a client backoff filter, the method comprising:
receiving, from a server, a backoff data packet comprising backoff metadata;
saving the backoff metadata in a cache local to the client backoff filter;
receiving a subsequent request for service;
checking whether an attribute of the subsequent request for service matches the backoff metadata in the cache;
performing, responsive to checking, an action comprising at least one from a group consisting of:
blocking, responsive to the attribute matching the backoff metadata in the cache, transmission of the subsequent request for service to the server, and
transmitting, responsive to the attribute failing to match the backoff metadata in the cache, the subsequent request for service to the server,
wherein the client backoff filter is part of a client proxy by which a client that generates the subsequent request for service communicates with a server proxy for a server.
2. The method of claim 1 , further comprising:
receiving, before receiving the backoff data packet, a first request for service;
checking, responsive to receiving the first request for service, whether one or more backoff attributes matches the first request for service; and
transmitting, responsive to no match being found, the first request for service to a throttle filter of a server.
3. The method of claim 2 , wherein the backoff data packet is received responsive to transmitting the first request for service.
4. The method of claim 1 , further comprising:
receiving, before receiving the backoff data packet, a first request for service;
checking, responsive to receiving the first request for service, whether one or more backoff attributes matches the first request for service; and
blocking, responsive to a match existing between the one or more backoff attributes and the first request for service, transmission of the first request for service to a throttle filter of a server.
5. The method of claim 1 , further comprising:
forwarding the backoff data packet to a client that requested the subsequent request for service, wherein the backoff data packet commands the client to cease transmitting future requests for service.
6. The method of claim 1 , wherein the client backoff filter and the cache are programmed as an encoder, and wherein saving the backoff metadata in the cache further comprises:
saving, by the encoder, the backoff metadata as a key and a plurality of values for the key.
7. The method of claim 6 , wherein each of the plurality of values represents a corresponding backoff condition currently imposed on a service identified by the key.
8. The method of claim 7 , wherein the corresponding backoff condition comprises at least one from the group consisting of a time the corresponding backoff condition is applied, a quota on how many new service requests may be sent, and a communication path by which a new request for service may be sent.
9. The method of claim 1 , wherein the client backoff filter and the cache are programmed as a decoder, and wherein checking whether the attribute of the subsequent request for service matches the backoff metadata further comprises:
identifying a key in the cache, wherein the key corresponds to a service corresponding to the subsequent request for service;
comparing the attribute of the subsequent request for service to a value in the cache that corresponds to the key; and
determining that the attribute matches the attribute in the backoff metadata when the attribute matches the value.
10. A system comprising:
a server comprising a processor and a cache;
a data repository in communication with the server and storing:
a backoff data packet comprising backoff metadata,
a subsequent request for service, and
an attribute of the subsequent request for service; and
a client filter which, when executed by the processor:
receives the backoff data packet,
saves the backoff metadata in the cache,
receives the subsequent request for service,
checks whether the attribute of the subsequent request for service matches the backoff metadata in the cache, and
performs, responsive to checking, an action comprising at least one from the group consisting of:
blocking, responsive to the attribute matching the backoff metadata in the cache, transmission of the subsequent request for service to the server, and
transmitting, responsive to the attribute failing to match the backoff metadata in the cache, the subsequent request for service to the server,
wherein the client filter is part of a client proxy by which a client that generates the subsequent request for service communicates with a server proxy for a server.
11. The system of claim 10 , wherein the client filter, when executed by the processor, further:
receives, before receiving the backoff data packet, a first request for service,
checks, responsive to receiving the first request for service, whether one or more backoff attributes matches the first request for service, and
transmits, responsive to no match being found, the first request for service to a throttle filter of a server.
12. The system of claim 10 , wherein the client filter, when executed by the processor, further:
receives, before receiving the backoff data packet, a first request for service,
checks, responsive to receiving the first request for service, whether one or more backoff attributes matches the first request for service, and
blocks, responsive to a match existing between the one or more backoff attributes and the first request for service, transmission of the first request for service to a throttle filter of a server.
13. The system of claim 10 , wherein the client filter, when executed by the processor, further:
forwards the backoff data packet to a client that requested the subsequent request for service, wherein the backoff data packet commands the client to cease transmitting future requests for service.
14. The system of claim 10 , wherein the client filter and the cache are programmed as an encoder, and wherein saving the backoff metadata in the cache further comprises:
saving, by the encoder, the backoff metadata as a key and a plurality of values for the key.
15. The system of claim 14 , wherein each of the plurality of values represents a corresponding backoff condition currently imposed on a service identified by the key.
16. The system of claim 15 , wherein the corresponding backoff condition comprises at least one from the group consisting of a time the corresponding backoff condition is applied, a quota on how many new service requests may be sent, and a communication path by which a new request for service may be sent.
17. The system of claim 10 , wherein the client filter and the cache are programmed as a decoder, and wherein the client filter checking whether the attribute of the subsequent request for service matches the backoff metadata further comprises:
identifying a key in the cache, wherein the key corresponds to a service corresponding to the subsequent request for service;
comparing the attribute of the subsequent request for service to a value in the cache that corresponds to the key; and
determining that the attribute matches the attribute in the backoff metadata when the attribute matches the value.