Granted Patent B2

US 12,210,453 · App. 18/345,243 · Granted Jan 28, 2025

Inventors: Charles D. Fico (Indianapolis, IN); Stefan Brinton (Indianapolis, IN); Chad Slappey (Indianapolis, IN); Hanna Wade (Indianapolis, IN)

Assignee: Genesys Cloud Services, Inc.

G06F12/0646G06F12/0891G06F12/123

Abstract

Claims (46)

1. A method for configurable caching, deduplication, and rate limit handling of user interface data requests, the method comprising:

receiving a data request initiated by a user interface element of a user interface;

determining whether a deduplication cache includes a deduplication entry associated with the data request;

determining whether a main cache, different from the deduplication cache, includes a cache entry associated with the data request in response to determining that the deduplication cache does not include the deduplication entry;

determining whether the data request is associated with a rate-limited group of application programming interface endpoints in response to one of (i) determining that the main cache does not include the cache entry associated with the data request or (ii) determining that the cache entry associated with the data request has expired; and

making the data request to a backend system after a predefined server retry period associated with the rate-limited group has elapsed in response to determining that the data request is associated with the rate-limited group.

2. The method of claim 1 , wherein the deduplication entry indicates that a previous data request identical to the data request initiated by the user interface element of the user interface was made within a threshold period of time.

3. The method of claim 1 , further comprising determining whether the data request is associated with a predefined maximum cache age in response to determining that the main cache includes the cache entry associated with the data request.

4. The method of claim 3 , further comprising determining whether the cache entry associated with the data request has expired based on a creation time of the cache entry and the predefined maximum cache age in response to determining that the data request is associated with the predefined maximum cache age.

5. The method of claim 3 , further comprising determining whether the cache entry associated with the data request has expired based on an expiration time of the cache entry defined by the cache entry in response to determining that the data request is not associated with the predefined maximum cache age.

6. The method of claim 1 , further comprising making the data request to the backend system immediately in response to determining that the data request is not associated with any rate-limited group.

7. The method of claim 1 , further comprising:

receiving an error associated with the data request in response to a failure to fulfill the data request;

determining whether the error associated with the data request is a retriable error;

determining whether a predefined retry limit has been reached in response to determining that the error associated with the data request is the retriable error; and

retrying the data request in response to determining that the predefined retry limit has not been reached.

8. The method of claim 7 , wherein retrying the data request comprises retrying the data request after the predefined server retry period in response to determining that the retriable error is a 429 error.

9. The method of claim 7 , wherein the predefined retry limit is a maximum number of retry attempts that can be made.

10. The method of claim 1 , wherein determining whether the data request is associated with the rate-limited group of application programming interface endpoints comprises determining whether an application programming interface endpoint to which the data request is directed is included in the rate-limited group of application programming interface endpoints.

11. The method of claim 1 , wherein the deduplication cache is configured to store one or more promises, wherein each of the one or more promises is associated with a previous respective data request.

12. The method of claim 1 , wherein the deduplication cache is configured to store data returned to previous data requests with a configurable timeout.

13. The method of claim 1 , wherein the main cache is configured to store data returned in response to previous data requests.

14. A system for configurable caching, deduplication, and rate limit handling of user interface data requests, the system comprising:

a deduplication cache;

a main cache different from the deduplication cache;

at least one processor; and

at least one memory comprising a plurality of instructions stored thereon that, in response to execution by the at least one processor, causes the system to:

receive a data request initiated by a user interface element of a user interface;

determine whether the deduplication cache includes a deduplication entry associated with the data request;

determine whether the main cache includes a cache entry associated with the data request in response to a determination that the deduplication cache does not include the deduplication entry;

determine whether the data request is associated with a rate-limited group of application programming interface endpoints in response to a determination that one of (i) the main cache does not include the cache entry associated with the data request or (ii) the cache entry associated with the data request has expired; and

make the data request to a backend system after a predefined server retry period associated with the rate-limited group has elapsed in response to a determination that the data request is associated with the rate-limited group.

15. The system of claim 14 , wherein the deduplication entry indicates that a previous data request identical to the data request initiated by the user interface element of the user interface was made within a threshold period of time.

16. The system of claim 14 , wherein the plurality of instructions further causes the system to:

determine whether the data request is associated with a predefined maximum cache age in response to a determination that the main cache includes the cache entry associated with the data request;

determine whether the cache entry associated with the data request has expired based on a creation time of the cache entry and the predefined maximum cache age in response to a determination that the data request is associated with the predefined maximum cache age; and

determine whether the cache entry associated with the data request has expired based on an expiration time of the cache entry defined by the cache entry in response to a determination that the data request is not associated with the predefined maximum cache age.

17. The system of claim 14 , wherein the plurality of instructions further causes the system to:

receive an error associated with the data request in response to a failure to fulfill the data request;

determine whether the error associated with the data request is a retriable error;

determine whether a predefined retry limit has been reached in response to a determination that the error associated with the data request is the retriable error; and

retry the data request in response to a determination that the predefined retry limit has not been reached.

18. The system of claim 17 , wherein to retry the data request comprises to retry the data request after the predefined server retry period in response to a determination that the retriable error is a 429 error.

19. The system of claim 17 , wherein the predefined retry limit is a maximum number of retry attempts that can be made.

20. The system of claim 14 , wherein the deduplication cache is configured to store one or more promises, wherein each of the one or more promises is associated with a previous respective data request; and

wherein the main cache is configured to store data returned in response to previous data requests.

Assignments (4)

Continuity (1)

References Cited (14)