QUERY TTL PENALTY BOX IN AUTO
A method for managing time-to-live (TTL) associated with a query stored in a cache, the method comprising a processor performing the following operations in an iteratively manner: detecting a first cache miss and a second cache miss associated with the query; detecting a difference between a first payload associated with the first cache miss and a second payload associated with the second cache miss; and for the difference not being detected, initializing the TTL of the query to a first time period.
1 . A method for managing time-to-live (TTL) associated with a query stored in a cache, the method comprising a processor performing the following operations in an iterative manner:
detecting a first cache miss and a second cache miss associated with the query, wherein the first cache miss precedes the second cache miss in time;
detecting a difference between a first payload associated with the first cache miss and a second payload associated with the second cache miss, wherein the first payload and the second payload are retrieved for processing from a database in communication with the cache after the second cache miss has been detected; and
for the difference not being detected, increasing the TTL of the query by a predetermined percentage of the TTL.
2 . The method of claim 1 , wherein the cache is a wire protocol-compatible database cache configured to communicate between an application that receives a user input including the query and the database.
3 . The method of claim 1 , further comprising:
for the difference being detected, removing a query result associated with the query from the cache and placing the query in a penalty state in which the TTL is not further increased or reduced.
4 . The method of claim 3 , further comprising:
for the query in the penalty state, once a condition is satisfied:
caching a current query result associated with the query into the cache and removing the query from the penalty state.
5 . The method of claim 4 , wherein the condition comprises:
while the query is in the penalty state, incrementing a counter each time the query is received from an application; and
comparing the counter against a query threshold indicative of a threshold number of queries received from the application while the TTL is in the penalty state.
6 . The method of claim 5 , further comprising:
determining whether the counter is equal to the query threshold; and
for the counter determined to be equal to the query threshold, removing the query from the penalty state.
7 . A method for adjusting time-to-live (TTL) associated with a query stored in a cache, the method comprising a processor performing the following operations in an iteratively manner:
detecting a first cache miss and a second cache miss associated with the query, wherein the first cache miss precedes the second cache miss in time;
detecting a difference between a first payload associated with the first cache miss and a second payload associated with the second cache miss, wherein the first payload and the second payload are retrieved for processing from a database in communication with the cache after the second cache miss has been detected;
for the difference not being detected, increasing the TTL of the query by a predetermined percentage of the TTL; and
for the difference being detected;
reducing the TTL of the query by a second predetermined percentage of the TTL; and
for the TTL of the query being reduced to equal to or less than a minimum TTL threshold, preventing a query result associated with the query from being stored in the cache.
8 . The method of claim 7 , wherein the first predetermined percentage of the TTL is 20% of the TTL.
9 . The method of claim 8 , wherein the second predetermined percentage of the TTL is 40% of the TTL.
10 . (canceled)
11 . The method of claim 10 , wherein the minimum TTL threshold is 50 milliseconds.
12 . A system for managing time-to-live (TTL) associated with a query, the system comprising:
a cache for storing the query;
a processor in communication with the cache and iteratively performs:
detect a first cache miss and a second cache miss associated with the query, wherein the first cache miss precedes the second cache miss in time;
detect a difference between a first payload associated with the first cache miss and a second payload associated with the second cache miss, wherein the first payload and the second payload are retrieved for processing from a database in communication with the cache after the second cache miss has been detected; and
for the difference not being detected, increasing the TTL of the query by a predetermined percentage of the TTL.
13 . The system of claim 12 , wherein the cache is a wire protocol-compatible database cache configured to communicate between an application that receives a user input including the query and the database.
14 . The system of claim 12 , wherein the processor is further configured to:
for the difference being detected, remove a query result associated with the query from the cache and place the query in a penalty state in which the TTL is not further increased or reduced.
15 . The system of claim 14 , wherein the processor is further configured to:
for the query in the penalty state, once a condition is satisfied:
cache a current query result associated with the query into the cache and remove the query from the penalty state.
16 . The system of claim 15 , wherein the condition comprises:
while the query is in the penalty state, incrementing a counter each time the query is received from an application; and
comparing the counter against a query threshold indicative of a threshold number of queries received from the application while the TTL is in the penalty state.
17 . The system of claim 16 , wherein the processor is further configured to:
determine whether the counter is equal to the query threshold; and
for the counter determined to be equal to the query threshold, remove the query from the penalty state.
18 . A non-transitory computer readable medium, storing instructions for managing time-to-live (TTL) associated with a query stored in a cache, the instructions comprising:
performing the following operations in an iterative manner:
detecting a first cache miss and a second cache miss associated with the query, wherein the first cache miss precedes the second cache miss in time;
detecting a difference between a first payload associated with the first cache miss and a second payload associated with the second cache miss, wherein the first payload and the second payload are retrieved for processing from a database in communication with the cache after the second cache miss has been detected;
for the difference not being detected, increasing the TTL of the query by a predetermined percentage of the TTL; and
for the difference being detected, removing a query result associated with the query from the cache and placing the query in a penalty state in which the TTL is not further increased or reduced.
19 . The non-transitory computer readable medium of claim 18 , further comprising:
for the query in the penalty state, once a condition is satisfied:
caching a current query result associated with the query into the cache and removing the query from the penalty state.
20 . The non-transitory computer readable medium of claim 19 , wherein the condition comprises:
while the query is in the penalty state, incrementing a counter each time the query is received from an application;
comparing the counter against a query threshold indicative of a threshold number of queries received from the application while the TTL is in the penalty state;
determining whether the counter is equal to the query threshold; and
for the counter determined to be equal to the query threshold, removing the query from the penalty state.