Method and apparatus for selectively deleting cached records
View Patent ↗A method, apparatus and computer program product selectively delete records from a cache in a manner that not only takes into account usage of the record, but also the cost associated with the generation of the record. In regards to a method, a cost associated with generation of a record maintained in a cache is determined. The cost may be defined in terms of the time consumed to generate the record. The method also determines usage of the record. At least one of the cost or the usage may be determined on a relative basis with respect to the cost or the usage, respectively, of other records maintained in the cache. Further, the method determines whether the record should be deleted from the cache based upon the cost and the usage of the record. Based on this determination, the record may be selectively deleted from or retained within the cache.
1. A method comprising:
determining a cost associated with initial generation of a record that is then maintained in a cache by determining the cost in terms of time consumed to initially generate the record with the time consumed to initially generate the record being based upon time required to generate search results from a search of a database in response to a database query with the search results then stored in the cache;
determining usage of the record including retrieval of the record with the usage occurring following storage of the record in the cache, wherein at least one of the cost or the usage is determined on a relative basis with respect to the cost or the usage, respectively, of other records maintained in the cache;
combining a representation of the cost with a representation of the usage of the record to define a score; and
determining, with a processor, whether the record is to be deleted from the cache based upon the cost and the usage of the record, wherein determining whether the record is to be deleted comprises comparing the score based upon a combination of the representation of the cost and the representation of the usage of the record to a predefined threshold.
2. A method according to claim 1 further comprising determining a cost ratio of the cost associated with generation of the record and an average cost associated with generation of other records maintained in the cache, and wherein determining whether the record is to be deleted comprises determining whether the record is to be deleted from the cache based upon the cost ratio.
3. A method according to claim 2 wherein the representation of the cost comprises the cost ratio.
4. A method according to claim 3 wherein combining the cost ratio with the representation of the usage of the record comprises individually weighting the cost ratio and the representation of the usage of the record to define the score.
5. A method according to claim 1 wherein determining usage of the record comprises determining an average number of retrievals of the record in a predefined time period since a most recent refresh of the record.
6. A method according to claim 1 wherein determining usage of the record comprises determining a representation of time remaining prior to expiration of the record.
7. A method according to claim 1 wherein determining whether the record is to be deleted from the cache based upon the cost and the usage of the record comprises determining whether the record is to be deleted from the cache without consideration of a size of the cache.
8. A method according to claim 1 wherein determining usage of the record comprises determining usage of the record based on a number of retrievals of the record following storage in the cache.
9. An apparatus comprising a hardware processing circuitry configured to:
determine a cost associated with initial generation of a record that is then maintained in a cache by determining the cost in terms of time consumed to initially generate the record with the time consumed to initially generate the record being based upon time required to generate search results from a search of a database in response to a database query with the search results then stored in the cache;
determine usage of the record including retrieval of the record with the usage occurring following storage of the record in the cache;
combine a representation of the cost with a representation of the usage of the record to define a score; and
determine whether the record is to be deleted from the cache based upon the cost and the usage of the record, wherein the processing circuitry is configured to determine at least one of the cost or the usage on a relative basis with respect to the cost or the usage, respectively, of other records maintained in the cache, wherein the hardware processing circuitry is configured to determine whether the record is to be deleted by comparing the score based upon a combination of the representation of the cost and the representation of the usage of the record to a predefined threshold.
10. An apparatus according to claim 9 wherein the processing circuitry is further configured to determine a cost ratio of the cost associated with generation of the record and an average cost associated with generation of other records maintained in the cache, and wherein the processing circuitry is configured to determine whether the record is to be deleted by determining whether the record is to be deleted from the cache based upon the cost ratio.
11. An apparatus according to claim 10 wherein the representation of the cost comprises the cost ratio.
12. An apparatus according to claim 11 wherein the processing circuitry is configured to combine the cost ratio with the representation of the usage of the record by individually weighting the cost ratio and the representation of the usage of the record to define the score.
13. An apparatus according to claim 9 wherein the processing circuitry is configured to determine usage of the record by determining an average number of retrievals of the record in a predefined time period since a most recent refresh of the record.
14. An apparatus according to claim 9 wherein the processing circuitry is configured to determine usage of the record by determining a representation of time remaining prior to expiration of the record.
15. An apparatus according to claim 9 wherein the processing circuitry is configured to determine whether the record is to be deleted from the cache based upon the cost and the usage of the record without consideration of a size of the cache.
16. An apparatus according to claim 9 wherein the processing circuitry is configured to determine usage of the record by determining usage of the record based on a number of retrievals of the record following storage in the cache.
17. A non-transitory computer readable storage medium comprising instructions that, when executed by a processor, cause the processor to:
determine a cost associated with initial generation of a record that is then maintained in a cache by determining the cost in terms of time consumed to initially generate the record with the time consumed to initially generate the record being based upon time required to generate search results from a search of a database in response to a database query with the search results then stored in the cache;
determine usage of the record including retrieval of the record with the usage occurring following storage of the record in the cache, wherein at least one of the cost or the usage is determined on a relative basis with respect to the cost or the usage, respectively, of other records maintained in the cache;
combine a representation of the cost with a representation of the usage of the record to define a score; and
determine whether the record is to be deleted from the cache based upon the cost and the usage of the record, wherein the processor is caused to determine whether the record is to be deleted by comparing the score based upon a combination of the representation of the cost and the representation of the usage of the record to a predefined threshold.
18. A non-transitory computer readable storage medium according to claim 17 wherein the instructions, when executed by the processor, further cause the processor to determine a cost ratio of the cost associated with generation of the record and an average cost associated with generation of other records maintained in the cache, and wherein determining whether the record is to be deleted comprises determining whether the record is to be deleted from the cache based upon the cost ratio.
19. A non-transitory computer readable storage medium according to claim 18 wherein the representation of the cost comprises the cost ratio.
20. A non-transitory computer readable storage medium according to claim 17 wherein determining whether the record is to be deleted from the cache based upon the cost and the usage of the record comprises determining whether the record is to be deleted from the cache without consideration of a size of the cache.
21. A non-transitory computer readable storage medium according to claim 17 wherein determining usage of the record comprises determining usage of the record based on a number of retrievals of the record following storage in the cache.