Method and apparatus for buffering and obtaining resources, resource buffering system
A method and an apparatus for buffering and obtaining resources as well as a resource buffering system are disclosed. The method includes: obtaining an access popularity value of a resource from a database at intervals of a first preset time, and obtaining load values of cache servers from the database if determining that the access popularity value reaches a preset first threshold; and determining a duplication cache server for duplicating the resource according to the access popularity value and the load values, and notifying the duplication cache server to duplicate the resource from a cache server that stores the resource and buffer the resource. The method overcome the problems in the prior art, namely, the same resource is buffered in only one cache server and the relatively idle cache servers are unable to share loads with busy cache servers. The method improves extensibility and working efficiency of the buffering system.
1. A resource buffering method implemented by a hardware processor of a resource buffering apparatus, the method comprising:
obtaining an access popularity value of a resource, and obtaining first load values of cache servers when determining that the access popularity value reaches a preset first threshold; and
determining one or more duplication cache servers from the cache servers for duplicating the resource according to the access popularity value and the first load values, and notifying the one or more duplication cache servers to duplicate the resource from a first cache server that stores the resource;
when the access popularity value of the resource is lower than the first threshold, determining a second cache server among the cache servers that already buffers the resource according to second load values of all cache servers that buffer the resource and a required quantity of duplicates of the resource, and notifying the determined second cache server to delete the resource; wherein the determined second cache server has a load higher than other cache servers that already buffer the resource.
2. The method according to claim 1 , further comprising:
obtaining a duplication completion notification sent by the one or more duplication cache servers; and
writing the duplication completion notification and duplication information into a database, wherein the duplication information is of the one or more duplication cache servers that buffer the resource.
3. The method according to claim 1 , further comprising:
determining a level of a quantity of downloads of the resource in a time period according to the access popularity value;
sorting all cache servers except the first cache server that already buffers the resource in order of the first load values, and obtaining a sorting result; and
determining a required quantity of duplication cache servers according to the level of the quantity of downloads, and selecting one or more cache servers as the one or more duplication cache servers based on the sorting result and the required quantity of the duplication cache servers, wherein the one or more duplication cache servers are the cache servers whose load values are lower than a preset second threshold.
4. A resource buffering apparatus, comprising:
a processor; and
a memory, wherein the processor is configured to execute computer-executable instructions stored in the memory to perform operations of:
obtaining an access popularity value of a resource, and obtaining first load values of cache servers where determining that the access popularity value reaches a preset first threshold; and
determining one or more duplication cache servers from the cache servers for duplicating the resource according to the access popularity value and the first load values, and notifying the one or more duplication cache servers to duplicate the resource from a first cache server that stores the resource;
when the access popularity value of the resource is lower than the first threshold, determining a second cache server among the cache servers that already buffers the resource according to second load values of all cache servers that buffer the resource and a required quantity of duplicates of the resource, and notifying the determined second cache server to delete the resource; wherein the determined second cache server has a load higher than other cache servers that already buffer the resource.
5. The resource buffering apparatus according to claim 4 , wherein the processor is further configured to perform operations of:
obtaining a duplication completion notification sent by the one or more duplication cache servers; and
writing the duplication completion notification and duplication information into a database, wherein the duplication information is of the one or more duplication cache servers that buffer the resource.
6. The resource buffering apparatus according to claim 4 , wherein the processor is further configured to perform operations of:
determining a level of a quantity of downloads of the resource in a time period according to the access popularity value;
sorting all cache servers except the first cache server that already buffers the resource in order of the first load values, and obtaining a sorting result; and
determining the required number of duplication cache servers according to the level of the number of downloads, and selecting one or more cache servers as the one or more duplication cache servers in the sorting result according to the required number of the duplication cache servers, wherein the one or more duplication cache servers are the cache servers whose load value are lower than a preset second threshold.
7. A non-transitory computer readable storage medium, storing computer instructions for buffering a resource, wherein the computer instructions when executed by a hardware processor instructs the hardware processor to implement following operations:
obtaining an access popularity value of a resource, and obtaining first load values of cache servers when determining that the access popularity value reaches a preset first threshold; and
determining one or more duplication cache servers from the cache servers for duplicating the resource according to the access popularity value and the first load values, and notifying the one or more duplication cache servers to duplicate the resource from a first cache server that stores the resource;
when the access popularity value of the resource is lower than the first threshold, determining a second cache server among the cache servers that already buffers the resource according to second load values of all cache servers that buffer the resource and a required quantity of duplicates of the resource, and notifying the determined second cache server to delete the resource; wherein the determined second cache server has a load higher than other cache servers that already buffer the resource.
8. The non-transitory computer readable storage medium according to claim 7 , wherein the operations further comprise:
obtaining a duplication completion notification sent by the one or more duplication cache servers; and
writing the duplication completion notification and duplication information into a database, wherein the duplication information is of the one or more duplication cache servers that buffer the resource.
9. The non-transitory computer readable storage medium according to claim 7 , wherein the operations further comprise:
determining a level of a quantity of downloads of the resource in a time period according to the access popularity value;
sorting all cache servers except the first cache server that already buffers the resource in order of the first load values, and obtaining a sorting result; and
determining a required quantity of duplication cache servers according to the level of the quantity of downloads, and selecting one or more cache servers as the one or more duplication cache servers based on the sorting result and the required quantity of the duplication cache servers, wherein the one or more duplication cache servers are the cache servers whose load values are lower than a preset second threshold.