Data processing method and apparatus for data transfer in distributed storage system, device, and storage medium

1. A data processing method comprising:

based on a transfer control parameter corresponding to a storage location transfer event of distributed business data in a distributed storage system within a first time, predicting a first transfer control parameter usable by the distributed storage system within a second time for the storage location transfer event;

obtaining a second transfer control parameter that the distributed storage system provides within the second time in a case that the storage location transfer event does not occur; and

controlling a transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter;

wherein:

the transfer control parameter is a read rate and/or write rate used in the storage system for the storage location transfer event when the storage location transfer event occurs in the storage system;

the first transfer control parameter is a predicted read rate and/or write rate that the storage system uses within the second time in the storage location transfer event; and

the second transfer control parameter is a predicted transfer control parameter that the storage system provides to an access party of the business data within the second time.

2. The method of claim 1 , wherein controlling the transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter includes, in response to the first transfer control parameter being smaller than or equal to the second transfer control parameter, controlling the transfer of the distributed business data within the second time based on a difference value between the second transfer control parameter and the first transfer control parameter.

3. The method of claim 1 , wherein:

controlling the transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter includes, in response to the first transfer control parameter being greater than the second transfer control parameter, controlling the transfer of the distributed business data within the second time based on:

a difference value between the first transfer control parameter and the second transfer control parameter, and

a reference transfer control parameter;

the second transfer control parameter is a peak value of the transfer control parameter that the distributed storage system provides within the second time in a case that the storage location transfer event does not occur; and

the reference transfer control parameter is a valley value of the transfer control parameter that the distributed storage system provides within the second time in the case that the storage location transfer event does not occur.

4. The method of claim 1 ,

wherein:

the distributed storage system includes a plurality of storage modules; and

storage location of the distributed business data in the distributed storage system includes at least one storage module of the plurality of the storage modules;

the method further comprising:

obtaining target attributes of the plurality of storage modules;

dividing the plurality of storage modules into groups based on the target attributes; and

determining whether the storage location transfer event occurs in the distributed storage system based on at least one of:

resource balance parameters of the groups, or

reference quantities of the plurality of storage modules, each of the reference quantities being at least one of a reading capability parameter or a writing capability parameter of a corresponding one of the plurality of storage modules.

5. The method of claim 1 , further comprising:

determining, from all storage modules of the distributed storage system, a first storage module and a second storage module where the storage location transfer event of the distributed data occurs;

wherein controlling the transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter includes controlling a transfer of the distributed business data in the first storage module and the second storage module within the second time based on the first transfer control parameter and the second transfer control parameter.

6. The method of claim 1 , wherein obtaining the second transfer control parameter that the distributed storage system provides within the second time in the case that the storage location transfer event does not occur includes:

obtaining, based on historical data, the transfer control parameter provided by the distributed storage system within a historical time matching the second time in a case that the storage location transfer event does not occur in history; and

using the transfer control parameter provided by the distributed storage system within the historical time matching the second time as the second transfer control parameter.

7. The method of claim 1 , wherein:

a first time in a next cycle is a same time as a second time in a previous cycle; and

the transfer control parameter in the next cycle corresponding to the storage location transfer event of the business data in the storage system within the first time in the next cycle is an actual transfer control parameter used by the storage system in the previous cycle and obtained through actual detection.

8. An electronic device comprising:

at least one processor; and

a memory communicatively connected to the at least one processor and storing instructions that, when being executed by the at least one processor, cause the at least one processor to:

based on a transfer control parameter corresponding to a storage location transfer event of distributed business data in a distributed storage system within a first time, predict a first transfer control parameter usable by the distributed storage system within a second time for the storage location transfer event;

obtain a second transfer control parameter that the distributed storage system provides within the second time in a case that the storage location transfer event does not occur; and

control a transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter;

wherein:

the transfer control parameter is a read rate and/or write rate used in the storage system for the storage location transfer event when the storage location transfer event occurs in the storage system;

the first transfer control parameter is a predicted read rate and/or write rate that the storage system uses within the second time in the storage location transfer event; and

the second transfer control parameter is a predicted transfer control parameter that the storage system provides to an access party of the business data within the second time.

9. The device of claim 8 , wherein the instructions further cause the at least one processor to control the transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter by, in response to the first transfer control parameter being smaller than or equal to the second transfer control parameter, controlling the transfer of the distributed business data within the second time based on a difference value between the second transfer control parameter and the first transfer control parameter.

10. The device of claim 8 , wherein:

the instructions further cause the at least one processor to control the transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter by, in response to the first transfer control parameter being greater than the second transfer control parameter, controlling the transfer of the distributed business data within the second time based on:

a difference value between the first transfer control parameter and the second transfer control parameter, and

a reference transfer control parameter;

the second transfer control parameter is a peak value of the transfer control parameter that the distributed storage system provides within the second time in a case that the storage location transfer event does not occur; and

the reference transfer control parameter is a valley value of the transfer control parameter that the distributed storage system provides within the second time in the case that the storage location transfer event does not occur.

11. The device of claim 8 , wherein:

the distributed storage system includes a plurality of storage modules;

storage location of the distributed business data in the distributed storage system includes at least one storage module of the plurality of the storage modules; and

the instructions further cause the at least one processor to:

obtain target attributes of the plurality of storage modules;

divide the plurality of storage modules into groups based on the target attributes; and

determine whether the storage location transfer event occurs in the distributed storage system based on at least one of:

resource balance parameters of the groups, or

reference quantities of the plurality of storage modules, each of the reference quantities being at least one of a reading capability parameter or a writing capability parameter of a corresponding one of the plurality of storage modules.

12. The device of claim 8 , wherein

the instructions further cause the at least one processor to determine, from all storage modules of the distributed storage system, a first storage module and a second storage module where the storage location transfer event of the distributed data occurs; and

the instructions further cause the at least one processor to control the transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter by controlling a transfer of the distributed business data in the first storage module and the second storage module within the second time based on the first transfer control parameter and the second transfer control parameter.

13. The device of claim 8 , wherein the instructions further cause the at least one processor to obtain the second transfer control parameter that the distributed storage system provides within the second time in the case that the storage location transfer event does not occur by:

obtaining, based on historical data, the transfer control parameter provided by the distributed storage system within a historical time matching the second time in a case that the storage location transfer event does not occur in history; and

using the transfer control parameter provided by the distributed storage system within the historical time matching the second time as the second transfer control parameter.

14. A non-transitory computer readable storage medium storing instructions that, when executed by a computer, cause the computer to:

based on a transfer control parameter corresponding to a storage location transfer event of distributed business data in a distributed storage system within a first time, predict a first transfer control parameter usable by the distributed storage system within a second time for the storage location transfer event;

obtain a second transfer control parameter that the distributed storage system provides within the second time in a case that the storage location transfer event does not occur; and

control a transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter;

wherein:

the transfer control parameter is a read rate and/or write rate used in the storage system for the storage location transfer event when the storage location transfer event occurs in the storage system;

the first transfer control parameter is a predicted read rate and/or write rate that the storage system uses within the second time in the storage location transfer event; and

the second transfer control parameter is a predicted transfer control parameter that the storage system provides to an access party of the business data within the second time.

15. The non-transitory computer readable storage medium of claim 14 , wherein the instructions further cause the computer to control the transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter by, in response to the first transfer control parameter being smaller than or equal to the second transfer control parameter, controlling the transfer of the distributed business data within the second time based on a difference value between the second transfer control parameter and the first transfer control parameter.

16. The non-transitory computer readable storage medium of claim 14 , wherein:

the instructions further cause the computer to control the transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter by, in response to the first transfer control parameter being greater than the second transfer control parameter, controlling the transfer of the distributed business data within the second time based on:

a difference value between the first transfer control parameter and the second transfer control parameter, and

a reference transfer control parameter;

the second transfer control parameter is a peak value of the transfer control parameter that the distributed storage system provides within the second time in a case that the storage location transfer event does not occur; and

the reference transfer control parameter is a valley value of the transfer control parameter that the distributed storage system provides within the second time in the case that the storage location transfer event does not occur.

17. The non-transitory computer readable storage medium of claim 14 , wherein:

the distributed storage system includes a plurality of storage modules;

storage location of the distributed business data in the distributed storage system includes at least one storage module of the plurality of the storage modules; and

the instructions further cause the computer to:

obtain target attributes of the plurality of storage modules;

divide the plurality of storage modules into groups based on the target attributes; and

determine whether the storage location transfer event occurs in the distributed storage system based on at least one of:

resource balance parameters of the groups, or

reference quantities of the plurality of storage modules, each of the reference quantities being at least one of a reading capability parameter or a writing capability parameter of a corresponding one of the plurality of storage modules.

18. The non-transitory computer readable storage medium of claim 14 , wherein

the instructions further cause the computer to determine, from all storage modules of the distributed storage system, a first storage module and a second storage module where the storage location transfer event of the distributed data occurs; and

the instructions further cause the computer to control the transfer of the distributed business data within the second time based on the first transfer control parameter and the second transfer control parameter by controlling a transfer of the distributed business data in the first storage module and the second storage module within the second time based on the first transfer control parameter and the second transfer control parameter.

19. The non-transitory computer readable storage medium of claim 14 , wherein the instructions further cause the computer to obtain the second transfer control parameter that the distributed storage system provides within the second time in the case that the storage location transfer event does not occur by:

obtaining, based on historical data, the transfer control parameter provided by the distributed storage system within a historical time matching the second time in a case that the storage location transfer event does not occur in history; and

using the transfer control parameter provided by the distributed storage system within the historical time matching the second time as the second transfer control parameter.