IP Library Granted Patent US 11,768,856
Granted Patent B2
US 11,768,856 · App. 17/589,318 · Granted Sep 26, 2023

Method, apparatus, and management node for managing data in partition table, and storage medium

Inventors: Wei Feng (Beijing, CN); Fucheng Hong (Shenzhen, CN); Qi Sui (Beijing, CN)
Assignee: HUAWEI CLOUD COMPUTING TECHNOLOGIES CO., LTD.
G06F16/278G06F16/182G06F16/29
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,768,856
App. No.
17/589,318
Granted
Sep 26, 2023
Kind
B2
Abstract

In a method for managing data in a partition table, a server, and a storage medium, a management node obtains a creation duration range of data of a target partition in the partition table, further obtains a geographical area to which the target partition belongs, historical access information of the target partition, or a service type of the target partition; and then, when the creation duration range of the data of the target partition meets a predetermined time range of a first storage stage and a preset condition is met, the management node alters the data that is of the target partition and that has been stored based on a storage policy corresponding to a second storage stage to be stored based on a storage policy corresponding to the first storage stage.

Claims (48)

1. A method comprising:

obtaining a creation duration range of data of a target partition in a partition table, wherein the creation duration range is a combination of a minimum duration and a maximum duration, wherein the minimum duration is a first distance between a maximum time in a creation time range and a current time point, and wherein the maximum duration is a second distance between a minimum time in the creation time range and the current time point;

obtaining a geographical area to which the target partition belongs, historical access information of the target partition, or a service type of the target partition; and

altering, when the creation duration range meets a predetermined time range of a first storage stage and when a preset condition is met, the data that have been stored based on a second storage policy corresponding to a second storage stage,

wherein the second storage stage is to be stored based on a first storage policy corresponding to the first storage stage,

wherein a first storage performance of the first storage stage is lower than a second storage performance of the second storage stage, and

wherein the preset condition is that the geographical area is a target area, the historical access information meets a target condition, or the service type is a target service type.

2. The method of claim 1 , wherein the historical access information comprises a last access time of the target partition.

3. The method of claim 1 , wherein the historical access information comprises an access frequency of the target partition within a duration closest to the current time point.

4. The method of claim 3 , wherein the target condition is that the access frequency is less than a first value.

5. The method of claim 1 , wherein the target condition is that a duration is greater than a second value, and wherein the duration is from a last access time of the target partition to the current time point.

6. The method of claim 1 , further comprising storing, when the second storage stage is a hot data storage stage, when the first storage stage is a warm data storage stage, and based on a storage replica number corresponding to the warm data storage stage, the data in a storage area corresponding to the warm data storage stage.

7. The method of claim 1 , further comprising storing, when the second storage stage is a warm data storage stage and the first storage stage is a cold data storage stage, the data in a storage area corresponding to the cold data storage stage and in an erasure coding (EC) format.

8. The method according to claim 1 , further comprising establishing a mapping relationship between a Hadoop distributed file system (HDFS) directory of the target partition and a data block that is of the target partition and that is stored in a storage area corresponding to the first storage stage.

9. A method comprising:

obtaining a creation duration range of data of a target partition in a partition table, wherein the creation duration range is a combination of a minimum duration and a maximum duration, wherein the minimum duration is a first distance between a maximum time in a creation time range and a current time point, and wherein the maximum duration is a second distance between a minimum time in the creation time range and the current time point; and

altering, when the creation duration range meets a predetermined time range of a first storage stage, the data that have been stored based on a second storage policy corresponding to a second storage stage,

wherein the second storage stage is to be stored based on a first storage policy corresponding to the first storage stage,

wherein a first storage performance of the first storage stage is lower than a second storage performance of the second storage stage,

wherein the first storage stage is a warm data storage stage when the second storage stage is a hot data storage stage, and

wherein the first storage stage is a cold data storage stage when the second storage stage is the warm data storage stage.

10. The method of claim 9 , wherein when the minimum duration is less than a first threshold in the hot data storage stage, the minimum duration is greater than or equal to the first threshold in the warm data storage stage and less than a second threshold in the warm data storage stage.

11. The method of claim 9 , wherein when the minimum duration is greater than or equal to a first threshold in the hot data storage stage and when the minimum duration is less than a second threshold in the warm data storage stage, the minimum duration is greater than or equal to the second threshold in the cold data storage stage.

12. A management node comprising:

a memory configured to store instructions; and

a processor coupled to the memory and configured to execute the instructions to cause the management node to:

obtain a creation duration range of data of a target partition in a partition table, wherein the creation duration range is a combination of a minimum duration and a maximum duration, wherein the minimum duration is a first distance between a maximum time in a creation time range and a current time point, and wherein the maximum duration is a second distance between a minimum time in the creation time range and the current time point;

obtain a geographical area to which the target partition belongs, historical access information of the target partition, or a service type of the target partition; and

alter, when the creation duration range meets a predetermined time range of a first storage stage and when a preset condition is met, the data that have been stored based on a second storage policy corresponding to a second storage stage,

wherein the second storage stage is to be stored based on a first storage policy corresponding to the first storage stage,

wherein a first storage performance of the first storage stage is lower than a second storage performance of the second storage stage, and

wherein the preset condition is that the geographical area is a target area, the historical access information meets a target condition, or the service type is a target service type.

13. The management node of claim 12 , wherein the historical access information comprises a last access time of the target partition or comprises an access frequency of the target partition within a first duration closest to the current time point.

14. The management node of claim 13 , wherein the target condition is that the access frequency is less than a first value or is that a duration is greater than a second value, and wherein the duration is from the last access time to the current time point.

15. The management node of claim 12 , wherein the processor is further configured to execute the instructions to cause the management node to store when the second storage stage is a hot data storage stage, when the first storage stage is a warm data storage stage, and based on a storage replica number corresponding to the warm data storage stage, the data in a storage area corresponding to the warm data storage stage.

16. The management node of claim 12 , wherein the processor is further configured to execute the instructions to cause the management node to store, when the second storage stage is a warm data storage stage and the first storage stage is a cold data storage stage, the data in a storage area corresponding to the cold data storage stage and in an erasure coding (EC) format.

17. The management node according to claim 12 , wherein the processor is further configured to execute the instructions to cause the management node to establish a mapping relationship between a Hadoop distributed file system (HDFS) directory of the target partition and a data block that is of the target partition and that is stored in a storage area corresponding to the first storage stage.

18. A management node comprising:

a memory configured to store instructions; and

a processor coupled to the memory and configured to execute the instructions to cause the management node to:

obtain a creation duration range of data of a target partition in a partition table, wherein the creation duration range is a combination of a minimum duration and a maximum duration, wherein the minimum duration is a first distance between a maximum time in a creation time range and a current time point, and wherein the maximum duration is a second distance between a minimum time in the creation time range and the current time point; and

alter, when the creation duration range meets a predetermined time range of a first storage stage, the data that have been stored based on a second storage policy corresponding to a second storage stage,

wherein the second storage stage is to be stored based on a first storage policy corresponding to the first storage stage,

wherein a first storage performance of the first storage stage is lower than a second storage performance of the second storage stage,

wherein the first storage stage is a warm data storage stage when the second storage stage is a hot data storage stage, and

wherein the first storage stage is a cold data storage stage when the second storage stage is the warm data storage stage.

19. The management node of claim 18 , wherein when the minimum duration is less than a first threshold in the hot data storage stage, the minimum duration is greater than or equal to the first threshold in the warm data storage stage and less than a second threshold in the warm data storage stage.

20. The management node of claim 18 , wherein when the minimum duration is greater than or equal to a first threshold in the hot data storage stage and when the minimum duration is less than a second threshold in the warm data storage stage, the minimum duration is greater than or equal to the second threshold in the cold data storage stage.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2023
From: FENG, WEI; HONG, FUCHENG; SUI, QI
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 064382/0326 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2022
From: HUAWEI TECHNOLOGIES CO., LTD.
To: HUAWEI CLOUD COMPUTING TECHNOLOGIES CO., LTD.
Reel/Frame 059267/0088 →
Continuity (2)
Continuation PCTCN2019107747 · Sep 25, 2019
Related Publication 20220156288A1 · May 19, 2022