Granted Patent B2

US 11,675,514 · App. 16/942,919 · Granted Jun 13, 2023

Inventors: Vamsi Vankamamidi (Hopkinton, MA); Xinlei Xu (Beijing, CN); Geng Han (Beijing, CN)

Assignee: EMC IP Holding Company LLC

G06F3/0644G06F3/0604G06F3/0653G06F3/0673

Abstract

Claims (54)

1. A method for tracking storage utilization in a storage system, the method comprising:

determining an amount of physical storage space available for use on an appliance, the appliance being configured to store data, wherein types of the data being stored include user data, metadata, and boot data;

normalizing, for each type of data being stored on the appliance, an amount of storage space consumed by each type of data, the normalizing including:

using a log structure to derive an amount of storage space actually consumed by the user data, wherein the log structure is configured to track pages storing valid data and pages storing invalid data, and the amount of storage space actually consumed by the user data is derived based on statistics tracked for the pages storing valid data and for the pages storing invalid data;

using a redundancy protection level for a given type of data to derive an amount of storage space actually consumed by the metadata; and

using the redundancy protection level for the given type of data to derive the amount of storage space actually consumed by the boot data;

determining an amount of storage space on the appliance consumed by the user data, the metadata, and the boot data based on the derived amount of storage space actually consumed by the user data, the derived amount of storage space actually consumed by the metadata, and the derived amount of storage space actually consumed by the boot data; and

generating an alert when a percentage of storage space consumed on the appliance exceeds a threshold.

2. The method of claim 1 , further comprising:

displaying the amount of physical storage space on the appliance available for use and the amount of storage space on the appliance consumed by the data.

3. The method of claim 1 , wherein the alert provisions additional storage space for the storage system.

4. The method of claim 1 , wherein the alert balances load between the appliance and another appliance in the storage system.

5. The method of claim 1 , wherein the alert transitions the storage system into a write protection mode.

6. The method of claim 1 , wherein determining the amount of physical storage space available for use on the appliance comprises:

reserving an amount of storage space equal to the largest data storage device on the appliance;

configuring the remaining storage space on the appliance according to the redundancy protection level; and

reserving storage space on the appliance for over-provisioning.

7. The method of claim 6 , wherein normalizing the amount of storage space consumed by each type of data comprises:

for each type of data being stored on the appliance, deriving an amount of storage space actually consumed by the type of data based on the reserved storage space on the appliance for over-provisioning, spare space, and parity.

8. The method of claim 1 , wherein determining the amount of storage space on the appliance consumed by the data comprises:

summing the normalized amounts of storage space consumed by each type of data.

9. The method of claim 1 , further comprising:

determining an amount of physical storage space available for use on the data storage system and an amount of storage space on the data storage system consumed by the data.

10. A system for tracking storage utilization in a storage system, the system comprising a processor configured to:

determine an amount of physical storage space available for use on an appliance, the appliance being configured to store data, wherein types of the data being stored include user data, metadata, and boot data;

normalize, for each type of data being stored on the appliance, an amount of storage space consumed by each type of data; the normalizing including:

using a log structure to derive an amount of storage space actually consumed by the user data, wherein the log structure is configured to track pages storing valid data and pages storing invalid data, and the amount of storage space actually consumed by the user data is derived based on statistics tracked for the pages storing valid data and for the pages storing invalid data;

using a redundancy protection level for a given type of data to derive an amount of storage space actually consumed by the metadata; and

using the redundancy protection level for the given type of data to derive the amount of storage space actually consumed by the boot data;

determine an amount of storage space on the appliance consumed by the data, based on the normalized amounts of storage space actually consumed by the user data, the amount of storage space actually consumed by the metadata, and the amount of storage space actually consumed by the boot data; and

generate an alert when a percentage of storage space consumed on the appliance exceeds a threshold.

11. The system of claim 10 , wherein the processor is further configured to:

display the amount of physical storage space on the appliance available for use and the amount of storage space on the appliance consumed by the data.

12. The system of claim 10 , wherein the alert provisions additional storage space for the storage system.

13. The system of claim 10 , wherein the alert balances load between the appliance and another appliance in the storage system.

14. The system of claim 10 , wherein the alert transitions the storage system into a write protection mode.

15. The system of claim 10 , wherein the processor is further configured to:

reserve an amount of storage space equal to the largest data storage device on the appliance;

configure the remaining storage space on the appliance according to the redundancy protection level; and

reserve storage space on the appliance for over-provisioning.

16. The system of claim 15 , wherein the processor is further configured to:

for each type of data being stored on the appliance, derive an amount of storage space actually consumed by the type of data based on the reserved storage space on the appliance for over-provisioning, spare space, and parity.

17. The system of claim 10 , wherein the processor is further configured to:

sum the normalized amounts of storage space consumed by each type of data.

18. The system of claim 10 , wherein the processor is further configured to:

determine an amount of physical storage space available for use on the data storage system and an amount of storage space on the data storage system consumed by the data.

19. A non-transitory computer-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform the following steps:

determining an amount of physical storage space available for use on an appliance, the appliance being configured to store data, wherein types of the data being stored include user data, metadata, and boot data;

normalizing, for each type of data being stored on the appliance, an amount of storage space consumed by each type of data, the normalizing including:

using a log structure to derive an amount of storage space actually consumed by the user data, wherein the log structure is configured to track pages storing valid data and pages storing invalid data, and the amount of storage space actually consumed by the user data is derived based on statistics tracked for the pages storing valid data and for the pages storing invalid data;

using a redundancy protection level for a given type of data to derive an amount of storage space actually consumed by the metadata; and

using the redundancy protection level for the given type of data to derive the amount of storage space actually consumed by the boot data;

determining an amount of storage space on the appliance consumed by the user data, the metadata, and the boot data based on the derived amount of storage space actually consumed by the user data, the derived amount of storage space actually consumed by the metadata, and the derived amount of storage space actually consumed by the boot data; and

generating an alert when a percentage of storage space consumed on the appliance exceeds a threshold.

Assignments (9)

Continuity (1)