Enhanced vault save with compression
Metadata in volatile memory is selectively compressed and destaged to non-volatile storage in the event of an emergency shutdown due to loss of like power. Compression offload hardware that is normally used for data compression is used to compress the metadata, e.g. at line speed. The compressed metadata and any uncompressed metadata that was not selected for compression may be destaged to vault drives along with compressed and uncompressed data that is in the volatile memory. Compression during vaulting may decrease power consumption when operating under standby battery power.
1. A storage node comprising:
a plurality of interconnected computing nodes, each of the computing nodes comprising a processor and volatile memory in which metadata is maintained, including new metadata created responsive to writes;
non-volatile storage media comprising non-volatile managed drives that are configured for data storage when line power is available and dedicated non-volatile vault drives that are reserved for storage of data and metadata during emergency shutdown of the storage node, wherein the computing nodes create at least one logical storage volume that is presented to hosts and the metadata comprises mappings between logical block addresses of the logical storage volume and address space of the non-volatile storage media;
compression offload hardware that compresses data being copied from the volatile memory to the non-volatile managed drives when line power is available;
a standby power source configured to provide power to the computing nodes and the dedicated non-volatile vault drives; and
power conservation logic responsive to loss of line power and emergency shutdown under power provided by the standby power source to select, based on estimated compressibility, at least some but not all of the new metadata in the volatile memory to be compressed into compressed metadata by the compression offload hardware and to prompt storage of the compressed new metadata on the dedicated non-volatile vault drives.
2. The apparatus of claim 1 wherein new metadata that is not selected for compression is stored in an uncompressed state on the dedicated non-volatile vault drives in response to loss of line power and emergency shutdown under power provided by the standby power source in parallel with compression of the selected new metadata by the compression offload hardware.
3. The apparatus of claim 2 wherein data that is not selected for compression is stored in an uncompressed state on the dedicated non-volatile vault drives in response to loss of line power and emergency shutdown under power provided by the standby power source in parallel with compression of the selected data by the compression offload hardware.
4. A method comprising: in a storage node comprising: a plurality of interconnected computing nodes, each of the computing nodes comprising a processor and volatile memory in which metadata is maintained, including new metadata created responsive to writes; non-volatile storage media comprising non-volatile managed drives that are configured for data storage when line power is available and dedicated non-volatile vault drives that are configured for use only for storage of data and metadata during emergency shutdown of the storage node; compression offload hardware that compresses data being copied from the volatile memory to the non-volatile managed drives when line power is available; and a standby power source configured to provide power to the computing nodes, wherein the non-volatile storage media, and wherein the computing nodes create at least one logical storage volume that is presented to hosts and the metadata indicates mappings between logical block addresses of the logical storage volume and the volatile memory and the non-volatile storage media, steps comprising: detecting loss of line power; and responsive to the loss of line power, initiating emergency shutdown under power provided by the standby power source, comprising: selecting, based on estimated compressibility, at least some but not all of the new metadata in the volatile memory to be compressed into compressed metadata by the compression offload hardware; and—5—prompting storage of the compressed new metadata on the non-volatile storage media.
5. The method of claim 4 wherein the non-volatile storage media comprises managed drives and vault drives and comprising destaging the compressed new metadata to the vault drives in response to loss of line power and emergency shutdown under power provided by the standby power source.
6. The method of claim 4 comprising selecting at least some data to be compressed into compressed data and destaging that compressed data to the non-volatile storage media responsive to loss of line power and emergency shutdown under power provided by the standby power source.
7. The method of claim 6 wherein the non-volatile storage media comprises managed drives and vault drives and comprising destaging the compressed data and compressed new metadata to the vault drives responsive to loss of line power and emergency shutdown under power provided by the standby power source.
8. The method of claim 4 comprising storing metadata that is not selected for compression in an uncompressed state on the non-volatile storage in response to loss of line power and emergency shutdown under power provided by the standby power source.
9. The method of claim 6 comprising storing data that is not selected for compression in an uncompressed state on the non-volatile storage in response to loss of line power and emergency shutdown under power provided by the standby power source.
10. A computer-readable non-transitory storage media on which is stored computer program code used by a storage node, the code comprising: power conservation logic responsive to loss of line power and emergency shutdown under power provided by a standby power source to select, based on estimated compressibility, at least some but not all of new metadata in volatile memory to be compressed into compressed new metadata by compression offload hardware and store the compressed new metadata on at least one dedicated, non-volatile vault drive that is configured for use only for storage of data and metadata during emergency shutdown of the storage node, wherein the metadata indicates mappings between logical block addresses of a logical storage volume and non-volatile storage media.
11. The computer-readable non-transitory storage media of claim 10 wherein the power conservation logic includes instructions that select at least some data to be compressed into compressed data and destage that compressed data to the at least one vault drive responsive to loss of line power and emergency shutdown under power provided by the standby power source.
12. The computer-readable non-transitory storage media of claim 10 wherein the power conservation logic includes instructions that store new metadata that is not selected for compression in an uncompressed state on the at least one vault drive in response to loss of line power and emergency shutdown under power provided by the standby power source.
13. The computer-readable non-transitory storage media of claim 10 wherein the power conservation logic includes instructions that store data that is not selected for compression in an uncompressed state on the at least one vault drive in response to loss of line power and emergency shutdown under power provided by the standby power source.
14. The computer-readable non-transitory storage media of claim 10 implemented in a SAN (storage area network) node.