Migration of encrypted data for data storage systems
View Patent ↗Systems and methods for compression, formatting, and migration of data for data storage systems are disclosed. In some embodiments, data repacking can be used in any situation where embedded metadata needs to be accessed, such as during data migration, and where the underlying data is encrypted. In some embodiments, performance is increased because encrypted data is repacked without first performing decryption. In addition, data may also be compressed and repacking can be performed without performing decompression. Advantageously, there is no need to retrieve or wait for the availability of encryption key (or keys) or expand resources in decrypting (and decompressing) data before repacking it and encrypting repacked data. Available capacity for storing user data, reliability, and performance of the data storage system can be increased.
1. A data storage system comprising:
non-volatile memory (NVM) configured to store data in a plurality of memory data units, a memory data unit corresponding to a unit of storage in the NVM, wherein at least some memory data units have a different format; and
a controller configured to:
retrieve from the NVM data stored in a first memory data unit, the first memory data unit further storing metadata associated with the data, wherein the data is encrypted and the metadata is not encrypted, and
using the metadata and without decrypting the data, migrate the data from the first memory data unit to a second memory data unit, the format of the second memory data unit being different than the format of the first memory data unit,
wherein migrating the data from the first memory data unit to the second memory data unit causes at least some data stored in the first memory data unit to become invalid, and
wherein migrating the data from the first memory data unit to the second memory data unit causes improved performance or reliability of the data storage system,
wherein the NVM comprises a non-volatile solid-state memory array and a magnetic storage, wherein a physical storage unit of the non-volatile solid-state memory array is larger in size than a physical storage unit of the magnetic storage, and wherein the controller is further configured to format the data to be stored in a physical storage unit of a different size in performing the migration.
2. The data storage system of claim 1 , wherein the non-volatile solid-state memory array utilizes memory data units of a first format type and the magnetic storage utilizes memory data units of a second format type different from the first format type.
3. The data storage system of claim 2 , wherein a memory data unit of the first format type is configured to store a different maximum size of user data than a memory data unit of the second format type, and wherein user data comprises data received from a host system.
4. The data storage system of claim 1 , wherein the non-volatile solid-state memory array utilizes memory data units of a first format type and memory data units of a second format type different from the first format type.
5. The data storage system of claim 4 , wherein a memory data unit of the first format type is configured to store a different maximum size of user data than a memory data unit of the second format type, and wherein user data comprises data received from a host system.
6. The data storage system of claim 1 , wherein the data stored in the first memory data unit comprises compressed and encrypted data, and wherein the controller is further configured to store the compressed and encrypted data in the second memory data unit without decompressing the data.
7. The data storage system of claim 6 , wherein the metadata is not compressed.
8. The data storage system of claim 1 , wherein the metadata indicates a plurality of logical addresses associated with the data stored in the first memory data unit.
9. The data storage system of claim 1 , wherein the controller is further configured to store the data in the second memory data unit in response to performing one or more of garbage collection, wear leveling, and data refresh operations.
10. A method of migrating data in a data storage system comprising a non-volatile memory (NVM) configured to store data in a plurality of memory data units, a memory data unit corresponding to a unit of storage in the NVM, wherein at least some memory data units have a different format, the method comprising:
retrieving from the NVM data stored in a first memory data unit, the first memory data unit further storing metadata associated with the data, wherein the data is encrypted and the metadata is not encrypted; and
using the metadata and without decrypting the data, migrating the data from the first memory data unit to a second memory data unit, the format of the second memory data unit being different than the format of the first memory data unit,
wherein the method is performed under control of a controller,
wherein migrating the data from the first memory data unit to the second memory data unit causes at least some data stored in the first memory data unit to become invalid, and
wherein migrating the data from the first memory data unit to the second memory data unit causes improved performance or reliability of the data storage system,
wherein the NVM comprises a non-volatile solid-state memory array and a magnetic storage, wherein a physical storage unit of the non-volatile solid-state memory array is larger in size than a physical storage unit of the magnetic storage, and wherein the controller is configured to format the data to be stored in a physical storage unit of a different size in performing the migration.
11. The method of claim 10 , wherein the non-volatile solid-state memory array utilizes memory data units of a first format type and the magnetic storage utilizes memory data units of a second format type different from the first format type.
12. The method of claim 11 , wherein a memory data unit of the first format type is configured to store a different maximum size of user data than a memory data unit of the second format type, and wherein user data comprises data received from a host system.
13. The method of claim 10 , wherein the non-volatile solid-state memory array utilizes memory data units of a first format type and memory data units of a second format type different from the first format type.
14. The method of claim 13 , wherein a memory data unit of the first format type is configured to store a different maximum size of user data than a memory data unit of the second format type, and wherein user data comprises data received from a host system.
15. The method of claim 10 , further comprising storing compressed and encrypted data stored in the first memory data unit in the second memory data unit without decompressing the data.
16. The method of claim 15 , wherein the metadata is not compressed.
17. The method of claim 10 , wherein the metadata indicates a plurality of logical addresses associated with the data stored in the first memory data unit.
18. The method of claim 10 , wherein storing the data in the second memory data unit is performed in response to executing one or more of garbage collection, wear leveling, and data refresh operations.
19. A data storage system comprising:
non-volatile memory (NVM) configured to store data in a plurality of memory data units, a memory data unit corresponding to a unit of storage in the NVM, wherein at least some memory data units have a different format; and
a controller configured to:
retrieve data stored in a first memory data unit stored in the NVM, the first memory data unit further storing metadata associated with the data, wherein the data is encrypted and the metadata is not encrypted, and
using the metadata and without decrypting the data, migrate the data from the first memory data unit to a second memory data unit, the format of the second memory data unit being different than the format of the first memory data unit,
wherein migrating the data from the first memory data unit to the second memory data unit causes at least some data stored in the first memory data unit to become invalid,
wherein the NVM comprises a non-volatile solid-state memory array and a magnetic storage, wherein a physical storage unit of the non-volatile solid-state memory array is larger in size than a physical storage unit of the magnetic storage, and wherein the controller is further configured to format the data to be stored in a physical storage unit of a different size in performing the migration.
20. The data storage system of claim 19 , wherein the non-volatile solid-state memory array utilizes memory data units of a first format type and memory data units of a second format type different from the first format type.
21. The data storage system of claim 20 , wherein a memory data unit of the first format type is configured to store a different maximum size of user data than a memory data unit of the second format type, and wherein user data comprises data received from a host system.
22. The data storage system of claim 19 , wherein the data stored in the first memory data unit comprises compressed and encrypted data, and wherein the controller is further configured to store the compressed and encrypted data in the second memory data unit without decompressing the data.
23. The data storage system of claim 22 , wherein the metadata is not compressed.
24. The data storage system of claim 19 , wherein the controller is further configured to store the data in the second memory data unit in response to performing one or more of garbage collection, wear leveling, and data refresh operations.