Granted Patent B2

US 11,487,460 · App. 17/123,525 · Granted Nov 1, 2022

Inventors: Itay Keller (Tel Aviv, IL); Dan Aharoni (Brookline, MA)

Assignee: EMC IP Holding Company LLC

G06F3/065G06F3/0619G06F3/0652G06F3/0659G06F3/0683

Abstract

Claims (85)

1. A method, comprising:

obtaining a write operation issued by an application, the write operation comprising first data associated with a logical data device of the application;

storing the first data in a first entry of a log-structured array implemented on at least one storage device of a storage system;

invalidating a second entry of the log-structured array based at least in part on the storage of the first data in the first entry, the second entry comprising second data associated with the logical data device that was stored in the second entry prior to obtaining the write operation;

determining that a first indication in log-structured array metadata associated with the log-structured array indicates that the invalidated second entry comprises data that is awaiting replication to a replication storage system; and

deferring reclamation of the second entry based at least in part on the determination that the first indication in the log-structured array metadata indicates that the invalidated second entry comprises data that is awaiting replication to the replication storage system;

wherein the first indication in the log-structured array metadata indicating that the invalidated second entry comprises data that is awaiting replication to the replication storage system further indicates that the invalidated second entry is being utilized to provide at least a portion of a replication log that includes the data awaiting replication to the replication storage system; and

wherein the method is performed by at least one processing device of the storage system, the at least one processing device comprising at least one processor coupled to memory.

2. The method of claim 1 , wherein the method further comprises:

replicating the second data to the replication storage system;

clearing the first indication in the log-structured array metadata based at least in part on the replication of the second data;

determining that the first indication in the log-structured array metadata indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system; and

reclaiming the second entry based at least in part on the determination that the first indication indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system.

3. The method of claim 2 , wherein replicating the second data to the replication storage system comprises:

determining that a second indication in replication metadata indicates that the second data corresponds to a group of write operations awaiting replication to the replication storage system;

determining that a threshold criterion for replicating the group of write operations has been met; and

replicating data corresponding to the group of write operations to the replication storage system based at least in part on the replication metadata and the threshold criterion being met, the data corresponding to the group of write operations comprising the second data.

4. The method of claim 3 , wherein the threshold criterion comprises at least one of a predetermined number of write operations added to the group, a predetermined size of data corresponding to the write operations added to the group and a predetermined amount of time since the group was created.

5. The method of claim 3 , wherein the method further comprises setting a third indication in the replication metadata based at least in part on the storing of the first data in the first entry, the third indication indicating that the write operation corresponding to the first data is awaiting replication to the replication storage system.

6. The method of claim 5 wherein:

the third indication indicates that the write operation corresponding to the first data is included in the group of write operations awaiting replication to the replication storage system; and

replicating the data corresponding to the group of write operations to the replication storage system based at least in part on the replication metadata and the threshold criterion comprises replicating the first data to the replication storage system based at least in part on the third indication.

7. The method of claim 1 , wherein the method further comprises:

determining that a second indication in replication metadata indicates that the second data corresponds to a group of write operations awaiting replication to the replication storage system;

setting a third indication in the replication metadata based at least in part on the storing of the first data in the first entry, the third indication indicating that the write operation corresponding to the first data is included in the group of write operations awaiting replication to the replication storage system;

determining that the second data and the first data both correspond to the same group of write operations awaiting replication to the replication storage system based at least in part on the second indication and the third indication;

clearing the first indication in the log-structured array metadata based at least in part on the determination that the second data and the first data both correspond to the same group of write operations awaiting replication to the replication storage system;

determining that the first indication in the log-structured array metadata indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system; and

reclaiming the second entry based at least in part on the determination that the first indication indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system.

8. An article of manufacture comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code is executable by one or more processors to implement a method comprising:

obtaining a write operation issued by an application, the write operation comprising first data associated with a logical data device of the application;

storing the first data in a first entry of a log-structured array implemented on at least one storage device of a storage system;

invalidating a second entry of the log-structured array based at least in part on the storage of the first data in the first entry, the second entry comprising second data associated with the logical data device that was stored in the second entry prior to obtaining the write operation;

determining that a first indication in log-structured array metadata associated with the log-structured array indicates that the invalidated second entry comprises data that is awaiting replication to a replication storage system; and

deferring reclamation of the second entry based at least in part on the determination that the first indication in the log-structured array metadata indicates that the invalidated second entry comprises data that is awaiting replication to the replication storage system;

wherein the first indication in the log-structured array metadata indicating that the invalidated second entry comprises data that is awaiting replication to the replication storage system further indicates that the invalidated second entry is being utilized to provide at least a portion of a replication log that includes the data awaiting replication to the replication storage system.

9. The article of manufacture of claim 8 , wherein the method further comprises:

replicating the second data to the replication storage system;

clearing the first indication in the log-structured array metadata based at least in part on the replication of the second data;

determining that the first indication in the log-structured array metadata indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system; and

reclaiming the second entry based at least in part on the determination that the first indication indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system.

10. The article of manufacture of claim 9 , wherein replicating the second data to the replication storage system comprises:

determining that a second indication in replication metadata indicates that the second data corresponds to a group of write operations awaiting replication to the replication storage system;

determining that a threshold criterion for replicating the group of write operations has been met; and

replicating data corresponding to the group of write operations to the replication storage system based at least in part on the replication metadata and the threshold criterion being met, the data corresponding to the group of write operations comprising the second data.

11. The article of manufacture of claim 10 , wherein the threshold criterion comprises at least one of a predetermined number of write operations added to the group, a predetermined size of data corresponding to the write operations added to the group and a predetermined amount of time since the group was created.

12. The article of manufacture of claim 10 , wherein the method further comprises setting a third indication in the replication metadata based at least in part on the storing of the first data in the first entry, the third indication indicating that the write operation corresponding to the first data is awaiting replication to the replication storage system.

13. The article of manufacture of claim 12 , wherein:

the third indication indicates that the write operation corresponding to the first data is included in the group of write operations awaiting replication to the replication storage system; and

replicating the data corresponding to the group of write operations to the replication storage system based at least in part on the replication metadata and the threshold criterion comprises replicating the first data to the replication storage system based at least in part on the third indication.

14. The article of manufacture of claim 8 , wherein the method further comprises:

determining that a second indication in replication metadata indicates that the second data corresponds to a group of write operations awaiting replication to the replication storage system;

setting a third indication in the replication metadata based at least in part on the storing of the first data in the first entry, the third indication indicating that the write operation corresponding to the first data is included in the group of write operations awaiting replication to the replication storage system;

determining that the second data and the first data both correspond to the same group of write operations awaiting replication to the replication storage system based at least in part on the second indication and the third indication;

clearing the first indication in the log-structured array metadata based at least in part on the determination that the second data and the first data both correspond to the same group of write operations awaiting replication to the replication storage system;

determining that the first indication in the log-structured array metadata indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system; and

reclaiming the second entry based at least in part on the determination that the first indication indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system.

15. An apparatus comprising:

a storage system comprising at least one processor coupled to memory, the at least one processor being configured:

to obtain a write operation issued by an application, the write operation comprising first data associated with a logical data device of the application;

to store the first data in a first entry of a log-structured array implemented on at least one storage device of a storage system;

to invalidate a second entry of the log-structured array based at least in part on the storage of the first data in the first entry, the second entry comprising second data associated with the logical data device that was stored in the second entry prior to obtaining the write operation;

to determine that a first indication in log-structured array metadata associated with the log-structured array indicates that the invalidated second entry comprises data that is awaiting replication to a replication storage system; and

to defer reclamation of the second entry based at least in part on the determination that the first indication in the log-structured array metadata indicates that the invalidated second entry comprises data that is awaiting replication to the replication storage system;

wherein the first indication in the log-structured array metadata indicating that the invalidated second entry comprises data that is awaiting replication to the replication storage system further indicates that the invalidated second entry is being utilized to provide at least a portion of a replication log that includes the data awaiting replication to the replication storage system.

16. The apparatus of claim 15 , wherein the at least one processor is further configured:

to replicate the second data to the replication storage system;

to clear the first indication in the log-structured array metadata based at least in part on the replication of the second data;

to determine that the first indication in the log-structured array metadata indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system; and

to reclaim the second entry based at least in part on the determination that the first indication indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system.

17. The apparatus of claim 16 , wherein replicating the second data to the replication storage system comprises:

determining that a second indication in replication metadata indicates that the second data corresponds to a group of write operations awaiting replication to the replication storage system;

determining that a threshold criterion for replicating the group of write operations has been met; and

replicating data corresponding to the group of write operations to the replication storage system based at least in part on the replication metadata and the threshold criterion being met, the data corresponding to the group of write operations comprising the second data.

18. The apparatus of claim 17 , wherein the at least one processor is further configured to set a third indication in the replication metadata based at least in part on the storing of the first data in the first entry, the third indication indicating that the write operation corresponding to the first data is awaiting replication to the replication storage system.

19. The apparatus of claim 18 , wherein:

the third indication indicates that the write operation corresponding to the first data is included in the group of write operations awaiting replication to the replication storage system; and

replicating the data corresponding to the group of write operations to the replication storage system based at least in part on the replication metadata and the threshold criterion comprises replicating the first data to the replication storage system based at least in part on the third indication.

20. The apparatus of claim 15 , wherein the at least one processor is further configured:

to determine that a second indication in replication metadata indicates that the second data corresponds to a group of write operations awaiting replication to the replication storage system;

to set a third indication in the replication metadata based at least in part on the storing of the first data in the first entry, the third indication indicating that the write operation corresponding to the first data is included in the group of write operations awaiting replication to the replication storage system;

to determine that the second data and the first data both correspond to the same group of write operations awaiting replication to the replication storage system based at least in part on the second indication and the third indication;

to clear the first indication in the log-structured array metadata based at least in part on the determination that the second data and the first data both correspond to the same group of write operations awaiting replication to the replication storage system;

to determine that the first indication in the log-structured array metadata indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system; and

to reclaim the second entry based at least in part on the determination that the first indication indicates that the invalidated second entry does not comprise data that is awaiting replication to the replication storage system.

Assignments (9)

Continuity (1)

Cited By (4)

US 12,299,303 US 12,339,805 US 12,367,216 US 12,436,704