IP Library Granted Patent US 10,437,783
Granted Patent B1
US 10,437,783 · App. 14/496,790 · Granted Oct 8, 2019

Recover storage array using remote deduplication device

Inventors: Saar Cohen (Moshav Mishmeret, IL); Assaf Natanzon (Tel Aviv, IL)
Assignee: EMC IP Holding Company LLC
G06F16/1748G06F11/1458G06F16/2365
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,437,783
App. No.
14/496,790
Filed
Sep 25, 2014
Granted
Oct 8, 2019
Kind
B1
Art Unit
2157
USPC
707/649
Abstract

In one aspect, a method includes extracting configuration files from a deduplication device, configuring a storage array based on the configuration files extracted, extracting data for a point-in-time (PIT) from the deduplication device and sending the data for the PIT extracted to the storage array. In another aspect, an apparatus includes electronic hardware circuitry configured to extract configuration files from a deduplication device, configure a storage array based on the configuration files extracted, extract data for a PIT from the deduplication device and send the data for the PIT extracted to the storage array. In a further aspect, an article includes a non-transitory computer-readable medium that stores computer-executable instructions. The instructions cause a machine to extract configuration files from a deduplication device, configure a storage array based on the configuration files extracted, extract data for a PIT from the deduplication device and send the data for the PIT extracted to the storage array.

Claims (82)

1. A method comprising:

extracting configuration files from a deduplication device, the configuration files comprising configuration data used to reconstruct a storage array, the configuration data comprising volume IDs of volumes on the storage array, sizes of the volumes and consistency group data, the consistency group data comprising a list of consistency groups protected in the deduplication storage and a list of the devices of each consistency group;

configuring the storage array based on the configuration files extracted, comprising:

setting up logical units;

setting up volumes for each logical unit;

configuring hosts to access the logical units; and

configuring a data protection appliance with a consistency group mapping between snapshots and journal files, wherein the snapshots include a file of a snapshot of at least one of the logical units for different points-in-time, and, wherein the journal files include differences between first and second ones of the snapshots of that at least one of the logical units;

extracting data for a point-in-time (PIT) from the deduplication device, wherein the PIT is between selected ones of the snapshots, the method further comprising:

identifying a snapshot of the selected ones of the snapshots that is nearest the PIT;

identifying an input/output (I/O) received before the PIT and after the snapshot nearest the PIT;

accessing one of the journal files and identifying a journal entry nearest the PIT;

generating an interim snapshot including unchanged data from the snapshot nearest the PIT and data retrieved from the one of the journal files;

sending data for the point-in-time to the storage array, the data for the PIT including the interim snapshot; and

configuring a backup policy for each of the journal files and the snapshots, the backup policy defining backup windows indicating intervals of time that designate which of the journal files and snapshots will be retained in storage and a corresponding interval of time to be stored, each of the backup windows specifying varying granularities with respect to the intervals of time, wherein each of the journal files and the snapshots are stored for a time period corresponding to a designated one of the backup windows;

wherein the backup windows include a short-term protection window, a mid-term protection window, and a long-term protection window;

wherein the short-term protection window is configured to protect snapshots and journal files allowing for point-in-time recovery;

wherein the mid-term protection window includes only snapshot files for the corresponding time interval; and

wherein the journal files and snapshots move from the short-term protection window to the long-term protection window when a time interval defined for a respective one of the windows expires.

2. The method of claim 1 , further comprising:

notifying a user point-in-time available to recover; and

receiving from the user the point-in-time to recover.

3. The method of claim 1 , wherein the deduplication device is a first deduplication device, and

further comprising backing up a second deduplication device to the first deduplication device.

4. The method of claim 2 , wherein the storage array is a first storage array, and

further comprising backing up a second storage array to the second deduplication device.

5. The method of claim 1 , wherein extracting configuration files from a deduplication device comprises extracting configuration files from a deduplication device using a data protection appliance, and

wherein configuring a storage array based on the configuration files extracted comprises configuring a storage array based on the configuration files extracted using the data protection appliance.

6. The method of claim 1 , wherein the extracting configuration files, configuring the storage array, and configuring the data protection appliance is performed at a replication site, wherein in response to a recovery operation, the data protection appliance at the replication site extracts the data for the PIT, generates the interim snapshot, and sends the data for the PIT to the storage array, the storage array configured at the replication site.

7. The method of claim 6 , further comprising backing up the configuration files, the snapshots, the journal files, and the consistency group mapping between the snapshots and journal files from a production site to the replication site prior to the recovery operation.

8. An apparatus, comprising:

electronic hardware circuitry configured to:

extract configuration files from a deduplication device, the configuration files comprising configuration data used to reconstruct a storage array, the configuration data comprising volume IDs of volumes on the storage array, sizes of the volumes and consistency group data, the consistency group data comprising a list of consistency groups protected in the deduplication storage and a list of the devices of each consistency group;

configure the storage array based on the configuration files extracted comprising:

setting up logical units;

setting up volumes for each logical unit;

configuring hosts to access the logical units; and

configuring a data protection appliance with a consistency group mapping between snapshots and journal files, wherein the snapshots include a file of a snapshot of at least one of the logical units for different points-in-time, and, wherein the journal files include differences between first and second ones of the snapshots of that at least one of the logical units;

extract data for a point-in-time (PIT) from the deduplication device, wherein the PIT is between selected ones of the snapshots, the electronic hardware circuitry further configured to:

identify a snapshot of the selected ones of the snapshots that is nearest the PIT;

identify an input/output (I/O) received before the PIT and after the snapshot nearest the PIT;

access one of the journal files and identifying a journal entry nearest the PIT;

generate an interim snapshot including unchanged data from the snapshot nearest the PIT and data retrieved from the one of the journal files; and

send data for the point-in-time to the storage array, the data for the PIT including the interim snapshot; and

configure a backup policy for the journal files and the snapshots, the backup policy defining backup windows indicating intervals of time that designate which of the journal files and snapshots will be retained in storage and a corresponding interval of time to be stored, each of the backup windows specifying varying granularities with respect to the intervals of time, wherein each of the journal files and the snapshots are stored for a time period corresponding to a designated one of the backup windows;

wherein the backup windows include a short-term protection window, a mid-term protection window, and a long-term protection window;

wherein the short-term protection window is configured to protect snapshots and journal files allowing for point-in-time recovery;

wherein the mid-term protection window includes only snapshot files for the corresponding time interval; and

wherein the journal files and snapshots move from the short-term protection window to the long-term protection window when a time interval defined for a respective one of the windows expires.

9. The apparatus of claim 8 , wherein the circuitry comprises at least one of a processor, a memory, a programmable logic device or a logic gate.

10. The apparatus of claim 8 , further comprising circuitry configured to:

notify a user point-in-time available to recover; and

receive from the user the point-in-time to recover.

11. The apparatus of claim 8 , wherein the deduplication device is a first deduplication device, and

further comprising circuitry configured to back up a second deduplication device to the first deduplication device.

12. The apparatus of claim 8 , wherein the storage array is a first storage array, and

further comprising circuitry configured to back up a second storage array to the second deduplication device.

13. An article comprising:

a non-transitory computer-readable medium that stores computer-executable instructions, the instructions causing a machine to:

extract configuration files from a deduplication device, the configuration files comprising configuration data used to reconstruct a storage array, the configuration data comprising volume IDs of volumes on the storage array, sizes of the volumes and consistency group data, the consistency group data comprising a list of consistency groups protected in the deduplication storage and a list of the devices of each consistency group;

configure the storage array based on the configuration files extracted comprising:

setting up logical units;

setting up volumes for each logical unit;

configuring hosts to access the logical units; and

configuring a data protection appliance with a consistency group mapping between snapshots and journal files, wherein the snapshots include a file of a snapshot of at least one of the logical units for different points-in-time, and, wherein the journal files include differences between first and second ones of the snapshots of that at least one of the logical units;

extract data for a point-in-time (PIT) from the deduplication device, wherein the PIT is between selected ones of the snapshots, the instructions further causing a machine to:

identify a snapshot of the selected ones of the snapshots that is nearest the PIT;

identify an input/output (I/O) received before the PIT and after the snapshot nearest the PIT;

access one of the journal files and identifying a journal entry nearest the PIT;

generate an interim snapshot including unchanged data from the snapshot nearest the PIT and data retrieved from the one of the journal files;

send data for the point-in-time to the storage array, the data for the PIT including the interim snapshot; and

configure a backup policy for the journal files and the snapshots, the backup policy defining backup windows indicating intervals of time that designate which of the journal files and snapshots will be retained in storage and a corresponding interval of time to be stored, each of the backup windows specifying varying granularities with respect to the intervals of time, wherein each of the journal files and the snapshots are stored for a time period corresponding to a designated one of the backup windows;

wherein the backup windows include a short-term protection window, a mid-term protection window, and a long-term protection window;

wherein the short-term protection window is configured to protect snapshots and journal files allowing for point-in-time recovery;

wherein the mid-term protection window includes only snapshot files for the corresponding time interval; and

wherein the journal files and snapshots move from the short-term protection window to the long-term protection window when a time interval defined for a respective one of the windows expires.

14. The article of claim 13 , further comprising instructions causing the machine to:

notify a user point-in-time available to recover; and

receive from the user the point-in-time to recover.

15. The article of claim 13 , wherein the deduplication device is a first deduplication device, and

further comprising instructions causing the machine to back up a second deduplication device to the first deduplication device.

16. The article of claim 13 , wherein the storage array is a first storage array, and

further comprising instructions causing the machine to back up a second storage array to the second deduplication device.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (051302/0528) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.); SECUREWORKS CORP.
Reel/Frame 060438/0593 →
RELEASE OF SECURITY INTEREST AT REEL 051449 FRAME 0728 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.; SECUREWORKS CORP.; EMC CORPORATION
Reel/Frame 058002/0010 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Dec 31, 2019
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.; SECUREWORKS CORP.; EMC CORPORATION
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 051449/0728 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Dec 16, 2019
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.; SECUREWORKS CORP.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 051302/0528 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2019
From: EMC CORPORATION
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 050124/0494 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2014
From: COHEN, SAAR; NATANZON, ASSAF
To: EMC CORPORATION
Reel/Frame 034060/0455 →
Cited By (1)
US 12,705,140