IP Library Granted Patent US 8,364,917
Granted Patent B2
US 8,364,917 · App. 13/437,784 · Granted Jan 29, 2013

Replication of deduplicated storage system

Inventors: Allan J. Bricker (Sunnyvale, CA); Richard Johnsson (Palo Alto, CA); Greg Wade (San Jose, CA)
Assignee: EMC Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,364,917
App. No.
13/437,784
Filed
Apr 2, 2012
Granted
Jan 29, 2013
Kind
B2
Art Unit
2186
USPC
711/162
Abstract

A method for replicating a deduplicated storage system is disclosed. A stream of data is stored on an originator deduplicating system by storing a plurality of deduplicated segments and information on how to reconstruct the stream of data. The originator deduplicating system is replicated on a replica system by sending a copy of the plurality of deduplicated segments and information on how to reconstruct the stream of data to the replica system. A first portion of the deduplicated segments stored on the originator deduplicating system that is corrupted is identified. A copy of the first portion of the deduplicated segments is requested to be sent by the replica system to the originator deduplicating system.

Claims (35)

1. A method for replicating an originator deduplicating storage system, comprising:

storing a stream of data on an originator deduplicating storage system by storing a plurality of deduplicated segments and information on how to reconstruct the stream of data;

replicating the originator deduplicating storage system on a replica system by sending a copy of the plurality of deduplicated segments and information on how to reconstruct the stream of data to the replica system; and

identifying a first portion of the deduplicated segments stored on the originator deduplicating storage system that is corrupted and requesting a copy of the first portion of the deduplicated segments to be sent by the replica system to the originator deduplicating storage system,

wherein identifying comprises performing internal consistency checks.

2. The method of claim 1 , wherein the first portion of the deduplicated segments that is corrupted comprises deduplicated segments that fail to represent a corresponding portion of the stream of data.

3. The method of claim 1 , wherein the first portion of the deduplicated segments that is corrupted corresponds to a container, and wherein the container comprises a metadata section and one or more data sections.

4. The method of claim 1 , wherein identifying comprises checking a calculated checksum against a stored checksum.

5. The method of claim 1 , further comprising:

receiving a request for a copy of a second portion of the deduplicated segments from the replica system, wherein the second portion of the deduplicated segments is identified by the replica system as being corrupted on the replica system; and

sending the copy of the second portion of the deduplicated segments to the replica system.

6. An originator deduplicating storage system, comprising:

a processor configured to:

store a stream of data on the originator deduplicating storage system by storing a plurality of deduplicated segments and information on how to reconstruct the stream of data;

send a copy of the plurality of deduplicated segments and information on how to reconstruct the stream of data to a replica system replicating the originator deduplicating storage system; and

identify a first portion of the deduplicated segments stored on the originator deduplicating storage system that is corrupted and request a copy of the first portion of the deduplicated segments to be sent by the replica system to the originator deduplicating storage system; and

a memory coupled to the processor and configured to provide the processor with instructions,

wherein identifying comprises performing internal consistency checks.

7. The system of claim 6 , wherein the first portion of the deduplicated segments that is corrupted comprises deduplicated segments that fail to represent a corresponding portion of the stream of data.

8. The system of claim 6 , wherein the first portion of the deduplicated segments that is corrupted corresponds to a container, and wherein the container comprises a metadata section and one or more data sections.

9. The system of claim 6 , wherein identifying comprises checking a calculated checksum against a stored checksum.

10. The system of claim 6 , wherein the processor is further configured to:

receive a request for a copy of a second portion of the deduplicated segments from the replica system, wherein the second portion of the deduplicated segments is identified by the replica system as being corrupted on the replica system; and

send the copy of the second portion of the deduplicated segments to the replica system.

11. A computer program product for replicating a deduplicating storage system, the computer program product being embodied in a non-transitory computer readable medium and comprising computer instructions for:

storing a stream of data on an originator deduplicating storage system by storing a plurality of deduplicated segments and information on how to reconstruct the stream of data;

replicating the originator deduplicating storage system on a replica system by sending a copy of the plurality of deduplicated segments and information on how to reconstruct the stream of data to the replica system; and

identifying a first portion of the deduplicated segments stored on the originator deduplicating storage system that is corrupted and requesting a copy of the first portion of the deduplicated segments to be sent by the replica system to the originator deduplicating storage system,

wherein identifying comprises performing internal consistency checks.

12. The computer program product of claim 11 , wherein the first portion of the deduplicated segments that is corrupted comprises deduplicated segments that fail to represent a corresponding portion of the stream of data.

13. The computer program product of claim 11 , wherein the first portion of the deduplicated segments that is corrupted corresponds to a container, and wherein the container comprises a metadata section and one or more data sections.

14. The computer program product of claim 11 , wherein identifying comprises checking a calculated checksum against a stored checksum.

15. The computer program product of claim 11 , further comprising computer instructions for:

receiving a request for a copy of a second portion of the deduplicated segments from the replica system, wherein the second portion of the deduplicated segments is identified by the replica system as being corrupted on the replica system; and

sending the copy of the second portion of the deduplicated segments to the replica system.

Assignments (13)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001) Recorded Apr 26, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061324/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 3, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL, L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058216/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2016
From: EMC CORPORATION
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 040203/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2012
From: BRICKER, ALLAN J.; JOHNSSON, RICHARD; WADE, GREG
To: DATA DOMAIN, INC.
Reel/Frame 028149/0129 →
CONVERSION Recorded May 3, 2012
From: DATA DOMAIN, INC.
To: DATA DOMAIN LLC
Reel/Frame 028149/0259 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2012
From: DATA DOMAIN HOLDING, INC.
To: EMC CORPORATION
Reel/Frame 028149/0188 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2012
From: DATA DOMAIN LLC
To: DATA DOMAIN HOLDING, INC.
Reel/Frame 028149/0180 →
Continuity (4)
Continuation 13216558 · Aug 24, 2011
Continuation 12460766 · Jul 24, 2009
Continuation 11237628 · Sep 27, 2005
Related Publication 20120191931A1 · Jul 26, 2012