IP Library Granted Patent US 9,513,994
Granted Patent B2
US 9,513,994 · App. 14/387,326 · Granted Dec 6, 2016

Method and system for multi-dimensional raid

Inventor: Jeffrey S. Bonwick (Menlo Park, CA)
Assignee: EMC IP Holding Company LLC
G06F11/1076G06F3/064G06F3/0619G06F3/0689G06F11/108G06F11/1096G06F2211/1057
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,513,994
App. No.
14/387,326
Filed
Sep 23, 2014
Granted
Dec 6, 2016
Kind
B2
Art Unit
2113
USPC
714/6.24
Abstract

A method for storing data including calculating: a first set of parity values using the data, a second set of parity values using the first set of parity values, and a third set of parity values using the data, and the first set and second set of parity values. The method further includes storing a portion of the data in a grid, where the grid includes grids locations that are each associated with a physical location, where each physical location is determined using a unique combination of at least a first value determined using a first independent fault domain and a second value determined using a second independent fault domain. The method further includes storing parity values from the first set of parity values and parity values from the second set of parity values in the grid, and storing the third set of parity values in an associated parity grid.

Claims (42)

1. A non-transitory computer readable medium comprising instructions, which when executed perform a method for storing data, the method comprising:

receiving data from a client;

calculating a first set of parity values using the data;

calculating a second set of parity values using the first set of parity values;

calculating a third set of parity values using the data, the first set of parity values, and the second set of parity values;

storing a portion of the data in a grid of a plurality of grids, wherein the grid comprises a plurality of grids locations, wherein each grid location is associated with a physical location in persistent storage, wherein each physical location is determined using a unique combination of at least a first value determined using a first independent fault domain and a second value determined using a second independent fault domain;

storing parity values from the first set of parity values that correspond to the portion of the data in the grid;

storing parity values from the second set of parity values that correspond to the parity values from the first set of parity values in the grid; and

storing, in the persistent storage, each of the third set of parity values in one of a plurality of parity grids in the persistent storage, wherein the one of the plurality of parity grids is associated with the grid.

2. The non-transitory computer readable medium of claim 1 , wherein the plurality of grids and the plurality of parity grids are associated with a (Redundant Array of Independent Disks) RAID cube.

3. The non-transitory computer readable medium of claim 2 , wherein the RAID cube comprises a first dimension and a second dimension, wherein the first dimension is associated with the first independent fault domain and the second dimension is associated with the second independent fault domain.

4. The non-transitory computer readable medium of claim 3 , wherein the RAID cube further comprises a third dimension that is associated with a third independent fault domain, wherein the physical location is further determined using the third independent fault domain.

5. The non-transitory computer readable medium of claim 4 , wherein the persistent storage comprises a plurality of storage modules, wherein each of the plurality of storage modules comprises solid state memory, and wherein the first independent fault domain is the plurality of storage modules, the second independent fault domain is a plurality of channels in each of the plurality of storage modules, wherein the third independent fault domain is a plurality of NAND dies in each of the plurality of storage modules.

6. The non-transitory computer readable medium of claim 1 , wherein the first set of parity values comprises at least one selected from a group consisting of P parity values and Q parity values.

7. The non-transitory computer readable medium of claim 6 , wherein the second set of parity values comprises intersection parity values, wherein the intersection parity values are not calculated using any of the data.

8. The non-transitory computer readable medium of claim 1 , wherein the third set of parity values comprises at least one selected from a group consisting of P parity values and Q parity values.

9. The non-transitory computer readable medium of claim 1 , wherein the plurality of parity grids comprises a P Parity grid and a Q Parity grid.

10. The non-transitory computer readable medium of claim 1 , wherein the persistent storage comprises a plurality of storage modules, wherein each of the plurality of storage modules comprises solid state memory, and wherein the first independent fault domain is the plurality of storage modules and the second independent fault domain is a plurality of channels in each of the plurality of storage modules.

11. The non-transitory computer readable medium of claim 1 , wherein the persistent storage comprises a plurality of storage modules, wherein each of the plurality of storage modules comprises solid state memory, and wherein the first independent fault domain is a plurality of channels in each of the plurality of storage modules and the second independent fault domain is a plurality of NAND dies in each of the plurality of storage modules.

12. The non-transitory computer readable medium of claim 1 , wherein each of the grids comprises a plurality of rows, wherein a location of parity values from the first set of parity values are in different relative locations in at least two of the plurality of rows.

13. The non-transitory computer readable medium of claim 1 , wherein the plurality of parity grids do not store any of the plurality of data received from the client.

14. A system, comprising:

a controller;

a non-transitory computer readable medium operatively connected to the controller;

persistent storage operatively connected to the controller and comprising a plurality of storage modules, wherein each of the plurality of storage modules comprises solid state memory;

wherein the non-transitory computer readable medium comprises instructions which when executed by the controller performs a method, the method comprising:

receiving a plurality of data from a client;

calculating a first set of parity values using the plurality of data;

calculating a second set of parity values using the first set of parity values;

calculating a third set of parity values using the plurality of data, the first set of parity values, and the second set of parity values;

storing a portion of the data in a grid of a plurality of grids, wherein the grid comprises a plurality of grids locations, wherein each of the plurality of grid locations is associated with a physical location in the persistent storage, wherein each physical location is determined using a unique combination of at least a first value determined using a first independent fault domain and a second value determined using a second independent fault domain;

storing parity values from the first set of parity values that correspond to the portion of the data in the grid;

storing parity values from the second set of parity values that correspond to the parity values from the first set of parity values in the grid; and

storing, in the persistent storage, each of the third set of parity values in one of a plurality of parity grids in the persistent storage, wherein the one of the plurality of parity grids is associated with the grid.

15. The system of claim 14 , further comprising:

a field programmable gate array (FPGA) operatively connected to the controller,

wherein calculating the first set of parity values using the data comprises using the FPGA to calculate at least one of the first set of parity values.

16. The system of claim 14 , wherein the controller stores a grid geometry for the grid.

17. The system of claim 16 , wherein the grid geometry comprises a size of the grid and specifies independent fault domains associated with each dimension of the grid.

18. The system of claim 14 , wherein the controller tracks locations of parity values for the first set of parity values in the grid.

19. The system of claim 14 , wherein at least one of the plurality of storage modules comprises a NAND die.

20. The system of claim 14 , wherein the controller is configured to reconstruct a corrupted datum in the persistent storage using the first set of parity values, the second set of parity values, and the third set of parity values.

Assignments (11)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001) Recorded Apr 26, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061324/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 3, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL, L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058216/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2016
From: EMC CORPORATION
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 040203/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
MERGER Recorded Sep 10, 2016
From: DSSD, INC.
To: EMC CORPORATION
Reel/Frame 039694/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2014
From: BONWICK, JEFFREY S.
To: DSSD, INC.
Reel/Frame 033821/0546 →
Continuity (2)
Continuation 13428536 · Mar 23, 2012
Related Publication 20150095697A1 · Apr 2, 2015