IP Library Granted Patent US 10,248,506
Granted Patent B2
US 10,248,506 · App. 15/219,741 · Granted Apr 2, 2019

Storing data and associated metadata in a dispersed storage network

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,248,506
App. No.
15/219,741
Granted
Apr 2, 2019
Kind
B2
Abstract

A method begins by a processing module generating metadata for a data object. The method continues by a first disperse storage error encoding the metadata to produce a set of metadata slices. The method continues by partitioning the data to produce a plurality of data segments. The method continues by a second disperse storage error encoding the plurality of data segments to produce a plurality of sets of encoded data slices. The method continues by applying a distributed agreement protocol function to a data object identifier for the data object to produce ranked scoring information with regards to a plurality of storage sets. The method continues by selecting a storage set of the plurality of storage sets based on the ranked scoring information. The method continues by facilitating storage of the set of metadata slices and the plurality of sets of encoded data slices in the selected storage set.

Claims (29)

1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

generating metadata for a data object;

first disperse storage error encoding the metadata to produce a set of metadata slices, wherein the first disperse storage error encoding includes utilizing first dispersal parameters to store metadata, the first dispersal parameters including a decode threshold of 1;

partitioning the data object to produce a plurality of data segments;

first disperse storage error encoding at least a first data segment of the plurality of data segments to produce a set of data slices, wherein the first disperse storage error encoding includes utilizing the first dispersal parameters of the metadata, the first dispersal parameters including a decode threshold of 1;

second disperse storage error encoding additional data segments of the plurality of data segments to produce a plurality of sets of encoded data slices, wherein the additional data segments do not include the at least a first data segment and wherein the second disperse storage error encoding includes utilizing second dispersal parameters, the second dispersal parameters different from the first dispersal parameters and including a decode threshold greater than 1; and

facilitating storage of the set of metadata slices and the plurality of sets of encoded data slices in one or more storage units of the DSN; and

wherein subsequent accessing of the metadata slices reproduces the metadata and the first data segment of the data object, making the first data segment of the data object available for use by the one or more computing devices while continuing to retrieve the additional data segments from the DSN.

2. The method of claim 1 , wherein the first disperse storage error encoding includes utilizing the first dispersal parameters to store a copy of the metadata in each storage unit.

3. The method of claim 2 , wherein the first dispersal parameters to store metadata in each storage unit further include an information dispersal algorithm threshold of width 1 .

4. The method of claim 1 , wherein the partitioning is in accordance with a data segmentation approach.

5. The method of claim 4 , wherein the data segmentation approach includes any of: fixed size, ramping up size, or ramping down size.

6. The method of claim 1 further comprising, for each storage unit of the selected storage set, issuing a write slice request to the storage unit, where the write slice request includes an associated metadata slice of the set of metadata slices and a plurality of associated encoded data slices of each set of encoded data slices.

7. The method of claim 6 , wherein the plurality of associated encoded data slices of each set of encoded data slices includes a common pillar.

8. A computing device of a group of computing devices of a dispersed storage network (DSN), the computing device comprises:

an interface;

a local memory; and

a processing module operably coupled to the interface and the local memory, wherein the processing module functions to:

generate metadata for a data object;

first disperse storage error encode the metadata to produce a set of metadata slices, wherein the first disperse storage error encode includes utilizing first dispersal parameters to store metadata, the first dispersal parameters including a decode threshold of 1;

partition the data object to produce a plurality of data segments;

first disperse storage error encode at least a first data segment of the plurality of data segments to produce a set of data slices, wherein the first disperse storage error encoding includes utilizing the first dispersal parameters of the metadata, the first dispersal parameters including a decode threshold of 1;

second disperse storage error encode additional data segments of the plurality of data segments to produce a plurality of sets of encoded data slices, wherein the additional data segments do not include the at least a first data segment and wherein the second disperse storage error encoding includes utilizing second dispersal parameters, the second dispersal parameters different from the first dispersal parameters and including a decode threshold greater than 1; and

facilitate storage of the set of metadata slices and the plurality of sets of encoded data slices in one or more storage units of the DSN; and

wherein subsequent accessing of the metadata slices reproduces the metadata and the first data segment of the data object, making the first data segment of the data object available for use by the computing device while continuing to retrieve the additional data segments from the DSN.

9. The computing device of claim 8 , wherein the first dispersal parameters to store metadata in each storage unit further include an information dispersal algorithm threshold of width 1 .

10. The computing device of claim 8 , wherein the partitioning is in accordance with a data segmentation approach.

11. The computing device of claim 10 , wherein the data segmentation approach includes any of: fixed size, ramping up size, or ramping down size.

12. The computing device of claim 8 further comprising, for each storage unit of the selected storage set, issuing a write slice request to the storage unit, where the write slice request includes an associated metadata slice of the set of metadata slices and a plurality of associated encoded data slices of each set of encoded data slices.

Assignments (5)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Jun 11, 2025
From: BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT
To: PURE STORAGE, INC.
Reel/Frame 071558/0523 →
SECURITY INTEREST Recorded Aug 26, 2020
From: PURE STORAGE, INC.
To: BARCLAYS BANK PLC AS ADMINISTRATIVE AGENT
Reel/Frame 053867/0581 →
CORRECTIVE ASSIGNMENT TO CORRECT THE 9992063 AND 10334045 LISTED IN ERROR PREVIOUSLY RECORDED ON REEL 049556 FRAME 0012. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNOR HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 14, 2020
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: PURE STORAGE, INC.
Reel/Frame 052205/0705 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2019
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: PURE STORAGE, INC.
Reel/Frame 049556/0012 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2016
From: HORAN, SCOTT M.; LEGGETTE, WESLEY B.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 039259/0877 →