IP Library Patent Application 16134703
Patent Application
App. No. 16/134,703

MIGRATING DATA THAT IS FREQUENTLY ACCESSED TOGETHER IN A DISTRIBUTED STORAGE SYSTEM

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/134,703
Abstract

A method for a dispersed storage network (DSN) begins by processing a plurality of data access requests in accordance with a dispersed storage network (DSN) memory activation optimization approach to access a plurality of dispersed storage (DS) units sets where at least one DS unit set is inactive, identifying two or more data objects stored in at least two DS unit sets of the plurality of DS unit sets that are associated with favorably comparing access profiles, determining whether to migrate the at least some of the two or more data objects from the first DS unit set to the second DS unit set based on an estimated DSN memory performance change, and facilitating migration of the at least some (smaller) of the two or more data objects from the first DS unit set to the second DS unit set.

Claims (41)

1 . A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

processing a plurality of data access requests in accordance with a dispersed storage network (DSN) memory activation optimization approach to access a plurality of dispersed storage (DS) units sets where at least one DS unit set is inactive;

identifying two or more data objects stored in at least two DS unit sets of the plurality of DS unit sets that are associated with favorably comparing access profiles;

determining an estimated DSN memory performance change associated with migrating at least some of the two or more data objects from a first DS unit set to a second DS unit set;

determining whether to migrate the at least some of the two or more data objects from the first DS unit set to the second DS unit set based on the estimated DSN memory performance change; and

when migrating, facilitating migration of the at least some of the two or more data objects from the first DS unit set to the second DS unit set.

2 . The method of claim 1 further comprises:

executing a received access request immediately when a corresponding DS unit set is active;

queuing the received access request in a request queue when the corresponding DS unit set is inactive;

issuing an activation status change request to a DS unit set to activate or deactivate the DS unit set based on the DSN memory activation optimization approach; and

when activating a previously inactive DS unit set, processing saved access requests from the request queue corresponding to the DS unit set.

3 . The method of claim 1 , wherein the dispersed storage network (DSN) memory activation optimization approach includes DSN memory power management.

4 . The method of claim 1 , wherein the identifying two or more data objects includes determining access profiles and comparing the access profiles.

5 . The method of claim 4 , wherein the determining of the access profiles includes at least one of: accessing historical records, monitoring data access requests, interpreting an activation schedule, obtaining a historical activation record, or identifying frequency of access.

6 . The method of claim 4 , wherein the comparing includes correlating access profiles.

7 . The method of claim 6 , wherein the correlating access profiles includes one or more of: correlating similar access time frames or correlating similar requesting entities for a common data object.

8 . The method of claim 7 , wherein the determining is in accordance with the access profiles and one or more of: estimated average wait time with regards to a DS unit set activation scheduling, estimated latency, estimated performance or an estimated power consumption.

9 . The method of claim 1 , wherein the determining whether to migrate includes when the estimated DSN memory performance change compares favorably to a performance threshold.

10 . The method of claim 9 , wherein the estimated DSN memory performance change compares favorably to a performance threshold includes one of: lowered access latency or lower power consumption.

11 . The method of claim 1 , wherein the two or more data objects include encoded data slices, and when the facilitating includes activating both DS unit sets, retrieving respective ones of the encoded data slices from the first DS unit set, storing these encoded data slices in the second DS unit set, and deleting these encoded data slices from the first DS unit set.

12 . The method of claim 1 , wherein the two or more data objects include encoded data slices, and wherein the facilitating includes migration by at least one of issuing a migration request to the first DS unit set to transfer respective ones of the encoded data slices to the second DS unit set, or issuing a migration request to the second DS unit set to retrieve these encoded data slices from the first DS unit set.

13 . The method of claim 1 further comprises modifying an activation schedule based on confirmation of migration of the data objects.

14 . The method of claim 1 , wherein the activation schedule is modified to further limit activation of one DS unit set.

15 . The method of claim 1 , wherein a smallest of the two or more data objects is selected for migration.

16 . The method of claim 1 further comprises, when the two or more data objects are migrated, updating to a new object name in an index or metadata database which references it.

17 . A computing device of a group of computing devices of a dispersed storage network (DSN), the computing device comprises:

an interface;

a local memory; and

a processing module operably coupled to the interface and the local memory, wherein the processing module functions to:

process a plurality of data access requests in accordance with a dispersed storage network (DSN) memory activation optimization approach to access a plurality of dispersed storage (DS) units sets where at least one DS unit set is inactive;

identify two or more data objects stored in at least two DS unit sets of the plurality of DS unit sets that are associated with favorably comparing access profiles;

determine an estimated DSN memory performance change associated with migrating at least some of the two or more data objects from a first DS unit set to a second DS unit set;

determine whether to migrate the at least some of the two or more data objects from the first DS unit set to the second DS unit set based on the estimated DSN memory performance change; and

when migrating, facilitating migration of the at least some of the two or more data objects from the first DS unit set to the second DS unit set.

18 . The computing device of claim 17 , wherein the processing module further functions to:

execute a received access request immediately when a corresponding DS unit set is active;

queue the received access request in a request queue when the corresponding DS unit set is inactive;

issue an activation status change request to a DS unit set to activate or deactivate the DS unit set based on the DSN memory activation optimization approach; and

when activating a previously inactive DS unit set, processing saved access requests from the request queue corresponding to the DS unit set.

19 . The computing device of claim 17 , wherein the determine an estimated DSN memory performance is in accordance with access profiles and one or more of: estimated average wait time with regards to a DS unit set activation scheduling, estimated latency, estimated performance or an estimated power consumption.

20 . The computing device of claim 17 , wherein a smallest of the two or more data objects is selected for migration.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2019
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: PURE STORAGE, INC.
Reel/Frame 050451/0549 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNMENT DOCUMENT BY ADDING THE APPLICATION'S IDENTIFYING INFORMATION PREVIOUSLY RECORDED ON REEL 046932 FRAME 0905. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 12, 2018
From: VOLVOVSKI, ILYA; GLADWIN, S. CHRISTOPHER; GRUBE, GARY W.; MARKISON, TIMOTHY W.; RESCH, JASON K.; SHIRLEY, THOMAS F., JR.; DHUSE, GREG R.; MOTWANI, MANISH; BAPTIST, ANDREW D.; LEGGETTE, WESLEY B.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 047649/0813 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2018
From: VOLVOVSKI, ILYA; GLADWIN, S. CHRISTOPHER; GRUBE, GARY W.; MARKISON, TIMOTHY W.; RESCH, JASON K.; SHIRLEY, THOMAS F., JR.; DHUSE, GREG R.; MOTWANI, MANISH; BAPTIST, ANDREW D.; LEGGETTE, WESLEY B.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 046932/0905 →