IP Library Granted Patent US 10,216,594
Granted Patent B2
US 10,216,594 · App. 15/424,978 · Granted Feb 26, 2019

Automated stalled process detection and recovery

Inventors: Kumar Abhijeet (Chicago, IL); Andrew D. Baptist (Mt. Pleasant, WI); Ilir Iljazi (Chicago, IL); Gregory A. Papadopoulos (Chicago, IL); Jason K. Resch (Chicago, IL)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06F11/2053G06F3/064G06F3/067G06F3/0619G06F11/1092G11C29/48G06F2201/805G06F2201/82G06F2211/1028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,216,594
App. No.
15/424,978
Granted
Feb 26, 2019
Kind
B2
Abstract

A dispersed storage network (DSN) includes multiple storage units. A processing unit included in the DSN detects a failing storage unit, and issues an error indicator to a recovery unit. The error indicator indicates the failing storage unit. To verify that the storage unit is failing, the recovery unit issues a test request to the failing storage unit. The recovery unit determines to implement a corrective action for recovery units that are determined to be actually failing, and facilitates implementing the corrective action.

Claims (59)

1. A method for use in a dispersed storage network (DSN) including a plurality of storage units, the method comprising:

detecting, by a processing unit included in the DSN, a failing storage unit;

issuing, by the processing unit, an error indicator to a recovery unit, to indicate the failing storage unit;

issuing, by the recovery unit, a test request to the failing storage unit;

determining, by the recovery unit, to implement a corrective action; and

facilitating, by the recovery unit, execution of the corrective action.

2. The method of claim 1 , wherein detecting a failing storage unit includes:

receiving an unfavorable response to an access request.

3. The method of claim 1 , wherein detecting includes:

determining that no response to an access request directed to the failing storage unit is received within a predetermined amount of time.

4. The method of claim 1 , wherein the error indicator includes:

information identifying the failing storage unit and a failure type.

5. The method of claim 4 , wherein issuing a test request includes:

generating a particular test request based on the failure type; and

sending the particular test request to the failing storage unit.

6. The method of claim 1 , wherein determining to implement a corrective action includes:

determining at least one of receiving an unfavorable response to the test request, or determining that a time period has expired without receiving a test response.

7. The method of claim 1 , wherein facilitating execution of the corrective action includes:

issuing a corrective action command to at least one of the failing storage unit or a managing unit.

8. The method of claim 1 , further comprising:

facilitating, by the recovery unit, execution of a further corrective action in response to receiving an unfavorable response to the corrective action.

9. A dispersed storage network (DSN) including a plurality of storage units, the DSN comprising:

processing unit configured to:

detect a failing storage unit;

issue an error indicator to a recovery unit, the error indicator indicate the failing storage unit;

a recovery unit configured to:

issue a test request to the failing storage unit;

determine to implement a corrective action; and

facilitate execution of the corrective action.

10. The dispersed storage network (DSN) of claim 9 , wherein the processing unit is configured to detect a failing storage unit, at least in part, by:

receiving, at the processing unit, an unfavorable response to an access request.

11. The dispersed storage network (DSN) of claim 9 , wherein the processing unit is configured to detect a failing storage unit, at least in part, by:

determining, at the processing unit, that no response to an access request directed to the failing storage unit is received within a predetermined amount of time.

12. The dispersed storage network (DSN) of claim 9 , wherein the error indicator includes:

information identifying the failing storage unit and a failure type.

13. The dispersed storage network (DSN) of claim 12 , wherein the recovery unit is configured to issue a test request, at least in part, by:

generating a particular test request based on the failure type; and

sending the particular test request to the failing storage unit.

14. The dispersed storage network (DSN) of claim 9 , wherein the recovery unit is configured to issue determine to implement a corrective action, at least in part, by:

determining at least one of receiving an unfavorable response to the test request, or determining that a time period has expired without receiving a test response.

15. The dispersed storage network (DSN) of claim 9 , wherein the recovery unit is configured to facilitate execution of the corrective action, at least in part, by:

issuing a corrective action command to at least one of the failing storage unit or a managing unit.

16. The dispersed storage network (DSN) of claim 9 , wherein the recovery unit is further configured to:

facilitate execution of a further corrective action in response to receiving an unfavorable response to the corrective action.

17. A recovery unit included in a dispersed storage network (DSN) including a plurality of storage units, the recovery unit comprising:

a processor;

a memory coupled to the processor;

a non-transitory program of instructions configured to be stored in the memory and executed by the processor, the program of instructions including:

at least one instruction to receive, from a processing unit, an error indicator indicating a failing storage unit;

at least one instruction to verify that the error indicator by issuing a test request to the failing storage unit;

at least one instruction to determine to implement a corrective action associated with the failing storage unit; and

at least one instruction to facilitate execution of the corrective action.

18. The recovery unit of claim 17 , wherein the at least one instruction to verify includes:

at least one instruction to generate a particular test request based on a failure type associated with the failing storage unit; and

at least one instruction to send the particular test request to the failing storage unit.

19. The recovery unit of claim 17 , wherein the at least one instruction to facilitate execution of the corrective action includes:

issuing a corrective action command to at least one of the failing storage unit or a managing unit.

20. The recovery unit of claim 17 , wherein the program of instructions further comprises:

the at least one instruction to facilitate execution of a further corrective action in response to receiving an unfavorable response to the corrective action.

Assignments (5)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Jun 11, 2025
From: BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT
To: PURE STORAGE, INC.
Reel/Frame 071558/0523 →
SECURITY INTEREST Recorded Aug 26, 2020
From: PURE STORAGE, INC.
To: BARCLAYS BANK PLC AS ADMINISTRATIVE AGENT
Reel/Frame 053867/0581 →
CORRECTIVE ASSIGNMENT TO CORRECT THE 9992063 AND 10334045 LISTED IN ERROR PREVIOUSLY RECORDED ON REEL 049556 FRAME 0012. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNOR HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 14, 2020
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: PURE STORAGE, INC.
Reel/Frame 052205/0705 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2019
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: PURE STORAGE, INC.
Reel/Frame 049556/0012 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2017
From: ABHIJEET, KUMAR; BAPTIST, ANDREW D.; ILJAZI, ILIR; PAPADOPOULOS, GREGORY A.; RESCH, JASON K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 041178/0731 →
Continuity (3)
Continuation In Part 15058408 · Mar 2, 2016
Provisional Application 62154886 · Apr 30, 2015
Related Publication 20170147457A1 · May 25, 2017