Granted Patent B2

US 10,318,401 · App. 15/957,809 · Granted Jun 11, 2019

Inventors: Thomas Rothschilds (Seattle, WA); Remi Bernotavicius (Seattle, WA); Edward Brow (Boulder, CO); William Ehlhardt (Seattle, WA)

Assignee: Qumulo, Inc.

G06F11/3495G06F11/3006G06F11/3065G06F11/3419

Abstract

Claims (90)

1. A method for managing data in a file system over a network using one or more processors that execute instructions to perform actions, comprising:

instantiating a monitoring engine to perform actions including:

monitoring one or more metrics to collect data that is associated with one or more nodes that are part of the file system, wherein each node is a computer that separately provides computing resources over the network that are characterized by the one or more metrics;

determining the one or more nodes that are associated with the one or more metrics that exceed one or more trigger levels based on the monitoring;

modifying an original monitor rate associated with the one or more determined nodes, wherein the modified monitor rate is associated with a trigger time period, wherein a duration of the trigger time period is selected based on a longest time period that is associated with the one or more metrics that exceed the one or more trigger levels;

in response to an expiration of the trigger time period, restoring the modified monitor rate to the original monitor rate; and

employing a file system engine to provide one or more reports that include the data associated with the one or more metrics, wherein the one or more reports improve identifying the one or more computers having computing resources characterized by the one or metrics that exceed the one or more trigger levels during the trigger time period.

2. The method of claim 1 , wherein the monitoring engine performs actions, further comprising:

distributing the data associated with the one or more metrics and the one or more nodes to the file system engine;

modifying an original distribution rate associated with the one or more determined nodes to another distribution rate, wherein the other distribution rate is associated with another trigger time period; and

in response to an expiration of the other trigger time period, restoring the original distribution rate.

3. The method of claim 1 , wherein the data for the one or more nodes includes one or more of a lock graph, a task stack, or a backtrace.

4. The method of claim 1 , wherein the monitoring engine performs actions, further comprising:

identifying one or more tasks that are associated with a locked resource;

identifying the one or more tasks that are waiting for the locked resource;

associating the one or more tasks with one or more time values that correspond to one or more attempts to access the locked resource; and

generating a lock graph based on the one or more tasks, wherein the lock graph includes a directed graph based on the association with the one or more time values.

5. The method of claim 1 , wherein the monitoring engine performs actions, further comprising, truncating the data associated with the one or more nodes to include data that corresponds to an overlapping time period and to omit data that corresponds to one or more non-overlapping time periods.

6. The method of claim 1 , wherein the monitoring of one or more metrics to collect data further comprises, assigning a separate original monitor rate or a separate modified monitor rate to one or more of the metrics based on the one or more metrics and the one or more nodes.

7. The method of claim 1 , wherein the one or more metrics include one or more of data throughput, latency, processor utilization, disk utilization, a count of dropped network packets, a count of disk inputs over a period of time, or a count of disk outputs over a period of time.

8. A system for managing data in a file system comprising:

a network computer, comprising:

a transceiver that communicates over the network;

a memory that stores at least instructions; and

one or more processors that execute instructions that perform actions, including:

instantiating a monitoring engine to perform actions including:

monitoring one or more metrics to collect data that is associated with one or more nodes that are part of the file system, wherein each node is a computer that separately provides computing resources over the network that are characterized by the one or more metrics;

determining the one or more nodes that are associated with the one or more metrics that exceed one or more trigger levels based on the monitoring;

modifying an original monitor rate associated with the one or more determined nodes, wherein the modified monitor rate is associated with a trigger time period, wherein a duration of the trigger time period is selected based on a longest time period that is associated with the one or more metrics that exceed the one or more trigger levels;

in response to an expiration of the trigger time period, restoring the modified monitor rate to the original monitor rate; and

employing a file system engine to provide one or more reports that include the data associated with the one or more metrics, wherein the one or more reports improve identifying the one or more computers having computing resources characterized by the one or metrics that exceed the one or more trigger levels during the trigger time period; and

a client computer, comprising:

a transceiver that communicates over the network;

a memory that stores at least instructions; and

one or more processors that execute instructions that perform actions, including:

receiving, the one or more reports.

9. The system of claim 8 , wherein the monitoring engine performs actions, further comprising:

distributing the data associated with the one or more metrics and the one or more nodes to the file system engine;

modifying an original distribution rate associated with the one or more determined nodes to another distribution rate, wherein the other distribution rate is associated with another trigger time period; and

in response to an expiration of the other trigger time period, restoring the original distribution rate.

10. The system of claim 8 , wherein the data for the one or more nodes includes one or more of a lock graph, a task stack, or a backtrace.

11. The system of claim 8 , wherein the monitoring engine performs actions, further comprising:

identifying one or more tasks that are associated with a locked resource;

identifying the one or more tasks that are waiting for the locked resource;

associating the one or more tasks with one or more time values that correspond to one or more attempts to access the locked resource; and

generating a lock graph based on the one or more tasks, wherein the lock graph includes a directed graph based on the association with the one or more time values.

12. The system of claim 8 , wherein the monitoring engine performs actions, further comprising, truncating the data associated with the one or more nodes to include data that corresponds to an overlapping time period and to omit data that corresponds to one or more non-overlapping time periods.

13. The system of claim 8 , wherein the monitoring of one or more metrics to collect data further comprises, assigning a separate original monitor rate or a separate modified monitor rate to one or more of the metrics based on the one or more metrics and the one or more nodes.

14. The system of claim 8 , wherein the one or more metrics include one or more of data throughput, latency, processor utilization, disk utilization, a count of dropped network packets, a count of disk inputs over a period of time, or a count of disk outputs over a period of time.

15. A processor readable non-transitory storage media that includes instructions for managing data in a file system over a network, wherein execution of the instructions by one or more processors on one or more network computers performs actions, comprising:

instantiating a monitoring engine to perform actions including:

monitoring one or more metrics to collect data that is associated with one or more nodes that are part of the file system, wherein each node is a computer that separately provides computing resources over the network that are characterized by the one or more metrics;

determining the one or more nodes that are associated with the one or more metrics that exceed one or more trigger levels based on the monitoring;

modifying an original monitor rate associated with the one or more determined nodes, wherein the modified monitor rate is associated with a trigger time period, wherein a duration of the trigger time period is selected based on a longest time period that is associated with the one or more metrics that exceed the one or more trigger levels;

in response to an expiration of the trigger time period, restoring the modified monitor rate to the original monitor rate; and

employing a file system engine to provide one or more reports that include the data associated with the one or more metrics, wherein the one or more reports improve identifying the one or more computers having computing resources characterized by the one or metrics that exceed the one or more trigger levels during the trigger time period.

16. The media of claim 15 , wherein the monitoring engine performs actions, further comprising:

distributing the data associated with the one or more metrics and the one or more nodes to the file system engine;

modifying an original distribution rate associated with the one or more determined nodes to another distribution rate, wherein the other distribution rate is associated with another trigger time period; and

in response to an expiration of the other trigger time period, restoring the original distribution rate.

17. The media of claim 15 , wherein the data for the one or more nodes includes one or more of a lock graph, a task stack, or a backtrace.

18. The media of claim 15 , wherein the monitoring engine performs actions, further comprising:

identifying one or more tasks that are associated with a locked resource;

identifying the one or more tasks that are waiting for the locked resource;

associating the one or more tasks with one or more time values that correspond to one or more attempts to access the locked resource; and

generating a lock graph based on the one or more tasks, wherein the lock graph includes a directed graph based on the association with the one or more time values.

19. The media of claim 15 , wherein the monitoring engine performs actions, further comprising, truncating the data associated with the one or more nodes to include data that corresponds to an overlapping time period and to omit data that corresponds to one or more non-overlapping time periods.

20. The media of claim 15 , wherein the monitoring of one or more metrics to collect data further comprises, assigning a separate original monitor rate or a separate modified monitor rate to one or more of the metrics based on the one or more metrics and the one or more nodes.

21. A network computer for managing data in a file system, comprising:

a transceiver that communicates over the network;

a memory that stores at least instructions; and

one or more processors that execute instructions that perform actions, including:

instantiating a monitoring engine to perform actions including:

monitoring one or more metrics to collect data that is associated with one or more nodes that are part of the file system, wherein each node is a computer that separately provides computing resources over the network that are characterized by the one or more metrics;

determining the one or more nodes that are associated with the one or more metrics that exceed one or more trigger levels based on the monitoring;

modifying an original monitor rate associated with the one or more determined nodes, wherein the modified monitor rate is associated with a trigger time period, wherein a duration of the trigger time period is selected based on a longest time period that is associated with the one or more metrics that exceed the one or more trigger levels;

in response to an expiration of the trigger time period, restoring the modified monitor rate to the original monitor rate; and

employing a file system engine to provide one or more reports that include the data associated with the one or more metrics, wherein the one or more reports improve identifying the one or more computers having computing resources characterized by the one or metrics that exceed the one or more trigger levels during the trigger time period.

22. The network computer of claim 21 , wherein the monitoring engine performs actions, further comprising:

distributing the data associated with the one or more metrics and the one or more nodes to the file system engine;

modifying an original distribution rate associated with the one or more determined nodes to another distribution rate, wherein the other distribution rate is associated with another trigger time period; and

in response to an expiration of the other trigger time period, restoring the original distribution rate.

23. The network computer of claim 21 , wherein the data for the one or more nodes includes one or more of a lock graph, a task stack, or a backtrace.

24. The network computer of claim 21 , wherein the monitoring engine performs actions, further comprising:

identifying one or more tasks that are associated with a locked resource;

identifying the one or more tasks that are waiting for the locked resource;

associating the one or more tasks with one or more time values that correspond to one or more attempts to access the locked resource; and

generating a lock graph based on the one or more tasks, wherein the lock graph includes a directed graph based on the association with the one or more time values.

25. The network computer of claim 21 , wherein the monitoring engine performs actions, further comprising, truncating the data associated with the one or more nodes to include data that corresponds to an overlapping time period and to omit data that corresponds to one or more non-overlapping time periods.

26. The network computer of claim 21 , wherein the monitoring of one or more metrics to collect data further comprises, assigning a separate original monitor rate or a separate modified monitor rate to one or more of the metrics based on the one or more metrics and the one or more nodes.

Assignments (3)

Continuity (2)

Cited By (9)

US 12,222,903 US 12,292,853 US 12,346,290 US 12,443,559 US 12,443,568 US 12,481,625 US 12,585,563 US 12,619,582 US 12,670,081