Granted Patent B2

US 11,513,870 · App. 16/888,302 · Granted Nov 29, 2022

Inventors: Yuan Luo (Shanghai, CN); Jia Zhuo (Shanghai, CN)

Assignee: EMC IP HOLDING COMPANY LLC

G06F9/542G06F9/4856G06F9/5088

Abstract

Claims (75)

1. A method, comprising:

based on a type of a predetermined task that is to be executed on a data object in an application node, determining, in the data object by a system comprising a processor, an address range of a group of objects on which the predetermined task is to be executed;

executing the predetermined task on the group of objects in an order of addresses of the group of objects during a predetermined period that is based on a data amount of the group of objects;

creating a progress indicator for indicating an address of an object that is currently being processed in the group of objects; and

managing the predetermined task based on the progress indicator;

wherein managing the predetermined task based on the progress indicator comprises:

in accordance with determining that the predetermined period ends before the predetermined task is completed,

dividing a portion of the group of objects that are not yet processed into at least a first portion and a second portion, and

executing the predetermined task on the first portion and the second portion respectively.

2. The method of claim 1 , wherein managing the predetermined task based on the progress indicator further comprises:

restarting the application node in accordance with determining that the application node fails; and

continuing an execution of the predetermined task based on the progress indicator.

3. The method of claim 1 , wherein dividing the portion of the group of objects that are not yet processed into at least the first portion and the second portion comprises:

determining an unprocessed address range of the portion of the group of objects that are not yet processed; and

dividing the unprocessed address range into at least the first portion and the second portion.

4. The method of claim 1 , wherein executing the predetermined task on the first portion and the second portion respectively comprises:

creating the progress indicator to indicate an address of an object that is currently being processed in the first portion; and

executing the predetermined task on the first portion based on the progress indicator.

5. The method of claim 1 , wherein determining, in the data object, the address range of the group of objects on which the predetermined task is to be executed based on the type of the predetermined task that is to be executed on the data object comprises:

in accordance with determining that the type of the predetermined task is a traversing task, obtaining an index of a hierarchy structure describing the data object, the traversing task representing that the predetermined task is to be executed on all objects in the data object; and

determining the address range based on the index.

6. The method of claim 1 , wherein determining, in the data object, the address range of the group of objects on which the predetermined task is to be executed based on the type of the predetermined task that is to be executed on the data object comprises:

in accordance with determining that the type of the predetermined task is an incremental task, obtaining a group of changed objects in the data object, the incremental task representing that the predetermined task is to be executed on the group of changed objects in the data object; and

determining the address range based on the group of changed objects.

7. The method of claim 1 , wherein determining, in the data object, the address range of the group of objects on which the predetermined task is to be executed based on the type of the predetermined task that is to be executed on the data object comprises:

in accordance with determining that the type of the predetermined task is a file task, obtaining a size of the data object, the file task representing that the data object is a file and the predetermined task is to be executed on the file; and

determining the address range based on the size of the file.

8. The method of claim 1 , wherein the application node comprises a plurality of processing resources, and the predetermined task is executed by one or more processing resources in the plurality of processing resources.

9. An electronic device, comprising:

at least one processor; and

a memory coupled to the at least one processor, the memory having instructions stored thereon, the instructions, when executed by the at least one processor, causing the electronic device to implement acts for managing a predetermined task in an application node, the acts comprising:

based on a type of the predetermined task that is to be executed on a data object in the application node, determining in the data object an address range of a group of objects on which the predetermined task is to be executed;

executing, using a first processing resource, the predetermined task on the group of objects in an order of addresses of the group of objects during a predetermined period that is based on a data amount of the group of objects;

creating a progress indicator for indicating an address of an object that is currently being processed in the group of objects; and

managing the predetermined task based on the progress indicator;

wherein managing the predetermined task based on the progress indicator comprises:

in accordance with determining that the predetermined period has ended before the predetermined task is completed, dividing a portion of the group of objects that are not yet processed into at least a first portion and a second portion; and

executing the predetermined task on the first portion and the second portion, using the first processing resource and a second processing resource, respectively, wherein the second processing resource is a different processing resource than the first processing resource.

10. The electronic device of claim 9 , wherein managing the predetermined task based on the progress indicator further comprises:

restarting the application node in accordance with determining that the application node fails; and

continuing an execution of the predetermined task based on the progress indicator.

11. The electronic device of claim 9 , wherein dividing the portion of the group of objects that are not yet processed into at least the first portion and the second portion comprises:

determining an unprocessed address range of the portion of the group of objects that are not yet processed; and

dividing the unprocessed address range into at least the first portion and the second portion.

12. The electronic device of claim 9 , wherein executing the predetermined task on the first portion and the second portion, using the first processing resource and the second processing resource, respectively comprises:

creating the progress indicator for indicating an address of an object that is currently being processed in the first portion; and

executing the predetermined task on the first portion based on the progress indicator.

13. The electronic device of claim 9 , wherein determining, in the data object, the address range of the group of objects on which the predetermined task is to be executed based on the type of the predetermined task that is to be executed on the data object comprises:

in accordance with determining that the type of the predetermined task is a traversing task, obtaining an index of a hierarchy structure describing the data object, the traversing task representing that the predetermined task is to be executed on all objects in the data object; and

determining the address range based on the index.

14. The electronic device of claim 9 , wherein determining, in the data object, the address range of the group of objects on which the predetermined task is to be executed based on the type of the predetermined task that is to be executed on the data object comprises:

in accordance with determining that the type of the predetermined task is an incremental task, obtaining a group of changed objects in the data object, the incremental task representing that the predetermined task is to be executed on the group of changed objects in the data object; and

determining the address range based on the group of changed objects.

15. The electronic device of claim 9 , wherein determining, in the data object, the address range of the group of objects on which the predetermined task is to be executed based on the type of the predetermined task that is to be executed on the data object comprises:

in accordance with determining that the type of the predetermined task is a file task, obtaining a size of the data object, the file task representing that the data object is a file and the predetermined task is to be executed on the file; and

determining the address range based on the size of the file.

16. The electronic device of claim 9 , wherein the application node comprises a plurality of processing resources, and the predetermined task is executed by one or more processing resources in the plurality of processing resources.

17. A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processor of an electronic device, facilitate performance of operations, comprising:

based on a type of a predetermined task that is to be executed on a data object in an application node, determining in the data object an address range of a group of objects on which the predetermined task is to be executed, wherein the predetermined task comprises application of removing noise from an image of the data object;

executing, using a first processing resource, the predetermined task on the group of objects in an order of addresses of the objects of the group during a predetermined period;

creating a progress indicator for indicating an address of an object that is currently being processed in the group of objects; and

managing the predetermined task based on the progress indicator;

wherein managing the predetermined task based on the progress indicator comprises:

determining that the predetermined period ends before the predetermined task is completed,

dividing a portion of the group of objects that are not yet processed into at least a first portion and a second portion; and

executing the predetermined task on the first portion and the second portion, using the first processing resource and a second processing resource, respectively, wherein the second processing resource is a different processing resource than the first processing resource.

18. The non-transitory machine readable medium of claim 17 , wherein the predetermined task comprises at least one of:

synchronizing the data object from the application node to another application node; and

processing the data object and transmitting a result of processing the data object to the another application node.

19. The non-transitory machine readable medium of claim 17 , wherein managing the predetermined task based on the progress indicator further comprises:

restarting the application node in accordance with determining that the application node has failed; and

continuing an execution of the predetermined task based on the progress indicator.

20. The non-transitory machine readable medium of claim 17 , wherein dividing the portion of the group of objects that are not yet processed into at least the first portion and the second portion comprises:

determining an unprocessed address range of the portion of the group of objects that are not yet processed; and

dividing the unprocessed address range into at least the first portion and the second portion.

Assignments (9)