Performing computations during idle periods at the storage edge
A controller, for use in a storage device of a data processing system, includes a host interface, a memory interface and one or more processors. The host interface is configured to communicate over a computer network with one or more remote hosts of a data processing system. The memory interface is configured to communicate locally with a non-volatile memory of the storage device. The one or more processors are configured to manage local storage or retrieval of media objects at the non-volatile memory, and to perform additional tasks that are not associated with management of storage or retrieval of the objects.
1. A controller for use in a storage device of a data processing system, the controller comprising:
a host interface configured to communicate over a computer network with one or more remote hosts of a data processing system;
a memory interface, configured to communicate locally with a non-volatile memory of the storage device; and
one or more processors, configured to:
manage local storage or retrieval of media objects at the non-volatile memory;
identify idle periods during which at least some resources of the one or more processors are free from managing storage or retrieval of the objects; and
during the idle periods, perform additional tasks that are not associated with the non-volatile memory, wherein performing the additional tasks is initiated or resumed during the identified idle periods, and suspended outside the identified idle periods.
2. The controller according to claim 1 , wherein, in performing the additional tasks during the idle periods, the one or more processors are configured to generate data analytics.
3. The controller according to claim 2 , wherein, in generating the data analytics during the idle periods, the one or more processors are configured to generate metadata for one or more of the objects.
4. The controller according to claim 1 , wherein the one or more processors are configured to perform the additional tasks for a plurality of unstructured media objects that that are stored, or that are to be stored, in the non-volatile memory.
5. The controller according to claim 1 , wherein the one or more processors are configured to assign a first priority to management of the storage or retrieval of the objects at the non-volatile memory, and to assign a second priority, lower than the first priority, to performing of the additional tasks.
6. The controller according to claim 1 , wherein the storage device comprises a Solid State Drive (SSD), and wherein the non-volatile memory of the storage device comprises one or more Flash memory devices.
7. The controller according to claim 1 , wherein the storage device comprises a Hard Disk Drive (HDD), and wherein the non-volatile memory of the storage device comprises one or more magnetic disks.
8. The controller according to claim 1 , wherein the one or more processors comprise a single processor that is configured both to manage the local storage or retrieval of the media objects and to perform the additional tasks during the idle periods.
9. A method for use in a storage device, the method comprising:
by a host interface coupled to a storage device situated in a data processing system, communicating over a computer network with one or more remote hosts;
by a memory interface of the storage device, communicating locally with a non-volatile memory of the storage device;
managing, by one or more processors of the storage device, local storage or retrieval of media objects at the non-volatile memory;
identifying, by the one or more processors, idle periods during which at least some resources of the one or more processors are free from managing storage of the objects; and
during the idle periods, performing, by the one or more processors of the storage device, additional tasks that are not associated with the non-volatile memory, including initiating or resuming the performing of the additional tasks during the identified idle periods, and suspending the performing of the additional tasks outside the identified idle periods.
10. The method according to claim 9 , wherein performing the additional tasks during the idle periods comprises generating data analytics.
11. The method according to claim 10 , wherein generating the data analytics during the idle periods comprises generate metadata for one or more of the objects.
12. The method according to claim 9 , wherein performing the additional tasks comprises performing the additional tasks for a plurality of unstructured media objects that that are stored, or that are to be stored, in the non-volatile memory.
13. The method according to claim 9 , comprising assigning a first priority to management of the storage or retrieval of the objects at the non-volatile memory, and assigning a second priority, lower than the first priority, to performing of the additional tasks.
14. The method according to claim 9 , wherein the storage device comprises a Solid State Drive (SSD), and wherein the non-volatile memory of the storage device comprises one or more Flash memory devices.
15. The method according to claim 9 , wherein the storage device comprises a Hard Disk Drive (HDD), and wherein the non-volatile memory of the storage device comprises one or more magnetic disks.
16. The method according to claim 9 , wherein managing the local storage or retrieval of the media objects, and performing of the additional tasks, are both performed by a single processor of the storage device during the idle periods.