Embedded Machine Learning for Storage Devices
Methods are provided for tactically deploying machine learning operations within existing storage devices without additional capital investment. Machine learning operations can be processed within a SoC of a storage device as embedded software. Storage device designed to utilize machine learning methods within existing configurations can include a non-volatile memory for storing data and executable instructions and a processor to conduct a variety of steps. The steps can include executing a plurality of applications stored in the non-volatile memory, and receiving a request for data, including measurements, from at least one of the plurality of applications. The steps can further determine if the requested data is suitable for substitution by an inference and subsequently select at least one machine learning model for generating a suitable inference.
1 . A storage device, comprising:
a Non-Volatile Memory (NVM) for storing data and executable instructions; and
a processor communicatively coupled to the NVM, the processor being configured to direct the storage device to:
execute an application stored in the NVM;
receive a request for data from an application;
determine if the requested data is suitable for substitution by an inference;
select at least one machine learning model for generating a suitable inference;
generate an input vector associated with the selected at least one machine learning model;
process the input vector into inference data via the at least one selected machine learning model; and
pass the processed inference data to the requesting application.
2 . The storage device of claim 1 , wherein the processor forms part of a System on a Chip (SoC).
3 . The storage device of claim 1 , wherein the requested data is a measurement associated with the storage device.
4 . The storage device of claim 3 , wherein the determination of suitability is determined by comparing the time required to complete a storage device measurement and the time required to generate inference data.
5 . The storage device of claim 4 , wherein the generation of inference data is selected when the time required to generate the inference data is smaller than the time required to perform the storage device measurement.
6 . The storage device of claim 5 , wherein the determination of substituting drive measurements for inference data is based on at least the available processing time, the computational requirements of the measurement, or the computational resources currently available.
7 . The storage device of claim 1 , wherein the machine learning model is formatted into embedded source code.
8 . The storage device of claim 1 , wherein the input vector is generated based on contract data source code.
9 . The storage device of claim 8 , wherein the contract data source code is associated with the machine learning model.
10 . The storage device of claim 1 , wherein the machine learning model is trained from historical data.
11 . The storage device of claim 1 , wherein the machine learning model is statically trained prior to deployment.
12 . The storage device of claim 1 , wherein prior to passing the processed inference data to the application, the processor is further configured to direct the storage device to verify the inference data.
13 . The storage device of claim 12 , wherein the verification of the inference data comprises comparing the inference data to at least one threshold.
14 . The storage device of claim 13 , wherein the at least one threshold is pre-configured.
15 . The storage device of claim 13 , wherein the at least one threshold is dynamically configured.
16 . The storage device of claim 13 , wherein, in response of the inference data exceeding at least one threshold, the processor is further configured to direct the storage device to generate the requested data through non-machine learning-based methods.
17 . A method for generating machine-learning based inferences within a storage device, comprising:
receiving a request for data from a plurality of applications;
determining if the requested data is suitable for substitution by an inference;
selecting a machine-learning model to generate a suitable inference;
providing input data formatted to the selected machine learning model;
processing the input data through the machine-learning model to generate an inference;
verifying the inference; and
passing the verified inference to the requesting plurality of applications.
18 . The method of claim 17 , wherein the requested data is a measurement associated with the storage device.
19 . The method of claim 18 , wherein the measurement is associated with multiple properties of the storage device.
20 . A storage device, comprising:
a Non-Volatile Memory (NVM) for storing data and executable instructions; and
a processor communicatively coupled to the NVM, the processor being configured to direct the storage device to:
receive a request for processing a plurality of steps;
determine if one or more of the requested plurality of steps is suitable for substitution by an inference;
provide input data from one or more steps to a machine learning model;
process the input data through the machine learning model to generate an inference; and
pass the inference as an input to a subsequent step in the plurality of steps.