System and method for in-SSD data processing engine selection based on stream IDs
A multi-stream memory system includes an in-device data processor including a first data processing engine and a second data processing engine, a controller processor, and a processor memory coupled to the controller processor, wherein the processor memory has stored thereon instructions that, when executed by the controller processor, cause the controller processor to perform: identifying a stream ID of an input stream, identifying the first data processing engine as being associated with the stream ID based on a stream assignment table, and applying the first data processing engine to the input stream to generate processed data.
1 . A system comprising:
a first data processing element configured to perform a first process;
a second data processing element configured to perform a second process different from the first process;
a processor; and
memory coupled to the processor and storing instructions that, when executed by the processor, cause the processor to:
identify a first parameter associated with first data;
select the first data processing element to process the first data based on the first parameter to generate processed data;
identify a physical address associated with the first parameter; and
store the processed data and an indication of the selection of the first data processing element to process the first data using the physical address,
wherein the indication of the selection of the first data processing element identifies the first process performed on the first data by the first data processing element to generate the processed data.
2 . The system of claim 1 , wherein the indication is stored in metadata associated with the processed data using the physical address.
3 . The system of claim 1 , wherein to select the first data processing element to process the first data, the instructions further cause the processor to determine that the first data processing element is associated with the first parameter based on a mapping between the first parameter and the first data processing element.
4 . The system of claim 3 , wherein the mapping indicates the physical address associated with the first parameter.
5 . The system of claim 1 , wherein the instructions further cause the processor to:
identify a second parameter associated with second data; and
select a different data processing element based on the second parameter.
6 . The system of claim 1 , wherein the instructions further cause the processor to:
identify the second data processing element associated with the first parameter; and
select the second data processing element to process the processed data.
7 . The system of claim 1 , wherein the first data processing element is configured to perform at least one of a deduplication operation, a search operation, or a graphics processing operation as the first process.
8 . A method comprising:
identifying, by one or more processors, a first parameter associated with first data;
selecting, by the one or more processors, a first data processing element from among a plurality of data processing elements configured to perform different processes, the first data processing element being selected to process the first data based on the first parameter to generate processed data;
identifying, by the one or more processors, a physical address associated with the first parameter; and
storing, by the one or more processors, the processed data and an indication of the selecting of the first data processing element to process the first data using the physical address,
wherein the indication of the selecting of the first data processing element identifies a process performed on the first data by the first data processing element to generate the processed data.
9 . The method of claim 8 , wherein the indication is stored in metadata associated with the processed data using the physical address.
10 . The method of claim 8 , wherein the selecting of the first data processing element to process the first data comprises determining that the first data processing element is associated with the first parameter based on a mapping between the first parameter and the first data processing element.
11 . The method of claim 10 , wherein the mapping indicates the physical address associated with the first parameter.
12 . The method of claim 8 , further comprising:
identifying a second parameter associated with second data; and
selecting a different data processing element from among the plurality of data processing elements based on the second parameter.
13 . The method of claim 8 , further comprising:
identifying a second data processing element from among the plurality of data processing elements associated with the first parameter; and
select the second data processing element to process the processed data.
14 . The method of claim 8 , wherein the first data processing element is configured to perform at least one of a deduplication operation, a search operation, or a graphics processing operation.
15 . A storage device comprising:
a first data processing element configured to perform a first process;
a second data processing element configured to perform a second process different from the first process; and
a storage controller configured to:
identify a first parameter associated with first data;
select the first data processing element to process the first data based on the first parameter to generate processed data;
identify a physical address associated with the first parameter; and
store the processed data and an indication of the selecting of the first data processing element to process the first data using the physical address,
wherein the indication of the selecting of the first data processing element identifies the first process performed on the first data by the first data processing element to generate the processed data.
16 . The storage device of claim 15 , wherein the indication is stored in metadata associated with the processed data using the physical address.
17 . The storage device of claim 15 , wherein to select the first data processing element to process the first data, the storage controller is configured to determine that the first data processing element is associated with the first parameter based on a mapping between the first parameter and the first data processing element.
18 . The storage device of claim 17 , wherein the mapping indicates the physical address associated with the first parameter.
19 . The storage device of claim 15 , wherein the storage controller is further configured to:
identify a second parameter associated with second data; and
select a different data processing element based on the second parameter.
20 . The storage device of claim 15 , wherein the storage controller is further configured to:
identify the second data processing element associated with the first parameter; and
select the second data processing element to process the processed data.