Data stream processing method, storage control node, and nonvolatile readable storage medium
View Patent ↗A data stream processing method, a storage control node, and a nonvolatile readable storage medium are provided. The storage control node includes a first Data Processing Unit (DPU) and a second DPU. The method includes: the first DPU receives an Input/Output interface (I/O) request, performs protocol offloading on the I/O request to obtain a data message, and stores the data message in a memory; and the second DPU acquires the data message from the memory and performs data processing on the acquired data message.
1 . A data stream processing method, wherein a storage control node comprises a first Data Processing Unit (DPU) and a second DPU, and the data stream processing method comprises:
receiving, by the first DPU, an Input/Output interface (I/O) request, performing, by the first DPU, protocol offloading on the I/O request to obtain a data message, and storing, by the first DPU, the data message in a memory; and
acquiring, by the second DPU, the data message from the memory and performing, by the second DPU, data processing on the acquired data message, wherein
storing, by the first DPU, the data message in the memory comprises:
determining, by the first DPU, a type of data contained in the data message, and storing the data message in a corresponding memory according to the type of the data contained in the data message.
2 . The data stream processing method according to claim 1 , wherein storing, by the first DPU, the data message in the memory comprises:
storing, by the first DPU, the data message in the memory through a Peer-to-Peer (P2P) Direct Memory Access (DMA).
3 . The data stream processing method according to claim 1 , wherein acquiring, by the second DPU, the data message from the memory and performing, by the second DPU, the data processing on the acquired data message comprises:
performing, by the second DPU, hardware acceleration on the data processing in a hardware manner by using a built-in data stream acceleration engine.
4 . The data stream processing method according to claim 1 , wherein storing, by the first DPU, the data message in the corresponding memory according to the type of the data contained in the data message comprises:
selecting, by the first DPU according to storage reliability requirement corresponding to the type of the data contained in the data message, to store the data message in a Dynamic Random Access Memory (DRAM) or a Storage Class Memory (SCM), wherein storage reliability of the SCM is higher than storage reliability of the DRAM, and the memory comprises the DRAM or the SCM.
5 . The data stream processing method according to claim 1 , wherein determining, by the first DPU, the type of data contained in the data message comprises:
performing, by the first DPU, data fingerprint calculation on the data message to obtain a data fingerprint of the data message; and
determining, by the first DPU according to the data fingerprint, the type of the data contained in the data message.
6 . The data stream processing method according to claim 1 , wherein storing, by the first DPU, the data message in the memory comprises:
storing, by the first DPU, the data message in the memory through a high-speed interconnection bus.
7 . The data stream processing method according to claim 6 , wherein acquiring, by the second DPU, the data message from the memory and performing, by the second DPU, the data processing on the acquired data message comprises:
acquiring, by the second DPU, the data message from the memory through the high-speed interconnection bus, and performing, by the second DPU, at least one of erasure processing, encryption processing, compression processing, deduplication processing, and data consistency protection processing on the acquired data message.
8 . The data stream processing method according to claim 7 , wherein performing the compression processing on the acquired data message comprises:
performing, by the second DPU, the data compression by using a built-in acceleration module.
9 . The data stream processing method according to claim 7 , wherein performing the erasure processing on the acquired data message comprises:
performing, by the second DPU, data erasure by using a built-in acceleration module.
10 . The data stream processing method according to claim 7 , wherein performing, by the second DPU, at least one of the erasure processing, the encryption processing, the compression processing, the deduplication processing, and the data consistency protection processing on the acquired data message comprises:
performing the erasure processing, the encryption processing, the compression processing, the deduplication processing, and the data consistency protection processing by using one same second DPU.
11 . The data stream processing method according to claim 7 , wherein performing, by the second DPU, at least one of the erasure processing, the encryption processing, the compression processing, the deduplication processing, and the data consistency protection processing on the acquired data message comprises:
performing the encryption processing and the compression processing by using one same second DPU; and
performing the erasure processing, the deduplication processing, and the data consistency protection processing by using another second DPU.
12 . The data stream processing method according to claim 7 , wherein performing, by the second DPU, at least one of the erasure processing, the encryption processing, the compression processing, the deduplication processing, and the data consistency protection processing on the acquired data message comprises:
performing the erasure processing, the encryption processing, the compression processing, the deduplication processing, and the data consistency protection processing by respectively using different second DPUs.
13 . The data stream processing method according to claim 1 , further comprising:
performing, by a Central Processing Unit (CPU) in the storage control node, data forwarding control and storage management.
14 . The data stream processing method according to claim 1 , wherein performing, by the first DPU, the protocol offloading on the I/O request to obtain the data message comprises:
performing, by the first DPU, operations comprising at least one of unpacking, parsing and verification on a data packet corresponding to the I/O request so as to obtain the data message.
15 . A storage control node, comprising a first Data Processing Unit (DPU) and a second DPU, wherein
the first DPU is configured to receive an Input/Output interface (I/O) request, perform protocol offloading on the I/O request to obtain a data message, and store the data message in a memory;
the second DPU is configured to acquire the data message from the memory and perform data processing on the acquired data message; and
the first DPU is configured to determine a type of data contained in the data message, and store the data message in a corresponding memory according to the type of the data contained in the data message.
16 . The storage control node according to claim 15 , wherein the first DPU is configured to perform data fingerprint calculation on the data message to obtain a data fingerprint of the data message; and determine, based on the data fingerprint, the type of the data contained in the data message.
17 . The storage control node according to claim 15 , wherein the first DPU is configured to store the data message in the memory through a high-speed interconnection bus.
18 . The storage control node according to claim 15 , wherein the second DPU is configured to acquire the data message from the memory through a high-speed interconnection bus, and perform at least one of erasure processing, encryption processing, compression processing, deduplication processing, and data consistency protection processing on the acquired data message.
19 . The storage control node according to claim 15 , further comprising a CPU, wherein
the CPU is configured to perform data forwarding control and storage management.
20 . A nonvolatile readable storage medium, wherein the nonvolatile readable storage medium stores a computer program, and the computer program, when being executed by a processor, causes the processor to implement the following operations:
receiving, by a first Data Processing Unit (DPU) in a storage control node, an Input/Output interface (I/O) request, performing protocol offloading on the I/O request to obtain a data message, and storing the data message in a memory; and
acquiring, by a second DPU in the storage control node, the data message from the memory and performing data processing on the acquired data message, wherein
storing, by the first DPU, the data message in the memory comprises:
determining, by the first DPU, a type of data contained in the data message, and storing the data message in a corresponding memory according to the type of the data contained in the data message.