Data processing method and data processing apparatus
The present invention proposes a data processing method, a data processing apparatus, an electronic device, and a computer-readable storage medium. The method includes: in response to a data processing instruction, segmenting an original data to obtain multiple data segments of the original data to enable parallel processing of the multiple data segments, wherein the multiple data segments includes a first data segment; determining whether the first data segment is suitable for using a preset run-length encoding; and when the first data segment is suitable for using the run-length encoding, using the run-length encoding to perform a run-length encoding processing on the first data segment. According to some embodiments, the original data is initially segmented into multiple data segments, and each data segment can be processed independently and concurrently, thereby enhancing the speed of data compression processing.
1 . A data processing method, characterized by comprising:
in response to a data processing instruction, segmenting an original data to obtain multiple data segments of the original data to enable parallel processing of the multiple data segments, wherein the multiple data segments comprise a first data segment;
determining whether the first data segment is suitable for using a preset run-length encoding; and
when the first data segment is suitable for using the run-length encoding, using the run-length encoding to perform a run-length encoding processing on the first data segment;
the multiple data segments further comprise a second data segment, and the data processing method further comprises:
determining whether the second data segment is suitable for using the run-length encoding; and
when the second data segment is not suitable for using the run-length encoding, not processing the second data segment or encoding the second data segment using a different encoding method than the run-length encoding.
2 . The data processing method according to claim 1 , characterized in that
the step of in response to a data processing instruction, segmenting an original data to obtain multiple data segments of the original data comprises:
segmenting the original data according to a length of the original data;
segmenting the original data according to a data distribution of the original data; or
segmenting the original data according to a preset segmentation constant.
3 . The data processing method according to claim 1 , characterized by further comprising:
concatenating the first data segment and the second data segment.
4 . The data processing method according to claim 3 , characterized in that
the step of concatenating the first data segment and the second data segment comprises:
when both the first data segment and the second data segment are processed using or not using the run-length encoding, directly concatenating the first data segment and the second data segment.
5 . The data processing method according to claim 3 , characterized in that the step of concatenating the first data segment and the second data segment comprises:
when only one of the first data segment and the second data segment is processed using the run-length encoding, marking a position of the first data segment after the run-length encoding processing.
6 . The data processing method according to claim 5 , characterized in that the step of marking a position of the first data segment after the run-length encoding processing comprises:
adding a special character before and after the position of the first data segment after the run-length encoding processing to mark the position of the first data segment after the run-length encoding processing; or
storing a position data of the first data segment after the run-length encoding processing to mark the position of the first data segment after the run-length encoding processing.
7 . An electronic device, comprising:
a processor; and
a memory storing a computer program that, when executed by the processor, causes the processor to execute the data processing method as claimed in claim 1 .
8 . An electronic device, comprising:
a processor; and
a memory storing a computer program that, when executed by the processor, causes the processor to execute the data processing method as claimed in claim 2 .
9 . An electronic device, comprising:
a processor; and
a memory storing a computer program that, when executed by the processor, causes the processor to execute the data processing method as claimed in claim 3 .
10 . An electronic device, comprising:
a processor; and
a memory storing a computer program that, when executed by the processor, causes the processor to execute the data processing method as claimed in claim 4 .
11 . An electronic device, comprising:
a processor; and
a memory storing a computer program that, when executed by the processor, causes the processor to execute the data processing method as claimed in claim 5 .
12 . An electronic device, comprising:
a processor; and
a memory storing a computer program that, when executed by the processor, causes the processor to execute the data processing method as claimed in claim 6 .
13 . A data processing apparatus, characterized by comprising:
a segmenting unit, configured to in response to a data processing instruction, segment an original data to obtain multiple data segments of the original data to enable parallel processing of the multiple data segments, wherein the multiple data segments comprise a first data segment and a second data segment;
a run-length encoding processing confirmation unit, configured to determine whether the first data segment is suitable for using a preset run-length encoding, and configured to determine whether the second data segment is suitable for using the run-length encoding; and
a run-length encoding unit, configured to when the first data segment is suitable for using the run-length encoding, use the run-length encoding to perform a run-length encoding processing on the first data segment, and configured to when the second data segment is not suitable for using the run-length encoding, not process the second data segment or encoding the second data segment using a different encoding method than the run-length encoding.