System and method for selectively processing data sub-segments using a data mask
View Patent ↗A data processing application for selectively processing data sub-segments using a data mask. Data segments are retrieved from a data source and pre-processed to include selected data sub-segments based upon the data mask. The masked data segments are communicated to a processor for processing. The excluded data sub-segments, if any, may be recombined with the processed data in post-processing, also using the data mask. Systems, methods, and articles of manufacture embodying the invention are described.
1. A method for processing a data segment, comprising:
receiving an original data segment, wherein the original data segment is a field within a row of a table;
receiving a data type of the original data segment that defines a plurality of sub-segments that compose the original data segment;
receiving a set of exclusion instructions that specifies one or more sub-segments, as defined by the data type of the original data segment, to exclude;
creating a masked data segment by excluding, based on the data type of the original data segment and based on the set of exclusion instructions, at least one sub-segment from the plurality of sub-segments; and
communicating the masked data segment to a process that returns a processed data segment.
2. The method of claim 1 , further comprising combining the original data segment and the processed data segment to create a result data segment.
3. The method of claim 2 , wherein combining the original data segment and the processed data segment to create a result data segment comprises using a segment mask to combine the original data segment and the processed data segment to create a result data segment.
4. The method of claim 2 , wherein combining the original data segment and the processed data segment comprises combining the at least one sub-segment excluded from the plurality of sub-segments and the processed data segment.
5. The method of claim 4 , wherein the result data segment comprises the original data segment modified so that a sub-segment included in the masked data segment is replaced by a sub-segment of the processed data segment.
6. The method of claim 2 , wherein the original data segment and the result data segment have a first data length equal to a number of sub-segments in the original data segment.
7. The method of claim 6 , wherein the masked data segment has a second data length equal to the difference between the first data length and a number of sub-segments excluded from the plurality of sub-segments.
8. The method of claim 1 , wherein the least one sub-segment excluded from the plurality of sub-segments is selected for exclusion using a segment mask.
9. The method of claim 8 , wherein the segment mask comprises a plurality of sub-segment masks.
10. The method of claim 9 , wherein the sub-segment mask indicates whether to exclude a sub-segment in the masked data segment.
11. A computer program product for processing a data segment, the computer program product comprising a computer-readable medium, the computer-readable medium comprising:
program code configured to receive an original data segment, wherein the original data segment is a field within a row of a table;
program code configured to receive a data type of the original data segment that defines a plurality of sub-segments that compose the original data segment;
program code configured to receive a set of exclusion instructions that specifies one or more sub-segments, as defined by the data type of the original data segment, to exclude;
program code configured to create a masked data segment by excluding, based on the data type of the original data segment and based on the set of exclusion instructions, at least one sub-segment from the plurality of sub-segments; and
program code configured to communicate the masked data segment to a process that returns a processed data segment.
12. A system including a processor for processing a data segment comprising:
a data segment receiving module configured to receive an original data segment, wherein the original data segment is a field within a row of a table;
a data type receiving module configured to receive a data type of the original data segment that defines a plurality of sub-segments that compose the original data segment;
an exclusion instruction receiving module configured to receive a set of exclusion instructions that specifies one or more sub-segments, as defined by the data type of the original data segment, to exclude;
a creation module configured to create a masked data segment by excluding, based on the data type of the original data segment and based on the set of exclusion instructions, at least one sub-segment from the plurality of sub-segments; and
a communication module configured to communicate the masked data segment to a process that returns a processed data segment.