IP Library Granted Patent US 10,049,101
Granted Patent B2
US 10,049,101 · App. 14/819,735 · Granted Aug 14, 2018

Method and system for processing semantic fragments

Inventors: Wei Hua Duan (Beijing, CN); Jia Ji (Beijing, CN); Jiang Lu (Beijing, CN); Wei Jie Wang (Beijing, CN); Qiang Xu (Vermont South, AU); Liang Xue (Beijing, CN)
Assignee: International Business Machines Corporation
G06F17/2785
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,049,101
App. No.
14/819,735
Granted
Aug 14, 2018
Kind
B2
Abstract

The present invention discloses a method and system for processing semantic fragments. Some embodiments of the present invention provides a method for processing semantic fragments. The method comprises: obtaining a plurality of groups of semantic fragments, the plurality of groups of semantic fragments at least including a first group of semantic fragments generated from a first data processing flow and a second group of semantic fragments generated from a second data processing flow, the first data processing flow being different from the second data processing flow; and merging the first group of semantic fragment and the second group of semantic fragment based on semantic equivalence. A corresponding system is also disclosed.

Claims (54)

1. A method of processing semantic fragments, the method comprising:

obtaining a plurality of groups of semantic fragments by fragmenting a plurality of data processing flows according to one or more data processing attributes, wherein the semantic fragments are not parts of human language, and wherein each semantic fragment comprises one or more executable code elements corresponding to a data processing flow, the plurality of groups of semantic fragments at least including a first group of semantic fragments generated from a first data processing flow and a second group of semantic fragments generated from a second data processing flow, the first data processing flow being different from the second data processing flow; and

merging the first group of semantic fragments and the second group of semantic fragments based on semantic equivalence, wherein semantic equivalence is determined according to similarity of semantic features of the first group of semantic fragments to semantic features of the second group of semantic fragments, wherein the semantic features are selected from the list consisting of a subject of data processing feature, a processing time feature, a processing location feature, a security level feature, and a resource requirement feature.

2. The method according to claim 1 , wherein obtaining a plurality of groups of semantic fragments comprises:

partitioning the first data processing flow into the first group of semantic fragments based on semantic features of elements in the first data processing flow.

3. The method according to claim 2 , wherein the elements in the first data processing flow include primary elements and auxiliary elements connecting the primary elements, and wherein partitioning the first data processing flow into the first group of semantic fragments comprises:

determining at least one boundary element from the primary elements based on the semantic features of the primary elements;

partitioning the primary elements into different groups based on the at least one boundary element; and

partitioning the auxiliary elements to the groups based on connections between the primary elements and the auxiliary elements, to generate the first group of semantic fragments.

4. The method according to claim 2 , wherein partitioning the first data processing flow into the first group of semantic fragments comprises:

associating semantic fragments with data flow in the first group of semantic fragments for reconstruction of the first data processing flow.

5. The method according to claim 1 , further comprising:

determining similarities between semantic fragments in the first group of semantic fragments and semantic fragments in the second group of semantic fragments,

wherein merging the first group of semantic fragment and the second group of semantic fragment based on semantic equivalence comprises: merging the first group of semantic fragments and the second group of semantic fragments based on an order of the similarities.

6. The method according to claim 1 , wherein merging the first group of semantic fragment and the second group of semantic fragment based on semantic equivalence comprises:

merging a first semantic fragment in the first group of semantic fragments and a second semantic fragment in the second group of semantic fragments into a third semantic fragment by generating a branch.

7. The method according to claim 6 , wherein merging a first semantic fragment in the first group of semantic fragments and a second semantic fragment in the second group of semantic fragments into a third semantic fragment by generating a branch comprises:

responsive to a first element in the first semantic fragment being semantically equivalent to a second element in the second semantic fragment while a first downstream element of the first element in the first semantic fragment being not semantically equivalent to a second downstream element of the second element in the second semantic fragment, merging the first element and the second element into a third element in the third semantic fragment; and

using a branch element to insert the first downstream element and the second downstream element into the third semantic fragment as downstream elements of the third element.

8. The method according to claim 7 , wherein merging the first element and the second element into a third element in the third semantic fragment comprises:

creating the branch element as the third element.

9. The method according to claim 6 , wherein merging a first semantic fragment in the first group of semantic fragments and a second semantic fragment in the second group of semantic fragments into a third semantic fragment by generating a branch comprises:

responsive to a first element in the first semantic fragment being not semantically equivalent to a second element in the second semantic fragment while a first downstream element of the first element in the first semantic fragment being semantically equivalent to a second downstream element of the second element in the second semantic fragment, creating a branch element in the third semantic fragment;

inserting the first element and the second element into the third semantic fragment as downstream elements of the branch element; and

merging the first downstream element and the second downstream element into the third semantic fragment as a downstream element common to the first element and the second element.

10. The method according to claim 1 , further comprising:

extracting a backbone of at least one of the first data processing flow and the second data processing flow based on a result of the merging.

11. A system for processing semantic fragments, the method comprising:

a fragment obtaining unit configured to obtain a plurality of groups of semantic fragments by fragmenting a plurality of data processing flows according to one or more data processing attributes, wherein the semantic fragments are not parts of human language, and wherein each semantic fragment comprises one or more executable code elements corresponding to a data processing flow, the plurality of groups of semantic fragments at least including a first group of semantic fragments generated from a first data processing flow and a second group of semantic fragments generated from a second data processing flow, the first data processing flow being different from the second data processing flow; and

a fragment merging unit configured to merge the first group of semantic fragments and the second group of semantic fragments based on semantic equivalence, wherein semantic equivalence is determined according to similarity of semantic features of the first group of semantic fragments to semantic features of the second group of semantic fragments, wherein the semantic features are selected from the list consisting of a subject of data processing feature, a processing time feature, a processing location feature, a security level feature, and a resource requirement feature.

12. The system according to claim 11 , wherein the fragment obtaining unit comprises:

a fragment partitioning unit configured to partition the first data processing flow into the first group of semantic fragments based on semantic features of elements in the first data processing flow.

13. The system according to claim 12 , wherein the elements in the first data processing flow include primary elements and auxiliary elements connecting the primary elements, and wherein the fragment partitioning unit comprises:

a boundary element determining unit configured to determine at least one boundary element from the primary elements based on the semantic features of the primary elements;

a primary element partitioning unit configured to partition the primary elements into different groups based on the at least one boundary element; and

an auxiliary element partitioning unit configured to partition the auxiliary elements to the groups based on connection between the primary elements and the auxiliary elements, to generate the first group of semantic fragments.

14. The system according to claim 12 , wherein the fragment partitioning unit comprises:

a fragment associating unit configured to associate semantic fragments with data flow in the first group of semantic fragments for reconstruction of the first data processing flow.

15. The system according to claim 11 , further comprising:

a similarity determining unit configured to determine similarities between semantic fragments in the first group of semantic fragments and semantic fragments in the second group of semantic fragments,

wherein the fragment merging unit is configured to merge the first group of semantic fragments and the second group of semantic fragments based on an order of the similarities.

16. The system according to claim 11 , wherein the fragment merging unit comprises:

a branch-based merging unit configured to merge a first semantic fragment in the first group of semantic fragments and a second semantic fragment in the second group of semantic fragments into a third semantic fragment by generating a branch.

17. The system according to claim 16 , wherein the branch-based merging unit comprises:

a first element merging unit configured to, responsive to a first element in the first semantic fragment being semantically equivalent to a second element in the second semantic fragment while a first downstream element of the first element in the first semantic fragment being not semantically equivalent to a second downstream element of the second element in the second semantic fragment, merge the first element and the second element into a third element in the third semantic fragment; and

a first element inserting unit configured to use a branch element to insert the first downstream element and the second downstream element into the third semantic fragment as downstream elements of the third element.

18. The system according to claim 17 , wherein the first element merging unit comprises:

a first branch creating unit configured to create the branch element as the third element.

19. The system according to claim 16 , wherein the branch-based merging unit comprises:

a second branch creating unit configured to, responsive to a first element in the first semantic fragment being not semantically equivalent to a second element in the second semantic fragment while a first downstream element of the first element in the first semantic fragment being semantically equivalent to a second downstream element of the second element in the second semantic fragment, create a branch element in the third semantic fragment;

a second element inserting unit configured to insert the first element and the second element into the third semantic fragment as downstream elements of the branch element; and

an element merging unit configured to merge the first downstream element and the second downstream element into the third semantic fragment as a downstream element common to the first element and the second element.

20. The system according to claim 11 , further comprising:

a backbone extracting unit configured to extract a backbone of at least one of the first data processing flow and the second data processing flow based on a result of the merging.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2015
From: DUAN, WEI HUA; JI, JIA; LU, JIANG; WANG, WEI JIE; XU, QIANG; XUE, LIANG
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 036268/0016 →
Priority Claims (1)
CN 2014 1 0412445 · Aug 20, 2014 · national
Continuity (1)
Related Publication 20160055147A1 · Feb 25, 2016