Mining web applications
View Patent ↗Systems and methods of mining Web applications are disclosed. An example method may include selecting a distance measure between subtrees of the Web applications. The method may also include computing an edit distance for the subtrees. The method may also include finding sets of similar subtrees using the edit distance with a Similar Sibling-Trees-aware RTDM (SiSTeR) approach.
1. A method of mining Web applications, the method stored as computer readable instructions on a computer readable media and executed by a processor, the method comprising:
selecting a distance measure between subtrees of the Web applications according to a bottom-up approach;
computing an edit distance for the subtrees; and
finding sets of similar subtrees using the edit distance with a Similar Sibling-Trees-aware Restricted Top-Down edit Metric (RTDM) (SiSTeR) approach, wherein the SiSTeR approach detects a plurality of lists of different length as similar while disregarding a number of entries within each of the plurality of lists individually, and wherein finding similar structures in the Web applications disregards dissimilarity affected only by a number of sibling sub-trees.
2. The method of claim 1 , further comprising finding repeating Document Object Model (DOM) subtrees.
3. The method of claim 1 , further comprising using a one-to-many replace operation.
4. The method of claim 3 , wherein the one-to-many replace operation is computed in a dynamic programming regime.
5. The method of claim 3 , wherein the many-to-one replace operation is computed in a dynamic programming regime.
6. The method of claim 1 , further comprising using a many-to-one replace operation.
7. The method of claim 1 , wherein a one-to-many replace operation and a many-to-one replace operation replaces a series of consecutive replaces of one subtree with many subtrees.
8. The method of claim 7 , wherein a cost of the replace operations is a sum of replaces.
9. The method of claim 7 , further comprising reducing a number of replace operations.
10. A system for mining Web applications, the system including computer readable instructions stored on a computer readable media and executed by a processor to:
select a distance measure between subtrees of the Web applications according to a bottom-up approach;
compute an edit distance for the subtrees; and
find sets of similar subtrees using the edit distance with a Similar Sibling-Trees-aware Restricted Top-Down edit Metric (RTDM) (SiSTeR) approach, wherein the SiSTeR approach detects a plurality of lists of different length as similar while disregarding a number of entries within each of the plurality of lists individually, and wherein finding similar structures in the Web applications disregards dissimilarity affected only by a number of sibling sub-trees.
11. The system of claim 10 , further comprising executing the instructions to find repeating Document Object Model (DOM) subtrees.
12. The system of claim 10 , further comprising executing the instructions using a one-to-many replace operation.
13. The system of claim 10 , further comprising executing the instructions many-to-one replace operation.
14. The system of claim 10 , further comprising executing the instructions in a dynamic programming regime.
15. The system of claim 10 , further comprising executing the instructions to reduce a number of replace operations.
16. The system of claim 10 , wherein a one-to-many replace operation and a many-to-one replace operation replaces a series of consecutive replaces of one subtree with many subtrees.
17. The system of claim 10 , wherein a cost of the replace operations is a sum of replaces.
18. The system of claim 10 , wherein the Web applications include at least search engines, video sites, and content pages.