Automation system and method
A computer-implemented method, computer program product and computing system for normalizing descriptors within a master website dataset; comparing descriptors within a subordinate website dataset to descriptors within the master website dataset to define a similarity score for each descriptor within subordinate website dataset; and normalizing one or more descriptors of the subordinate website dataset if the similarity score is above a similarity threshold.
1. A computer-implemented method, executed on a computing device, comprising:
obtaining descriptors within a master website dataset using one or more of a data description model associated with a first website and a function description model associated with the first website, wherein the data description model includes a description of a plurality of structure portions of the first website and how to navigate between the plurality of structure portions of the first website, wherein the function description model includes one or more actions that are performable on the first website;
normalizing the descriptors within the master website dataset;
obtaining descriptors within a subordinate website dataset using one or more of a data description model associated with a second website and a function description model associated with the second website, wherein the data description model includes a description of a plurality of structure portions of the second website and how to navigate between the plurality of structure portions of the second website, wherein the function description model includes one or more actions that are performable on the second website;
comparing the descriptors within the subordinate website dataset to descriptors within the master website dataset to define a similarity score for each descriptor within subordinate website dataset; and
normalizing one or more descriptors of the subordinate website dataset if the similarity score is above a similarity threshold.
2. The computer-implemented method of claim 1 wherein the one or more descriptors includes one or more of:
a property descriptor;
an attribute descriptor; and
a value descriptor.
3. The computer-implemented method of claim 1 wherein comparing descriptors within a subordinate website dataset to descriptors within the master website dataset to define a similarity score for each descriptor within subordinate website dataset includes:
determining a Cartesian product of descriptors within a subordinate website dataset and descriptors within the master website dataset to define the similarity score for each descriptor within subordinate website dataset.
4. The computer-implemented method of claim 1 further comprising one or more of:
obtaining the descriptors within the master website dataset via a description model; and
obtaining the descriptors within the subordinate website dataset via the description model.
5. The computer-implemented method of claim 4 wherein the description model includes a data description model.
6. The computer-implemented method of claim 4 wherein the description model includes a function description model.
7. The computer-implemented method of claim 1 wherein the similarity score is one or more of:
a value set similarity score;
a type similarity score; and
a string similarity score.
8. The computer-implemented method of claim 1 wherein normalizing one or more descriptors of the subordinate website dataset if the similarity score is above a similarity threshold includes:
mapping the one or more descriptors of the subordinate website dataset to the one or more descriptors of the master website dataset.
9. The computer-implemented method of claim 1 further comprising:
generating a plurality of mappings between one or more descriptors of a plurality of subordinate website datasets and the one or more descriptors of the master website dataset.
10. The computer-implemented method of claim 9 further comprising:
providing the plurality of mappings between the one or more descriptors of a plurality of subordinate website datasets and the one or more descriptors of the master website dataset to a machine learning process;
providing target subordinate website data concerning a target subordinate website to the machine learning process; and
normalizing one or more descriptors of the target website data to the master website dataset using the machine learning process.
11. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:
obtaining descriptors within a master website dataset using one or more of a data description model associated with a first website and a function description model associated with the first website, wherein the data description model includes a description of a plurality of structure portions of the first website and how to navigate between the plurality of structure portions of the first website, wherein the function description model includes one or more actions that are performable on the first website;
normalizing the descriptors within the master website dataset;
obtaining descriptors within a subordinate website dataset using one or more of a data description model associated with a second website and a function description model associated with the second website, wherein the data description model includes a description of a plurality of structure portions of the second website and how to navigate between the plurality of structure portions of the second website, wherein the function description model includes one or more actions that are performable on the second website;
comparing the descriptors within the subordinate website dataset to descriptors within the master website dataset to define a similarity score for each descriptor within subordinate website dataset; and
normalizing one or more descriptors of the subordinate website dataset if the similarity score is above a similarity threshold.
12. The computer program product of claim 11 wherein the one or more descriptors includes one or more of:
a property descriptor;
an attribute descriptor; and
a value descriptor.
13. The computer program product of claim 11 wherein comparing descriptors within a subordinate website dataset to descriptors within the master website dataset to define a similarity score for each descriptor within subordinate website dataset includes:
determining a Cartesian product of descriptors within a subordinate website dataset and descriptors within the master website dataset to define the similarity score for each descriptor within subordinate website dataset.
14. The computer program product of claim 11 further comprising one or more of:
obtaining the descriptors within the master website dataset via a description model; and
obtaining the descriptors within the subordinate website dataset via the description model.
15. The computer program product of claim 14 wherein the description model includes a data description model.
16. The computer program product of claim 14 wherein the description model includes a function description model.
17. The computer program product of claim 11 wherein the similarity score is one or more of:
a value set similarity score;
a type similarity score; and
a string similarity score.
18. The computer program product of claim 11 wherein normalizing one or more descriptors of the subordinate website dataset if the similarity score is above a similarity threshold includes:
mapping the one or more descriptors of the subordinate website dataset to the one or more descriptors of the master website dataset.
19. The computer program product of claim 11 further comprising:
generating a plurality of mappings between one or more descriptors of a plurality of subordinate website datasets and the one or more descriptors of the master website dataset.
20. The computer program product of claim 19 further comprising:
providing the plurality of mappings between the one or more descriptors of a plurality of subordinate website datasets and the one or more descriptors of the master website dataset to a machine learning process;
providing target subordinate website data concerning a target subordinate website to the machine learning process; and
normalizing one or more descriptors of the target website data to the master website dataset using the machine learning process.
21. A computing system including a processor and memory configured to perform operations comprising:
obtaining descriptors within a master website dataset using one or more of a data description model associated with a first website and a function description model associated with the first website, wherein the data description model includes a description of a plurality of structure portions of the first website and how to navigate between the plurality of structure portions of the first website, wherein the function description model includes one or more actions that are performable on the first website;
normalizing the descriptors within the master website dataset;
obtaining descriptors within a subordinate website dataset using one or more of a data description model associated with a second website and a function description model associated with the second website, wherein the data description model includes a description of a plurality of structure portions of the second website and how to navigate between the plurality of structure portions of the second website, wherein the function description model includes one or more actions that are performable on the second website;
comparing the descriptors within the subordinate website dataset to descriptors within the master website dataset to define a similarity score for each descriptor within subordinate website dataset; and
normalizing one or more descriptors of the subordinate website dataset if the similarity score is above a similarity threshold.
22. The computing system of claim 21 wherein the one or more descriptors includes one or more of:
a property descriptor;
an attribute descriptor; and
a value descriptor.
23. The computing system of claim 21 wherein comparing descriptors within a subordinate website dataset to descriptors within the master website dataset to define a similarity score for each descriptor within subordinate website dataset includes:
determining a Cartesian product of descriptors within a subordinate website dataset and descriptors within the master website dataset to define the similarity score for each descriptor within subordinate website dataset.
24. The computing system of claim 21 further comprising one or more of:
obtaining the descriptors within the master website dataset via a description model; and
obtaining the descriptors within the subordinate website dataset via the description model.
25. The computing system of claim 24 wherein the description model includes a data description model.
26. The computing system of claim 24 wherein the description model includes a function description model.
27. The computing system of claim 21 wherein the similarity score is one or more of:
a value set similarity score;
a type similarity score; and
a string similarity score.
28. The computing system of claim 21 wherein normalizing one or more descriptors of the subordinate website dataset if the similarity score is above a similarity threshold includes:
mapping the one or more descriptors of the subordinate website dataset to the one or more descriptors of the master website dataset.
29. The computing system of claim 21 further comprising:
generating a plurality of mappings between one or more descriptors of a plurality of subordinate website datasets and the one or more descriptors of the master website dataset.
30. The computing system of claim 29 further comprising:
providing the plurality of mappings between the one or more descriptors of a plurality of subordinate website datasets and the one or more descriptors of the master website dataset to a machine learning process;
providing target subordinate website data concerning a target subordinate website to the machine learning process; and
normalizing one or more descriptors of the target website data to the master website dataset using the machine learning process.