Automation system and method
A computer-implemented method, computer program product and computing system for providing a plurality of data description models corresponding to a plurality of websites to a machine learning process; providing ontology data concerning the plurality of websites to the machine learning process; providing target website data concerning a target website to the machine learning process; and processing the plurality of data description models, ontology data and target website data using the machine learning process to generate a data description model for the target web site.
1. A computer-implemented method, executed on a computing device, comprising:
providing a plurality of data description models corresponding to a plurality of websites to a machine learning process;
providing ontology data concerning the plurality of websites to the machine learning process, wherein the ontology data is a predefined dataset with normalized descriptors for a plurality of associated descriptors from the plurality of websites;
providing target website data concerning a target website to the machine learning process; and
processing the plurality of data description models, ontology data and target website data using the machine learning process to generate a data description model for the target website by processing the plurality of data description models and ontology data as training data for the machine learning process and processing the target website using the trained machine learning process to generate the data description model for the target website.
2. The computer-implemented method of claim 1 further comprising:
generating a specific data description model of the plurality of data description models.
3. The computer-implemented method of claim 2 wherein generating a specific data description model of the plurality of data description models includes:
identifying one or more portions of a website structure of a specific website; and
associating the one or more portions of the website structure with one or more descriptors of the specific website to define the specific data description model.
4. The computer-implemented method of claim 3 wherein identifying one or more portions of a website structure of a specific website includes:
enabling a user to review a specific website to visually identify one or more spatial regions of the specific website; and
associating the one or more spatial regions of the specific website with the one or more portions of the website structure.
5. The computer-implemented method of claim 3 wherein the one or more descriptors includes one or more of:
a property descriptor;
an attribute descriptor; and
a value descriptor.
6. The computer-implemented method of claim 3 wherein the website structure includes one or more of:
a HTML website structure;
a javascript website structure; and
a CSS website structure.
7. The computer-implemented method of claim 3 further comprising:
processing the specific data description model to obtain useable information from the specific website; and
populating a database with at least a portion of the useable information.
8. The computer-implemented method of claim 7 wherein processing the specific data description model to obtain useable information from the specific website includes:
processing the specific data description model to obtain raw information from the specific website; and
transforming the raw information into the useable information.
9. The computer-implemented method of claim 8 wherein transforming the raw information into the useable information includes one or more of:
amending the raw information;
processing the raw information to normalize and/or homogenize one or more attribute descriptors;
processing the raw information to normalize and/or homogenize one or more property descriptors; and
processing the raw information to normalize and/or homogenize one or more value descriptors.
10. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:
providing a plurality of data description models corresponding to a plurality of websites to a machine learning process;
providing ontology data concerning the plurality of websites to the machine learning process, wherein the ontology data is a predefined dataset with normalized descriptors for a plurality of associated descriptors from the plurality of websites;
providing target website data concerning a target website to the machine learning process; and
processing the plurality of data description models, ontology data and target website data using the machine learning process to generate a data description model for the target website by processing the plurality of data description models and ontology data as training data for the machine learning process and processing the target website using the trained machine learning process to generate the data description model for the target website.
11. The computer program product of claim 10 further comprising:
generating a specific data description model of the plurality of data description models.
12. The computer program product of claim 11 wherein generating a specific data description model of the plurality of data description models includes:
identifying one or more portions of a website structure of a specific website; and
associating the one or more portions of the website structure with one or more descriptors of the specific website to define the specific data description model.
13. The computer program product of claim 12 wherein identifying one or more portions of a website structure of a specific website includes:
enabling a user to review a specific website to visually identify one or more spatial regions of the specific website; and
associating the one or more spatial regions of the specific website with the one or more portions of the website structure.
14. The computer program product of claim 12 wherein the one or more descriptors includes one or more of:
a property descriptor;
an attribute descriptor; and
a value descriptor.
15. The computer program product of claim 12 wherein the website structure includes one or more of:
a HTML website structure;
a javascript website structure; and
a CSS website structure.
16. The computer program product of claim 12 further comprising:
processing the specific data description model to obtain useable information from the specific website; and
populating a database with at least a portion of the useable information.
17. The computer program product of claim 16 wherein processing the specific data description model to obtain useable information from the specific website includes:
processing the specific data description model to obtain raw information from the specific website; and
transforming the raw information into the useable information.
18. The computer program product of claim 17 wherein transforming the raw information into the useable information includes one or more of:
amending the raw information;
processing the raw information to normalize and/or homogenize one or more attribute descriptors;
processing the raw information to normalize and/or homogenize one or more property descriptors; and
processing the raw information to normalize and/or homogenize one or more value descriptors.
19. A computing system including a hardware processor and memory configured to perform operations comprising:
providing, using the hardware processor, a plurality of data description models corresponding to a plurality of websites to a machine learning process;
providing, using the hardware processor, ontology data concerning the plurality of websites to the machine learning process, wherein the ontology data is a predefined dataset with normalized descriptors for a plurality of associated descriptors from the plurality of websites;
providing, using the hardware processor, target website data concerning a target website to the machine learning process; and
processing the plurality of data description models, ontology data and target website data using the machine learning process to generate a data description model for the target website by processing the plurality of data description models and ontology data as training data for the machine learning process and processing the target website using the trained machine learning process to generate the data description model for the target website.
20. The computing system of claim 19 further comprising:
generating a specific data description model of the plurality of data description models.
21. The computing system of claim 20 wherein generating a specific data description model of the plurality of data description models includes:
identifying one or more portions of a website structure of a specific website; and
associating the one or more portions of the website structure with one or more descriptors of the specific website to define the specific data description model.
22. The computing system of claim 21 wherein identifying one or more portions of a website structure of a specific website includes:
enabling a user to review a specific website to visually identify one or more spatial regions of the specific website; and
associating the one or more spatial regions of the specific website with the one or more portions of the website structure.
23. The computing system of claim 21 wherein the one or more descriptors includes one or more of:
a property descriptor;
an attribute descriptor; and
a value descriptor.
24. The computing system of claim 21 wherein the website structure includes one or more of:
a HTML website structure;
a javascript website structure; and
a CSS website structure.
25. The computing system of claim 21 further comprising:
processing the specific data description model to obtain useable information from the specific website; and
populating a database with at least a portion of the useable information.
26. The computing system of claim 25 wherein processing the specific data description model to obtain useable information from the specific website includes:
processing the specific data description model to obtain raw information from the specific website; and
transforming the raw information into the useable information.
27. The computing system of claim 26 wherein transforming the raw information into the useable information includes one or more of:
amending the raw information;
processing the raw information to normalize and/or homogenize one or more attribute descriptors;
processing the raw information to normalize and/or homogenize one or more property descriptors; and
processing the raw information to normalize and/or homogenize one or more value descriptors.