System And Method For Generating Training Data For Function Approximation Of An Unknown Process Such As A Search Engine Ranking Algorithm
A system and method for generating training data for a machine learning system. A training data generator server sends at least one keyword to a search engine. The training data generator server receives at least a first and a second page from the search engine in response to the keyword, the first page having a first rank, the second page having a second rank, the first and second rank being based on the keyword. The training data generator server assigns a first label to the first page based on the first rank; and assigns a second label to the second page based on the second rank. The first web page, second page, first label and second label are forwarded to a machine learning server.
1 . A method for generating training data for a machine learning system, the method comprising:
sending at least one keyword to a search engine;
receiving at a first processor at least a first and a second page from the search engine in response to the keyword, the first page having a first rank, the second page having a second rank, the first and second rank being based on the keyword;
assigning at the first processor a first label to the first page based on the first rank;
assigning at the first processor a second label to the second page based on the second rank; and
forwarding the first web page, second page, first label and second label to a machine learning processor.
2 . The method as recited in claim 1 , wherein the first and second labels are based on a linear distribution of a ranking of the first and second pages by the search engine.
3 . The method as recited in claim 1 , wherein the pages are web pages.
4 . The method as recited in claim 1 , wherein the keyword is generated using at least one of an MSN keyword tool, GOOGLE ADWORDS, and a statistical analysis of keywords from web pages.
5 . A method for generating training data for a machine learning system, the method comprising:
sending at least one input to a system effective to perform a process;
receiving at a first processor at least a first and a second output from the system in response to the input, the first output having a first rank, the second output having a second rank, the first and second rank being based on the input;
assigning at the first processor a first label to the first output based on the first rank;
assigning at the first processor a second label to the second output based on the second rank; and
forwarding the first result, second result, first label and second label to a machine learning processor.
6 . The method as recited in claim 5 , wherein the first and second labels are based on a linear distribution of a ranking of the first and second pages by the search engine.
7 . The method as recited in claim 5 , wherein the pages are web pages.
8 . The method as recited in claim 5 , wherein the keyword is generated using at least one of an MSN keyword tool, GOOGLE ADWORDS, and a statistical analysis of keywords from web pages.
9 . A system for generating training data for a machine learning system, the system comprising:
a first processor effective to send at least one keyword to a search engine;
the first processor further effective to:
receive at least a first and a second page from the search engine in response to the keyword, the first page having a first rank, the second page having a second rank, the first and second rank being based on the keyword;
assign a first label to the first page based on the first rank; and
assign a second label to the second page based on the second rank; and
a machine learning processor connected to the first processor, the machine learning processor effective to receive the first web page, second web page, first label and second label.
10 . The system as recited in claim 9 , wherein the first and second labels are based on a linear distribution of a ranking of the first and second pages by the search engine.
11 . The system as recited in claim 9 , wherein the pages are web pages.
12 . The system as recited in claim 9 , wherein the keyword is generated using at least one of an MSN keyword tool, GOOGLE ADWORDS, and a statistical analysis of keywords from web pages.
13 . A computer readable storage medium including computer executable code effective to generate training data for a machine learning system, the code including the steps of:
sending at least one keyword to a search engine;
receiving at a first processor at least a first and a second page from the search engine in response to the keyword, the first page having a first rank, the second page having a second rank, the first and second rank being based on the keyword;
assigning at the first processor a first label to the first page based on the first rank;
assigning at the first processor a second label to the second page based on the second rank; and
forwarding the first web page, second page, first label and second label to a machine learning processor.
14 . The storage medium as recited in claim 13 , wherein the first and second labels are based on a linear distribution of a ranking of the first and second pages by the search engine.
15 . The storage medium as recited in claim 13 , wherein the pages are web pages.
16 . The storage medium as recited in claim 13 , wherein the keyword is generated using at least one of an MSN keyword tool, GOOGLE ADWORDS, and a statistical analysis of keywords from web pages.