System and method for classifying relevant competitors

1. A system for classifying competitors of a user of the system, the system comprising:

a website crawler that runs on a processor, the website crawler operable to obtain raw data from a plurality of Internet domains associated with a plurality of potential competitors' websites, wherein one or more wrappers is applied to the raw data to extract competitor product information from the raw data; and

a competitor classifier that runs on the processor, the competitor classifier operable to:

compute respective relevancy scores of a plurality of potential competitors to at least one product in a product set by assigning a value to a variable, the variable comprising:

an absolute number of products common to the user's web site and the potential competitor's web site, or

a percentage of products common to the user's website and the potential competitor's web site,

wherein the absolute number or the percentage is determined at least in part based on the competitor product information extracted from the raw data;

determine that one or more of the plurality of potential competitors has a respective computed relevancy score greater than a threshold value; and

add each of the one or more of the plurality of potential competitors having a respective computed relevancy score greater than the threshold value to a competitor set.

2. The system of claim 1 , wherein the competitor classifier is further operable to:

determine that a respective number of unique visitors to a respective website of at least one of the plurality of potential competitors over a period of time is below a predetermined threshold; and

disqualify, based on the respective number of unique visitors being below the predetermined threshold, the at least one of the plurality of potential competitors from the competitor set.

3. The system of claim 1 , wherein the competitor classifier is further operable to:

determine that a respective number of ratings or reviews on a respective website of at least one of the plurality of potential competitors is below a predetermined threshold; and

disqualify, based on the respective number of ratings or reviews being below the predetermined threshold, the at least one of the plurality of potential competitors from the competitor set.

4. The system of claim 1 , wherein the competitor classifier is further operable to:

determine that a respective number of views of a respective website of at least one of the plurality of potential competitors over a period of time is below a predetermined threshold; and

disqualify, based on the respective number of views being below the predetermined threshold, the at least one of the plurality of potential competitors from the competitor set.

5. The system of claim 1 , wherein the absolute number of products or the percentage of products is determined for only a particular brand of products.

6. The system of claim 1 , wherein the absolute number of products or the percentage of products is determined for only a particular category of products.

7. The system of claim 1 , wherein the absolute number of products or the percentage of products is determined for only a user-defined product group.

8. The system of claim 1 , wherein the competitor classifier is further operable to determine the respective relevancy scores based at least in part on at least one of unique visitors to the potential competitor's website, reviews on the potential competitor's website, ratings on the potential competitor's website, or a number of products offered by the potential competitor that comprise the product set.

9. A method for classifying competitors, the method comprising:

obtaining, by a website crawler run on a processor, raw data from a plurality of Internet domains associated with a plurality of potential competitors' websites;

applying, by the processor, one or more wrappers to the raw data to extract competitor product information from the raw data;

computing, by the processor, respective relevancy scores of a plurality of potential competitors to at least one product in a product set by assigning a value to a variable, the variable comprising:

an absolute number of products common to a user's website and the potential competitor's website, or

a percentage of products common to the user's website and the potential competitor's web site,

wherein the absolute number or the percentage is determined at least in part based on the competitor product information extracted from the raw data; and

determining, by the processor, that one or more of the potential competitors have a respective computed relevancy score that is greater than a threshold value; and

adding, by the processor, the one or more competitors having a respective computed relevancy score greater than the threshold value to a competitor set.

10. The method of claim 9 , wherein the competitor classifier is further operable to determine the respective relevancy scores based at least in part on unique visitors to the potential competitor's website, reviews on the potential competitor's website, ratings on the potential competitor's website, or a number of products offered by the potential competitor that comprise the product set.

11. The method of claim 9 , wherein the absolute number of products or the percentage of products is determined for only a particular brand of products, only a particular category of products, or only a user-defined product group.

12. The method of claim 9 , wherein the variable is a first variable, and the method further comprises:

assigning, by the processor, a value to a second variable related to a website of at least one of the plurality of potential competitors, the second variable comprising:

a number of unique visitors to a website of at least one of the plurality of potential competitors over a first period of time,

a number of ratings on the website,

a number of reviews on the website, or

a number of views of the website over a second period of time; and

disqualifying, by the processor, based on the second variable being below a predetermined threshold, the at least one of the plurality of potential competitors from the competitor set.

13. The method of claim 12 , wherein the second variable is determined at least in part based on the competitor product information extracted from the raw data.

14. The method of claim 9 , further comprising displaying, by the processor, product set information on a display of a computing device, wherein the product set information comprises, for the at least one product in the product set:

a product SKU,

a product category, or

a product brand.

15. The method of claim 9 , further comprising displaying, by the processor, competitor set information on a display of a computing device, wherein the competitor set information comprises, for each competitor in the competitor set:

the respective relevancy scores of the plurality of potential competitors,

the variable, or

the absolute number or percentage of products common to the user's web site and the potential competitor's website.

16. The method of claim 9 , further comprising generating, by the processor, a target price rule for the at least one product operative to change a price offered by the user for the at least one product.

17. The method of claim 9 , wherein the plurality of potential competitors are discovered from an unbounded number of Internet domains.

18. An apparatus for classifying competitors, the apparatus comprising:

a memory; and

a processor coupled to the memory, the processor operable to:

generate a product set from product information received from a user; and

generate a competitor set, the competitor set comprising at least one competitor determined to be relevant to at least one product in the product set, the processor operable to generate the competitor set by calculating respective relevancy scores of a plurality of potential competitors by:

obtaining, by a website crawler run on a processor, raw data from a plurality of Internet domains associated with a plurality of potential competitors' websites;

applying one or more wrappers to the raw data to extract competitor product information from the raw data;

assigning a respective value to a variable for each competitor, the variable comprising:

an absolute number of products common to the user's web site and the potential competitor's web site, or

a percentage of products common to the user's website and the potential competitor's website,

wherein the absolute number or the percentage is determined at least in part based on the product information extracted from the raw data; and

determining, for one or more of the plurality of potential competitors, that a respective computed relevancy score is greater than a threshold value; and

adding, each of the one or more of the plurality of potential competitors having a computed relevancy score greater than the threshold value to a competitor set.

19. The apparatus of claim 18 , wherein the respective relevancy scores are further determined based at least in part on at least one of unique visitors to the potential competitor's website, reviews on the potential competitor's website, ratings on the potential competitor's web site, or a number of products offered by the potential competitor that comprise the product set.

20. The apparatus of claim 18 , wherein the at least one of the unique visitors, the reviews, the ratings, or the number of products is determined at least in part based on the competitor product information extracted from the raw data.