Determining a semantic distance between subjects
A technique for calculating a semantic distance between subjects includes performing a mathematical operation between each of one or more first topic vectors and each of one or more second topic vectors to generate respective strength values. The first topic vectors are associated with respective first topics of a first subject, the second topic vectors are associated with respective second topics of a second subject, and the respective strength values are indicative of a relative closeness between associated ones of the first and second topics. Relevant ones of the respective strength values are summed to provide an overall strength value between the first subject and the second subject. A semantic distance between the first subject and the second subject is determined based on the overall strength value.
1. A method of determining a semantic distance between subjects, comprising:
performing, using a data processing system, a mathematical operation between each of one or more first topic vectors and each of one or more second topic vectors to generate respective strength values, wherein the first topic vectors are associated with respective first topics of a first subject, the second topic vectors are associated with respective second topics of a second subject, and the respective strength values are indicative of a relative closeness between associated ones of the first and second topics;
summing, using the data processing system, relevant ones of the respective strength values to provide an overall strength value between the first subject and the second subject;
determining, using the data processing system, a semantic distance between the first subject and the second subject based on the overall strength value; and
utilizing, using the data processing system, both the first and second subjects in a search for information related to the first subject in response to the semantic distance being within a threshold distance value to improve the operation of the data processing system in answering a question about the first subject.
2. The method of claim 1 , further comprising:
generating, using the data processing system, the first topic vectors and the second topic vectors based on a statistical model analysis.
3. The method of claim 2 , wherein the mathematical operation is a dot product operation.
4. The method of claim 2 , wherein the statistical model analysis is a latent Dirichlet allocation (LDA) analysis.
5. The method of claim 1 , wherein a number of the first topics for the first subject is determined by taking the square root of a number of documents associated with the first subject divided by two.
6. The method of claim 5 , wherein the documents are located using a Web search.
7. The method of claim 1 , wherein the semantic distance between the first subject and the second subject is determined by taking an inverse of the overall strength value.
8. The method of claim 1 , wherein each of the first and second topic vectors have an associated word and an associated strength that is normalized to one.