Systems, methods, and interfaces for analyzing conceptually-related portions of text

1. A method comprising:

analyzing a first cluster of conceptually-related portions of text to identify a probability for each of the one or more portions of texts within the first cluster of conceptually-related portions of text, wherein the first cluster of conceptually-related portions of text comprises one or more contracts and each of the one or more contracts comprises one or more contract clauses and wherein the probability is calculated based on the number of occurrences of a given contract clause divided by the total number of contracts in the first cluster of conceptually-related portions of text;

developing a model based on the one or more probabilities corresponding to the one or more portions of texts within the first cluster of conceptually-related portions of text;

calculating a novelty measurement between a first identified conceptually-related portion of text and the model; and

transmitting a second identified conceptually-related portion of text and a score associated with the novelty measurement.

2. The method of claim 1 , wherein the cluster of conceptually-related portions of text comprises contracts, the model comprises a model contract, the second identified conceptually-related portion of text comprises one or more contracts.

3. The method of claim 1 , wherein the second identified conceptually-related portion of text each comprise one or more contracts.

4. A method comprising:

analyzing a first cluster of conceptually-related portions of text to identify a probability for each of the one or more portions of texts within the first cluster of conceptually-related portions of text, wherein the first cluster of conceptually-related portions of text comprises one or more sentences and wherein the probability is calculated based on the number of first time occurrences of a word in each of the one or more sentences divided by the total number of sentences in the first cluster of conceptually-related portions of text;

developing a model based on the one or more probabilities corresponding to the one or more portions of texts within the first cluster of conceptually-related portions of text;

calculating a novelty measurement between a first identified conceptually-related portion of text and the model; and

transmitting a second identified conceptually-related portion of text and a score associated with the novelty measurement.

5. The method of claim 4 wherein the cluster of conceptually-related portions of text comprises contract clauses, the model comprises a model contract clause, and the second identified conceptually-related portion of text comprises one or more contract clauses.

6. The method of claim 4 wherein the first identified conceptually-related portion of text and the second identified conceptually-related portion of text are each contract clauses.

7. The method of claim 4 further comprising receiving a first identified conceptually-related portion of text from a third party.

8. The method of claim 4 , wherein the first identified conceptually-related portions of a text is a paragraph.

9. The method of claim 4 , wherein the first cluster of conceptually-related portions of text is generated by:

determining at least two corpora of conceptually-related portions of text;

calculating a common neighbors similarity measurement between the at least two corpora of conceptually-related portions of text; and

merging the at least two corpora of conceptually-related portions of text into the first cluster of conceptually-related portions of text where the common neighbors similarity measurement exceeds a threshold.

10. The method of claim 9 wherein the at least two corpora of conceptually-related portions of text comprises contracts, the cluster of conceptually-related portions of text comprises contracts and the model comprises a model contract.

11. The method of claim 9 wherein the at least two corpora of conceptually-related portions of text comprises contract clauses, the cluster of conceptually-related portions of text comprises contract clauses and the model comprises a model contract clause.

12. A system comprising:

a processor;

a memory coupled to the processor;

a processing program stored in the memory for execution by the processor, the processing program comprising:

an analysis module, the analysis module configured to:

analyze a first cluster of conceptually-related portions of text to identify a probability for each of the one or more portions of texts within the first cluster of conceptually-related portions of text, wherein the first cluster of conceptually-related portions of text comprises one or more contracts and each of the one or more contracts comprises one or more contract clauses and wherein the probability is calculated based on the number of occurrences of a given contract clause divided by the total number of contracts in the first cluster of conceptually-related portions of text; and

develop a model based on the one or more probabilities corresponding to the one or more portions of texts within the first cluster of conceptually-related portions of text;

a novelty module, the novelty module configured to calculate a novelty measurement between a first identified conceptually-related portion of text and the model; and

a transmission module, the transmission module configured to transmit a second identified conceptually-related portion of text and a score associated with the novelty measurement.

13. The system of claim 12 , wherein the cluster of conceptually-related portions of text comprises contracts, the model comprises a model contract, the second identified conceptually-related portion of text comprises one or more contracts.

14. The system of claim 12 , wherein the second identified conceptually-related portion of text each comprise one or more contracts.

15. A system comprising:

a processor;

a memory coupled to the processor;

a processing program stored in the memory for execution by the processor, the processing program comprising:

an analysis module, the analysis module configured to:

analyze a first cluster of conceptually-related portions of text to identify a probability for each of the one or more portions of texts within the first cluster of conceptually-related portions of text, wherein the first cluster of conceptually-related portions of text comprises one or more sentences and wherein the probability is calculated based on the number of first time occurrences of a word in each of the one or more sentences divided by the total number of sentences in the first cluster of conceptually-related portions of text; and

develop a model based on the one or more probabilities corresponding to the one or more portions of texts within the first cluster of conceptually-related portions of text;

a novelty module, the novelty module configured to calculate a novelty measurement between a first identified conceptually-related portion of text and the model; and

a transmission module, the transmission module configured to transmit a second identified conceptually-related portion of text and a score associated with the novelty measurement.

16. The system of claim 15 further comprising a common neighbors module, the common neighbors module configured to:

determine at least two corpora of conceptually-related portions of text;

calculate a common neighbors similarity measurement between the at least two corpora of conceptually-related portions of text; and

merge the at least two corpora of conceptually-related portions of text into the first cluster of conceptually-related portions of text where the common neighbors similarity measurement exceeds a threshold.

17. The system of claim 16 wherein the at least two corpora of conceptually-related portions of text comprises contract clauses, the cluster of conceptually-related portions of text comprises contract clauses and the model comprises a model contract clause.

18. The system of claim 15 wherein the cluster of conceptually-related portions of text comprises contract clauses, the model comprises a model contract clause, and the second identified conceptually-related portion of text comprises a contract clause.

19. The system of claim 15 wherein the first identified conceptually-related portion of text and the second identified conceptually-related portion of text are each contract clauses.

20. The system of claim 15 wherein the novelty module is further configured to receive the first identified conceptually-related portion of text from a third party.

21. The system of claim 15 , wherein the first identified conceptually-related portions of a text is a paragraph.