Document grouping system
Computer-based techniques for grouping documents are described herein. Documents may be grouped, organized, named, and/or indexed by their document character features. Document character features may comprise character counts, character difference counts, missing character counts, and any combination thereof. The comparison of documents may use a comparison threshold value for grouping documents. Documents may be processed in any language.
1. A computer-implemented system for grouping documents, the system comprising:
a non-transitory document storage system comprising computer memory configured to store a plurality of documents, wherein each document of the plurality of documents comprises distinct character types;
a computerized matching unit comprising one or more hardware processors,
wherein the computerized matching unit is configured to access the non-transitory document storage system and generate:
a first indicator of a common character count between a first document of the plurality of documents and a second document of the plurality of documents, wherein the common character count corresponds to a number of distinct character type occurrences in both the first document and the second document;
a second indicator of a character variance count between the first document and the second document, wherein the character variance count corresponds to differences in a number of occurrences of distinct character types in both the first document and the second document;
a third indicator of a missing character count between the first document and the second document, wherein the missing character count corresponds to a number of distinct character type occurrences in the first document and not in the second document;
a single indicator by combining at least the first indicator, the second indicator, and the third indicator, wherein the computerized matching unit is configured to compare the single indicator to a threshold indicator to determine whether there is a match between the first document and the second document; and
a grouping based at least in part on the single indicator; and
a matching reporting unit configured to report the grouping generated by the computerized matching unit to a user.
2. The system of claim 1 , wherein:
the first indicator comprises a first score;
the second indicator comprises a second score;
the third indicator comprises a third score;
the threshold indicator comprises a threshold score; and
the single indicator comprises a combined score based on the first score, the second score, and the third score, compared to the threshold score.
3. The system of claim 1 , further comprising:
a user interface unit configured to generate one or more user interfaces configured to display one or more clusters of documents based on the single indicator.
4. The system of claim 1 , further comprising:
an indexing unit,
wherein the indexing unit is configured to generate an index based on one or more document features.
5. The system of claim 1 , wherein the plurality of documents comprise loan documents.
6. The system of claim 1 , wherein the computerized matching unit is character set configurable.
7. The system of claim 1 , wherein the non-transitory document storage system comprises an in memory caching system.
8. The system of claim 1 , wherein:
the single indicator comprises a determining relationship M between the first document and the second document substantially as:
M
=
(
W
V
*
(
1
-
(
V
V
0
)
)
)
+
(
W
C
*
(
1
-
(
1
-
C
C
0
)
)
)
+
(
W
M
C
*
(
1
-
(
M
C
M
C
0
)
)
)
W
T
,
where W v , V 0 , W c , C 0 , W MC , MC 0 , and W T are constants;
the first indicator comprises C;
the second indicator comprises V; and
the third indicator comprises MC.
9. The system of claim 8 , wherein:
W v , V 0 , W c , C 0 , W MC , MC 0 , and W T may vary based on a first or second grouping.
10. A system for grouping documents, the system comprising:
one or more computing devices comprising one or more hardware processors, programmed, via executable code instructions, to implement:
a matching unit for comparing a plurality of documents, the matching unit configured to receive as input a first document and a second document, wherein each document of the plurality of documents comprises distinct character types, and
wherein the matching unit is further configured to generate:
a first indicator of a common character count between the first document and the second document, wherein the common character count corresponds to a number of distinct character type occurrences in both the first document and the second document;
a second indicator of a character variance count between the first document and the second document, wherein the character variance count corresponds to differences in a number of occurrences of distinct character types in both the first document and the second document;
a single indicator by combining at least the first indicator and the second indicator, wherein the matching unit is configured to compare the single indicator to a threshold indicator to determine whether there is a match between the first document and the second document; and
a grouping based at least in part on the single indicator; and
a matching reporting unit adapted to report the grouping generated by the matching unit.
11. The system of claim 10 , wherein the single indicator is further combined with a third indicator, compared to the threshold indicator, wherein the third indicator comprises a missing character count between the first document and the second document, wherein the missing character count corresponds to a number of distinct character type occurrences in the first document and not in the second document.
12. The system of claim 10 , further comprising:
a user interface unit configured to generate one or more user interfaces configured to display one or more clusters of documents based on the single indicator.
13. The system of claim 10 , further comprising:
an indexing unit,
wherein the indexing unit is adapted to output an index based on one or more document features.
14. The system of claim 10 , wherein the plurality of documents comprise loan documents.
15. The system of claim 10 , wherein the matching unit is character set configurable.
16. The system of claim 11 , wherein:
the single indicator comprises a determining relationship M between the first document and the second document substantially as:
M
=
(
W
V
*
(
1
-
(
V
V
0
)
)
)
+
(
W
C
*
(
1
-
(
1
-
C
C
0
)
)
)
+
(
W
MC
*
(
1
-
(
M
C
MC
0
)
)
)
W
T
,
where W v , V 0 , W c , C 0 , W MC , MC 0 , and W T are constants;
the first indicator comprises C;
the second indicator comprises V; and
the third indicator comprises MC.
17. Non-transitory computer storage comprising instructions for causing a computer system to group documents by a process that comprises:
receiving a first document and a second document, wherein each of the first document and the second document comprises distinct character types;
generating a first indicator of a common character count between the first document and the second document, wherein the common character count corresponds to a number of distinct character type occurrences in both the first document and the second document;
generating a second indicator of a character variance count between the first document and the second document, wherein the character variance count corresponds to differences in a number of occurrences of distinct character types in both the first document and the second document;
generating a third indicator of a missing character count between the first document and the second document, wherein the missing character count corresponds to a number of distinct character type occurrences in the first document and not in the second document;
generating a single indicator by combining at least the first indicator, the second indicator, and the third indicator;
comparing the single indicator to a threshold indicator to determine whether there is a match between the first document and the second document; and
transmitting matching information indicative of the comparison of the single indicator to the threshold indicator over a network to a computing device.
18. The non-transitory computer storage of claim 17 , wherein:
the first indicator comprises a first score;
the second indicator comprises a second score;
the third indicator comprises a third score;
the threshold indicator comprises a threshold score; and
the single indicator comprises a combined score based on the first score, the second score, and the third score.
19. The non-transitory computer storage of claim 17 , further comprising instructions for causing the computer system to group documents by:
generating one or more user interfaces configured to display one or more clusters of documents based on the single indicator.
20. The non-transitory computer storage of claim 17 , further comprising instructions for causing the computer system to group documents by:
generating an index based on one or more document features, wherein the index is stored in a second non-transitory computer storage.