Computer-implemented system and method for selecting documents for review
A computer-implemented system and method for selecting documents for review is provided. A master array of messages and topics for the messages is generated. The messages in the master array are sorted by the topics and the sorted messages are processed. During processing, each message in the master array is identified as unique, duplicate, or near duplicate. The unique messages are extracted from the duplicate and near duplicate messages, and entered into a log by creating a log entry for each of the unique messages. Each log entry includes a source of and identification information for one of the unique messages. The unique messages are then provided for document review.
1. A computer-implemented system for selecting documents for review, comprising:
a master array comprising messages and topics of the messages; and
a processor to execute modules, comprising:
a sort module to sort the messages in the master array by the topics;
a message processing module to process the sorted messages by identifying each message in the master array as unique, duplicate, or near duplicate, by extracting the unique messages from the duplicate and near duplicate messages, and by entering the unique messages into a log by creating a log entry for each of the unique messages, wherein each log entry comprises a source of and identification information for one of the unique messages;
a message counter to determine a maximum number of the messages to be processed during a single pass;
a pass determination module to determine a number of the passes required for processing the messages based on the maximum number of messages via the following equation:
n
=
ceil
⌈
TotNumMessages
ProgMax
⌉
where n equals a total number of the processing passes, TotNumMessages is the total number of messages, and ProgMax is the maximum number of messages to be processed; and
a delivery module to provide the unique messages for document review.
2. A system according to claim 1 , wherein the delivery module provides the duplicate and near duplicate messages for one or more of the unique messages during the document review.
3. A system according to claim 1 , further comprising:
a reference module to cross reference in the log each unique message with the duplicate and near duplicate messages for that unique message.
4. A system according to claim 1 , further comprising:
a holding area for the unique messages extracted from the duplicate and near duplicate messages.
5. A system according to claim 1 , wherein the messages are stored in one or more original message stores.
6. A system according to claim 5 , further comprising:
a point-to-point keyed collection storing cross-references between an identifier of the original message store for each message and an identifier of a newly created folder into which that message is placed after processing.
7. A system according to claim 1 , further comprising:
an identification module to identify at least one of the duplicate and near duplicate messages for a common unique message as having a longest thread.
8. A system according to claim 7 , further comprising:
a thread identification module to identify the duplicate or near duplicate message with the longest thread by identifying a number of thread markers for each of the duplicate and near duplicate messages for the common unique message and sorting the duplicate and near duplicate messages in order of increasing number of the thread markers.
9. A computer-implemented method for selecting documents for review, comprising:
generating a master array comprising messages and topics of the messages;
sorting the messages in the master array by the topics;
processing the sorted messages in one or more passes, comprising:
identifying each message in the master array as unique, duplicate, or near duplicate; and
extracting the unique messages from the duplicate and near duplicate messages and entering the unique messages into a log by creating a log entry for each of the unique messages, wherein each log entry comprises a source of and identification information for one of the unique messages;
determining a maximum number of the messages to be processed during a pass;
determining a number of the passes required for processing the messages based on the maximum number of messages via the following equation:
n
=
ceil
⌈
TotNumMessages
ProgMax
⌉
where n equals a total number of the processing passes, TotNumMessages is the total number of the messages, and ProgMax is the maximum number of the messages to be processed; and
providing the unique messages for document review.
10. A method according to claim 9 , further comprising:
providing the duplicate and near duplicate messages for one or more of the unique messages during the document review.
11. A method according to claim 9 , further comprising:
cross referencing in the log each unique message with the duplicate and near duplicate messages for that unique message.
12. A method according to claim 9 , further comprising:
creating a holding area for the unique messages extracted from the duplicate and near duplicate messages.
13. A method according to claim 9 , wherein the messages are stored in one or more original message stores.
14. A method according to claim 13 , further comprising:
generating a point-to-point keyed collection storing cross-references between an identifier of the original message store for each message and an identifier of a newly created folder into which that message is placed after processing.
15. A method according to claim 9 , further comprising:
identifying at least one of the duplicate and near duplicate messages for a common unique message as having a longest thread.
16. A method according to claim 15 , further comprising:
identifying the duplicate or near duplicate message with the longest thread, comprising:
identifying a number of thread markers for each of the duplicate and near duplicate messages for the common unique message; and
sorting the duplicate and near duplicate messages in order of increasing number of the thread markers.