Systems and methods for parallelized custom data-processing and search
This invention provides systems and methods for data processing by means of an ongoing background process on an end-user's computer. As a user receives and generates data, files are analyzed. A container file is opened into the volatile memory and its contents (including data and metadata) are extracted, without requiring an index to be created. The extracted components are analyzed based on predefined characteristics.
1. A computer-implemented method for processing data using a computer system, the method comprising:
opening a container file into a volatile memory;
extracting, using a first computer process, a first computer file from the container file without indexing the entire container file and without creating an index;
determining, using the first computer process, that the first computer file has a second computer file stored therein;
causing, using the first computer process, a second computer process to extract the second computer file;
extracting, using the second computer process, the second computer file;
determining, using the second computer process, that the second computer file satisfies a criterion defined by a user; and
indexing the second computer file into an index of files that satisfy the criterion defined by the user, which index comprises less than the entire container file.
2. The computer-implemented method of claim 1 , further comprising continually monitoring a target computer to automatically index, in real time, computer files of the container file by running, via a background process on one or more processors, each of the first computer process and the second computer process.
3. The computer-implemented method of claim 1 , wherein the computer system is configured to run, via a background process on one or more processors, at least the second process, so as to index, in real time, each such second computer file that satisfies the criterion defined by the user.
4. The computer-implemented method of claim 1 , wherein the criterion correlates the second computer file to an eDiscovery search, to produce an index of documents responsive to the eDiscovery search.
5. The computer-implemented method of claim 1 , wherein the criterion identifies the second computer file as containing indication of private financial details of an individual or health details of an individual.
6. The computer-implemented method of claim 1 , wherein the criterion identifies the second computer file as a cybersecurity threat.
7. The computer-implemented method of claim 1 , wherein the criterion identifies the second computer file as malware.
8. The computer-implemented method of claim 1 , wherein the criterion correlates the second computer file to a freedom of information request to produce an index of documents responsive to the freedom of information request.
9. The computer-implemented method of claim 1 , further comprising repeating the first computer process and the second computer process to index a plurality of computer files from the container file, wherein each file of said plurality of computer files from the container file comprises a second computer file that satisfies the criterion defined by a user.
10. The computer-implemented method of claim 1 , further comprising repeating the first computer process and the second computer process to index all computer files from the container file that satisfy the criterion defined by a user.
11. A computer-implemented system for processing data, the system comprising at least one processor coupled to a volatile memory, the at least one processor configured to:
open a container file into a volatile memory;
extract, using a first computer process, a first computer file from the container file without indexing the entire container file and without creating an index;
determine, using the first computer process, that the first computer file has a second computer file stored therein;
cause, using the first computer process, a second computer process to extract the second computer file;
extract, using the second computer process, the second computer file;
determine, using the second computer process, that the second computer file satisfies a criterion defined by a user; and
index the second computer file into an index of files that satisfy the criterion defined by the user, which index comprises less than the entire container file.
12. The computer-implemented system of claim 11 , wherein the at least one processor configured to:
continually monitor a target computer to automatically index, in real time, computer files of the container file by running, via a background process on one or more processors, each of the first computer process and the second computer process.
13. The computer-implemented system of claim 11 , wherein the at least one processor configured to:
run, via a background process, at least the second process, so as to index, in real time, each such second computer file that satisfies the criterion defined by the user.
14. The computer-implemented system of claim 11 , wherein the at least one processor configured to:
repeat the first computer process and the second computer process to index a plurality of computer files from the container file, wherein each file of said plurality of computer files from the container file comprises a second computer file that satisfies the criterion defined by a user.
15. The computer-implemented system of claim 11 , wherein the at least one processor configured to:
repeat the first computer process and the second computer process to index all computer files from the container file that satisfy the criterion defined by a user.
16. A non-transitory memory device having data stored thereon, the data comprising instructions which, when executed by a processor, cause the processor to perform a process, the process comprising:
opening a container file into a volatile memory;
extracting, using a first computer process, a first computer file from the container file without indexing the entire container file and without creating an index;
determining, using the first computer process, that the first computer file has a second computer file stored therein;
causing, using the first computer process, a second computer process to extract the second computer file;
extracting, using the second computer process, the second computer file;
determining, using the second computer process, that the second computer file satisfies a criterion defined by a user; and
indexing the second computer file into an index of files that satisfy the criterion defined by the user, which index comprises less than the entire container file.
17. The non-transitory memory device of claim 16 , wherein the process further comprises:
continually monitoring a target computer to automatically index, in real time, computer files of the container file by running, via a background process on one or more processors, each of the first computer process and the second computer process.
18. The non-transitory memory device of claim 16 , wherein the process further comprises:
running, via a background process on one or more processors, at least the second process, so as to index, in real time, each such second computer file that satisfies the criterion defined by the user.
19. The non-transitory memory device of claim 16 , wherein the process further comprises:
repeating the first computer process and the second computer process to index a plurality of computer files from the container file, wherein each file of said plurality of computer files from the container file comprises a second computer file that satisfies the criterion defined by a user.
20. The non-transitory memory device of claim 16 , wherein the process further comprises:
repeating the first computer process and the second computer process to index all computer files from the container file that satisfy the criterion defined by a user.