Snippet matching in file sharing networks
View Patent ↗Techniques for matching information representing private files against files obtained from a public network.
1. A system for determining if sensitive private information has been leaked to a public network, the system comprising:
a computer including at least one processor, a memory, and a network interface;
a private digital file containing sensitive content produced by an application program; and
a private information matching process executing in the memory of the processor and configured to
receive the private digital file;
process the private digital file to generate snippet portions thereof, wherein the snippet portions each further include multiple rolling chunks of a digital file, with a first snippet portion containing a first chunk comprising a first set of words in the file, a second snippet portion containing a second chunk comprising a second set of words in the file with the second set of words including at least some of but not all of the words in the first set of words plus some other words from the file;
receive multiple public digital files via the network interface from a public network;
process the public digital files to generate snippet portions thereof; and
match the generated snippets of the private digital files against the generated snippets of the public digital files to determine if at least some of the content of the private digital file is accessible to other computers connected to the public network.
2. The system of claim 1 wherein the private information matching process is further configured to calculate a hash of the private file and the public files.
3. The system of claim 1 wherein the private information matching process is further configured to calculate hashes of each of the chunks of the private file and public files.
4. The system of claim 3 wherein the private information matching process is further configured to aggregate consecutive snippets of the private digital file that match corresponding consecutive snippets of at least one public digital file into at least one contiguous block of matching words.
5. The system of claim 1 wherein the private information matching process is further configured to displaying, via a user interface, indication of a private file and matched public files with a graphical indication of a percent match.
6. The system of claim 1 wherein the private digital file as received contains only a part of a content of an original digital file omitting at least some information and not complete content of the original digital file.
7. The system of claim 4 wherein the private information matching process is further configured to match the snippets of the private file against the snippets of public files to ignore designated conditions resulting from the match.
8. The system of claim 4 wherein the private information matching process is further configured to match the snippets of the private file against the snippets of the public files by considering a snippet class.
9. The system of claim 7 wherein the private information matching process is further configured to ignore repeating snippets in the public files.
10. A method for determining if sensitive private information has been leaked to a public network, the method comprising:
receiving a private digital file containing sensitive content produced by an application program;
processing, by a processor of a computer system, the private digital file to generate snippet portions thereof, wherein the snippet portions each further include multiple rolling chunks of a digital file, with a first snippet portion containing a first chunk comprising a first set of words in the file, a second snippet portion containing a second chunk comprising a second set of words in the file with the second set of words including at least some of but not all of the words in the first set of words plus some other words from the file;
receiving multiple public digital files from a public network;
processing the public digital files to generate snippet portions thereof; and
matching the generated snippets of the private digital files against the generated snippets of the public digital files to determine if at least some of the content of the private digital file is accessible to computers connected to the public network.
11. The method of claim 10 further comprising calculating a hash of the private file and the public files.
12. The method of claim 10 further comprising calculating hashes of each of the chunks of the private file and public files.
13. The method of claim 12 further comprising aggregating consecutive snippets of the private digital file that match corresponding consecutive snippets of at least one public digital file into at least one contiguous block of matching words.
14. The method of claim 10 further comprising displaying, via a user interface, indication of a private file and matched public files with a graphical indication of a percent match.
15. The method of claim 10 wherein the private digital file contains only a part of a content of an original digital file omitting at least some information and not complete content of the original digital file.
16. The method of claim 13 further comprising matching the snippets of the private file against the snippets of public files to ignore designated conditions resulting from the match.
17. The method of claim 13 further comprising matching the snippets of the private file against the snippets of the public files by considering a snippet class.
18. The system of claim 16 further comprising ignoring repeating snippets in the public files.