Method and apparatus for autonomic discovery of sensitive content
View Patent ↗A data loss prevention (DLP) system provides a policy-based mechanism for managing how data is discovered and classified on an endpoint workstation, file server or other device within an enterprise. The technique described herein works in an automated manner by analyzing file system activity as one or more endpoint applications interact with a file system to build a statistical model of which areas of the file system are (or will be deemed to be) active or highly active. Using this information, scanning to those areas by the DLP software is then prioritized appropriately to focus compute resources on scanning and classifying preferably only those files and folders that are necessary to be scanned, i.e., the file system portions in which the user is applying the majority of his or her activity. As a result, the technique limits scanning to only those areas that have meaningful activity (thereby conserving compute resources with respect to files or folders that have not changed), improving scanning efficiency.
1. A method, operative at or in association with an endpoint in a data loss prevention (DLP) system, the DLP system executing at least in part on hardware and operative to perform scans of resources in a file system associated with the endpoint to search for sensitive content, the scans including an ordered set of scans that include a last scan followed by a next scan, comprising:
following the last scan:
obtaining information identifying an identity of a resource being accessed; and
updating a statistical model of resource access and usage based on the obtained information, the statistical model including, with respect to a resource, a count of resource accesses since the last scan; and
prior to initiating the next scan, prioritizing resources for further scanning for sensitive content based at least in part on resource access counts in the statistical model and one or more content sensitivity classifications associated with one or more resources.
2. The method as described in claim 1 wherein prioritizing is based on a scoring algorithm.
3. The method as described in claim 2 wherein the scoring algorithm applies at least one weight to a resource access count.
4. The method as described in claim 3 , wherein the particular resource access count includes a read count, and a write count.
5. The method as described in claim 4 , wherein the scoring algorithm applies one or more weights against one of: the read count, and the write count.
6. The method as described in claim 5 , wherein, with respect to given resource, the scoring algorithm applies separate weightings to the read count and the write count.
7. The method as described in claim 1 wherein the resource being accessed is a file or folder of a file system.
8. The method as described in claim 1 further including conducting the next scan of the resources, in order of access activity as indicated in the statistical model, until a completion milestone is reached.
9. The method as described in claim 8 wherein the completion milestone is one of: scanning of all resources represented in the statistical model, completion of an allocated time period, completion of a scan of a predetermined number of resources, and completion of a scan of resources having an access count that exceeds a threshold.
10. The method as described in claim 1 wherein the information is obtained by intercepting a system application programming interface (API) call.
11. An apparatus, operative at or in association with an endpoint in a data loss prevention (DLP) system, the DLP system operative to perform scans of resources in a file system associated with the endpoint to search for sensitive content, the scans including an ordered set of scans that include a last scan followed by a next scan, comprising:
a processor;
computer memory holding computer program instructions executed by the processor and operative:
following the last scan:
to obtain information identifying an identity of a resource being accessed; and
to update a statistical model of resource access and usage based on the obtained information, the statistical model including, with respect to a resource, a count of resource accesses since the last scan; and
prior to initiating the next scan, to prioritize resources for further scanning for sensitive content based at least in part on resource access counts in the statistical model and one or more content sensitivity classifications associated with one or more resources.
12. The apparatus as described in claim 11 wherein prioritizing is based on a scoring algorithm.
13. The apparatus as described in claim 12 wherein the scoring algorithm applies at least one weight to a resource access count.
14. The apparatus as described in claim 11 wherein the resource being accessed is a file or folder of a file system.
15. The apparatus as described in claim 11 wherein the computer program instructions are further operative to conduct the next scan of the resources, in order of access activity as indicated in the statistical model, until a completion milestone is reached.
16. The apparatus as described in claim 15 wherein the completion milestone is one of: scanning of all resources represented in the statistical model, completion of an allocated time period, completion of a scan of a predetermined number of resources, and completion of a scan of resources having an access count that exceeds a threshold.
17. The apparatus as described in claim 11 wherein the information is obtained by intercepting a system application programming interface (API) call.
18. A non-transitory computer readable storage medium comprising a computer program product for use in a data processing system operative at or in association with an endpoint in a data loss prevention (DLP) system, the DLP system operative to perform scans of resources in a file system associated with the endpoint to search for sensitive content, the scans including an ordered set of scans that include a last scan followed by a next scan, the computer program product holding computer program instructions which, when executed by the data processing system, perform a method comprising:
following the last scan:
obtaining information identifying an identity of a resource being accessed; and
updating a statistical model of resource access and usage based on the obtained information, the statistical model including, with respect to a resource, a count of resource accesses since the last scan; and
prior to initiating the next scan, prioritizing resources for further scanning for sensitive content based at least in part on resource access counts in the statistical model and one or more content sensitivity classifications associated with one or more resources.
19. The non-transitory computer readable storage medium as described in claim 18 wherein prioritizing is based on a scoring algorithm.
20. The non-transitory computer readable storage medium as described in claim 19 wherein the scoring algorithm applies at least one weight to a resource access count.
21. The non-transitory computer readable storage medium as described in claim 18 wherein the resource being accessed is a file or folder of a file system.
22. The non-transitory computer readable storage medium as described in claim 18 wherein the method further includes conducting the next scan of the resources, in order of access activity as indicated in the statistical model, until a completion milestone is reached.
23. The non-transitory computer readable storage medium as described in claim 22 wherein the completion milestone is one of: scanning of all resources represented in the statistical model, completion of an allocated time period, completion of a scan of a predetermined number of resources, and completion of a scan of resources having an access count that exceeds a threshold.
24. The non-transitory computer readable storage medium as described in claim 18 wherein the information is obtained by intercepting a system application programming interface (API) call.