Information uniqueness assessment using string-based collection frequency
Techniques are provided for assessing uniqueness of information using string-based collection frequency techniques. One method comprises obtaining multiple collections of documents from at least one data source; determining a collection frequency for a given character string based on a number of the collections comprising the given character string relative to a total number of the collections; assigning a uniqueness rating to the given character string based at least in part on a comparison of the collection frequency of the given character string to a collection frequency of one or more additional character strings in one or more of the plurality of collections; and performing an automated action using the given character string based on the assigned uniqueness rating. The automated action may comprise protecting the given character string and/or identifying the given character string as important information satisfying one or more importance criteria.
1. A method comprising:
obtaining a plurality of documents from at least one data source;
evaluating the plurality of documents for a given level, of a plurality of levels, to identify a plurality of collections of documents, wherein the given level is a level of interest to a given user;
determining a collection frequency, within the given level, for a given character string based at least in part on: (i) a number of the collections of documents within the given level comprising the given character string, wherein an existence of the given character string in one or more of the collections of documents, of the plurality of collections of documents, within the given level has a count of one for each collection of documents comprising one or more instances of the given character string, relative to (ii) a total number of the collections of documents within the given level in the plurality of collections;
assigning a uniqueness rating to the given character string for the given level based at least in part on a comparison of: (a) the collection frequency of the given character string within the given level, to (b) a collection frequency of one or more additional character strings within the given level in one or more of the plurality of collections; and
performing at least one automated action using the given character string based at least in part on the assigned uniqueness rating;
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.
2. The method of claim 1 , wherein the at least one automated action comprises protecting the given character string.
3. The method of claim 2 , wherein the protecting the given character string comprises one or more of: (i) anonymizing the given character string in response to the given character string satisfying one or more uniqueness criteria, and (ii) preventing a disclosure of the given character string in response to the given character string satisfying one or more uniqueness criteria.
4. The method of claim 1 , wherein the at least one automated action comprises identifying the given character string as important information satisfying one or more importance criteria.
5. The method of claim 1 , wherein the uniqueness rating is determined for one or more of the plurality of levels of the collections of documents.
6. The method of claim 1 , wherein the uniqueness rating of the given character string is assessed by ranking the collection frequency of the given character string and the collection frequency of the one or more additional character strings in one or more of the plurality of collections of documents.
7. The method of claim 1 , wherein the plurality of levels comprises two or more of a company level, a region level, a system level, a sub-system level and a component level.
8. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured to implement the following steps:
obtaining a plurality of documents from at least one data source;
evaluating the plurality of documents for a given level, of a plurality of levels, to identify a plurality of collections of documents, wherein the given level is a level of interest to a given user;
determining a collection frequency, within the given level, for a given character string based at least in part on: (i) a number of the collections of documents within the given level comprising the given character string, wherein an existence of the given character string in one or more of the collections of documents, of the plurality of collections of documents, within the given level has a count of one for each collection of documents comprising one or more instances of the given character string, relative to (ii) a total number of the collections of documents within the given level in the plurality of collections;
assigning a uniqueness rating to the given character string for the given level based at least in part on a comparison of: (a) the collection frequency of the given character string within the given level, to (b) a collection frequency of one or more additional character strings within the given level in one or more of the plurality of collections; and
performing at least one automated action using the given character string based at least in part on the assigned uniqueness rating.
9. The apparatus of claim 8 , wherein the at least one automated action comprises protecting the given character string.
10. The apparatus of claim 9 , wherein the protecting the given character string comprises one or more of: (i) anonymizing the given character string in response to the given character string satisfying one or more uniqueness criteria, and (ii) preventing a disclosure of the given character string in response to the given character string satisfying one or more uniqueness criteria.
11. The apparatus of claim 8 , wherein the at least one automated action comprises identifying the given character string as important information satisfying one or more importance criteria.
12. The apparatus of claim 8 , wherein the uniqueness rating is determined for one or more of the plurality of levels of the collections of documents.
13. The apparatus of claim 8 , wherein the uniqueness rating of the given character string is assessed by ranking the collection frequency of the given character string and the collection frequency of the one or more additional character strings in one or more of the plurality of collections of documents.
14. The apparatus of claim 8 , wherein the plurality of levels comprises two or more of a company level, a region level, a system level, a sub-system level and a component level.
15. A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform the following steps:
obtaining a plurality of documents from at least one data source;
evaluating the plurality of documents for a given level, of a plurality of levels, to identify a plurality of collections of documents, wherein the given level is a level of interest to a given user;
determining a collection frequency, within the given level, for a given character string based at least in part on: (i) a number of the collections of documents within the given level comprising the given character string, wherein an existence of the given character string in one or more of the collections of documents, of the plurality of collections of documents, within the given level has a count of one for each collection of documents comprising one or more instances of the given character string, relative to (ii) a total number of the collections of documents within the given level in the plurality of collections;
assigning a uniqueness rating to the given character string for the given level based at least in part on a comparison of: (a) the collection frequency of the given character string within the given level, to (b) a collection frequency of one or more additional character strings within the given level in one or more of the plurality of collections; and
performing at least one automated action using the given character string based at least in part on the assigned uniqueness rating.
16. The non-transitory processor-readable storage medium of claim 15 , wherein the at least one automated action comprises protecting the given character string.
17. The non-transitory processor-readable storage medium of claim 16 , wherein the protecting the given character string comprises one or more of: (i) anonymizing the given character string in response to the given character string satisfying one or more uniqueness criteria, and (ii) preventing a disclosure of the given character string in response to the given character string satisfying one or more uniqueness criteria.
18. The non-transitory processor-readable storage medium of claim 15 , wherein the at least one automated action comprises identifying the given character string as important information satisfying one or more importance criteria.
19. The non-transitory processor-readable storage medium of claim 15 , wherein the uniqueness rating is determined for one or more of the plurality of levels of the collections of documents.
20. The non-transitory processor-readable storage medium of claim 15 , wherein the uniqueness rating of the given character string is assessed by ranking the collection frequency of the given character string and the collection frequency of the one or more additional character strings in one or more of the plurality of collections of documents.