Data processing and scanning systems for generating and populating a data inventory
In particular embodiments, a data processing data inventory generation system is configured to: (1) generate a data model (e.g., a data inventory) for one or more data assets utilized by a particular organization; (2) generate a respective data inventory for each of the one or more data assets; and (3) map one or more relationships between one or more aspects of the data inventory, the one or more data assets, etc. within the data model. In particular embodiments, a data asset (e.g., data system, software application, etc.) may include, for example, any entity that collects, processes, contains, and/or transfers personal data (e.g., such as a software application, “internet of things” computerized device, database, website, data-center, server, etc.). The system may be configured to identify particular data assets and/or personal data in data repositories using any suitable intelligent identity scanning technique.
1. A computer-implemented data processing method for scanning one or more data repositories to identify one or more attributes of data associated with one or more individuals, the method comprising:
connecting, by one or more processors, via one or more computer networks, to one or more databases;
scanning, by one of more processors, the one or more databases to generate a catalog of one or more individuals and one or more pieces of personal information associated with the one or more individuals;
storing the catalog in computer memory;
scanning one or more data repositories based at least in part on the generated catalog to identify one or more attributes of data associated with the one or more individuals by searching one or more data fields in the one or more databases for the one or more pieces of personal information;
analyzing and correlating the one or more attributes and metadata for the scanned one or more data repositories;
using one or more machine learning techniques to categorize one or more data elements from the generated catalog;
analyzing a flow of the one or more data elements between the one or more data repositories and at least one known data asset; and
modifying an existing data model of data assets to include an attribute defined by the one or more data elements; and
electronically linking the at least one known data asset and the attribute in the existing data model of data assets.
2. The computer-implemented data processing method of claim 1 , further comprising:
providing a software application for installation on a computing device that is networked with the one or more data repositories associated with an organization; and
providing a communication channel between one or more remote scanning servers and the software application, wherein:
the software application is configured to communicate with the one or more remote scanning servers through a firewall; and
the software application is configured to transmit the one or more attributes of data associated with the one or more individuals to the one or more remote scanning servers.
3. The computer-implemented data processing method of claim 2 , wherein the step of categorizing the one or more data elements is performed by the one or more remote scanning servers.
4. The computer-implemented data processing method of claim 2 , wherein the software application comprises at least one virtual machine configured to perform the step of scanning the one or more data repositories based at least in part on the generated catalog.
5. The computer-implemented data processing method of claim 4 , wherein the software application is configured to cause the computing device to perform the step of scanning the one or more data repositories during non-peak networking hours.
6. The computer-implemented data processing method of claim 1 , wherein using one or more machine learning techniques to categorize one or more data elements from the generated catalog comprises using the one or more machine learning techniques to determine whether the one or more data elements are associated with the one or more individuals.
7. The computer-implemented data processing method of claim 1 , further comprising analyzing the one or more data repositories to determine whether each particular data repository is part of the existing data model of data assets.
8. The computer-implemented data processing method of claim 7 , further comprising in response to determining that a particular repository of the one or more data repositories is not part of an existing data model:
generating a data inventory for the particular data repository;
populating the data inventory with the one or more data elements; and
storing the data inventory in computer memory.
9. The computer-implemented data processing method of claim 1 , wherein the catalog comprises one or more data fields selected from the group consisting of:
(1) name;
(2) address;
(3) telephone number;
(4) e-mail address;
(5) social security number;
(6) banking information; and
(7) location data.
10. The computer-implemented data processing method of claim 1 , the method further comprising performing the step of scanning the one or more data repositories during non-peak networking hours.
11. The computer-implemented data processing method of claim 1 , the method further comprising performing the step of scanning the one or more data repositories during non-peak processing hours.