Discovery of sensitive data location in data sources using business/enterprise application data flows
A plurality of users connect to an application sending requests over a transport and receiving responses from an application that contain sensitive data. For each user request, the application runs one or more data requests and commands to various data sources or other information systems which return the sensitive data. The application then processes the data and returns is to the user as is or processed based on some business logic. The application includes a run-time environment—where the application logic is executed.
1. A method for discovering sensitive data, in a system comprising a user application, one or more application servers and a data source in communication through a computer network, the application server operating an application agent, the method comprising:
a. Selecting or indicating sensitive data in a user request by determining said user request with regard to operation of the user application or an application program interface (API) request;
b. Detecting a data flow, comprising a data request from the user application and a data response from the data source by the application agent;
c. Recording said data flow, including the data request and the data response;
d. Locating the sensitive data in the recording; and
e. Determining a data lineage for the sensitive data, including each communication between the user application and the data source, said data lineage comprising a set of events in sequence, said events comprising said interactions between the user application and the data source, and data transacted during said events,
f. wherein said locating the sensitive data further comprises determining a pattern of the sensitive data within total data communicated and determining metadata for the sensitive data, including for each sensitive source data element, a title, sensitivity score, various classifications, a request URI, the sensitivity and classification of the data element.
2. The method of claim 1 , further comprising determining a policy for locating the sensitive data in interactions between the user application, the application server and the data source, according to said data lineage and said metadata.
3. The method of claim 2 , wherein said determining said policy comprises determining the policy according to said data request from said user application and/or said data response.
4. A method for discovering sensitive data, in a system comprising a user application, an application server, and a data source in communication through a computer network, the application server operating an application agent, the method comprising:
a. selecting or indicating sensitive data in a user request by determining said user request with regard to operation of the user application or an application program interface (API) request;
b. detecting a data flow, comprising a data request from the user application and a data response from the data source by the application agent;
c. recording said data flow, including the data request and the data response;
d. locating the sensitive data in the recording, wherein locating the sensitive data comprises determining a pattern of the sensitive data within total data communicated, and wherein locating the sensitive data further comprises data element, a title, sensitivity score, various classifications, a request URI, the sensitivity and classification of the data element; and
e. determining a data lineage for the sensitive data, including each communication between the user application and the data source, said data lineage comprising a set of events in sequence, said events comprising said interactions between the user application and the data source, and data transacted during said events.