SYSTEMS AND METHODS FOR STRUCTURING DATA FROM UNSTRUCTURED ELECTRONIC DATA FILES
Computer implemented systems and methods are disclosed for structuring data from unstructured electronic data files. In accordance with some embodiments, an electronic data file including unstructured content associated with a legal process return is received and the unstructured content parsed. The unstructured content is parsed to identify one or more objects and properties based on a database ontology that are processed to generate an object model. A data report may be generated based on the identified objects and properties.
1 . A system comprising:
one or more computer processors; and
one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the system to perform operations comprising:
determining, based on scanning a header of an electronic data file, that the electronic data file includes data received from a first social media platform, the electronic data file including content;
identifying, from a plurality of database ontologies corresponding to a plurality of social media platforms, a database ontology corresponding to the social media platform associated with the electronic data file, the database ontology defining known data objects and corresponding property types for content received from the social media platform; and
parsing, based on the database ontology corresponding to the social media platform, the electronic data file into known data objects identified by the database ontology.
2 . The system of claim 1 , the operations further comprising:
generating a data report based on the parsing of the electronic data file.
3 . The system of claim 1 , wherein parsing the electronic data file into known data objects comprises:
identifying a first string in the content;
comparing the first string to the known data objects defined in the database ontology corresponding to the social media platform, yielding a comparison;
determining, based on the comparison, that the first string matches a first known data object defined in the database ontology corresponding to the social media platform, the first data object being of a first data object type that is associated with a first property type; and
in response to determining that the first string matches the first known data object, identifying the first string as a first identified object in the content and assigning the first object type to the first string.
4 . The system of claim 3 , wherein parsing the electronic data file into known data objects further comprises:
identifying a second string that follows the first string in the content; and
identifying the second string as a first identified property of the first identified object in the content and assigning the first property type to the second string.
5 . The system of claim 1 , wherein the electronic data file associated with the legal process return is received in response to a legal process.
6 . The system of claim 5 , wherein the legal process includes at least one of a warrant, a national security letter, and a subpoena.
7 . The system of claim 4 , wherein the first identified data object is a private message, and the first identified property is an identifier included in the private message.
8 . The system of claim 2 , wherein the data report includes at least one of a list of histogramed telephone number data report, a conversation reconstructed from one or more private messages, a login information data report, a picture mapping data report, and a shared IP address data report.
9 . A method comprising:
determining, based on scanning a header of an electronic data file, that the electronic data file includes data received from a first social media platform, the electronic data file including content;
identifying, from a plurality of database ontologies corresponding to a plurality of social media platforms, a database ontology corresponding to the social media platform associated with the electronic data file, the database ontology defining known data objects and corresponding property types for content received from the social media platform; and
parsing, based on the database ontology corresponding to the social media platform, the electronic data file into known data objects identified by the database ontology.
10 . The method of claim 9 , further comprising:
generating a data report based on the parsing of the electronic data file.
11 . The method of claim 9 , wherein parsing the electronic data file into known data objects comprises:
identifying a first string in the content;
comparing the first string to the known data objects defined in the database ontology corresponding to the social media platform, yielding a comparison;
determining, based on the comparison, that the first string matches a first known data object defined in the database ontology corresponding to the social media platform, the first data object being of a first data object type that is associated with a first property type; and
in response to determining that the first string matches the first known data object, identifying the first string as a first identified object in the content and assigning the first object type to the first string.
12 . The method of claim 11 , wherein parsing the electronic data file into known data objects further comprises:
identifying a second string that follows the first string in the content; and
identifying the second string as a first identified property of the first identified object in the content and assigning the first property type to the second string.
13 . The method of claim 9 , wherein the electronic data file associated with the legal process return is received in response to a legal process.
14 . The method of claim 13 , wherein the legal process includes at least one of a warrant, a national security letter, and a subpoena.
15 . The method of claim 12 , wherein the first identified data object is a private message, and the first identified property is an identifier included in the private message.
16 . The method of claim 10 , wherein the data report includes at least one of a list of histogramed telephone number data report, a conversation reconstructed from one or more private messages, a login information data report, a picture mapping data report, and a shared IP address data report.
17 . A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of a computing system, cause the computing system to perform operations comprising:
determining, based on scanning a header of an electronic data file, that the electronic data file includes data received from a first social media platform, the electronic data file including content;
identifying, from a plurality of database ontologies corresponding to a plurality of social media platforms, a database ontology corresponding to the social media platform associated with the electronic data file, the database ontology defining known data objects and corresponding property types for content received from the social media platform; and
parsing, based on the database ontology corresponding to the social media platform, the electronic data file into known data objects identified by the database ontology.
18 . The non-transitory computer-readable medium of claim 17 , the operations further comprising:
generating a data report based on the parsing of the electronic data file.
19 . The non-transitory computer-readable medium of claim 17 , wherein parsing the electronic data file into known data objects comprises:
identifying a first string in the content;
comparing the first string to the known data objects defined in the database ontology corresponding to the social media platform, yielding a comparison;
determining, based on the comparison, that the first string matches a first known data object defined in the database ontology corresponding to the social media platform, the first data object being of a first data object type that is associated with a first property type; and
in response to determining that the first string matches the first known data object, identifying the first string as a first identified object in the content and assigning the first object type to the first string.
20 . The non-transitory computer-readable medium of claim 19 , wherein parsing the electronic data file into known data objects further comprises:
identifying a second string that follows the first string in the content; and
identifying the second string as a first identified property of the first identified object in the content and assigning the first property type to the second string.