APPARATUSES, METHODS, AND COMPUTER PROGRAM PRODUCTS FOR AUTOMATIC EXTRACTION OF DATA
Apparatuses, methods, and computer program products are provided for extracting data from a data platform using a generic extraction code that derives relationships between different items of data based on the code structure itself (e.g., the structure of the stored data) to determine the relevant topic records for extraction. The extraction code is instantiated using the requested data type by calling a generic extraction code, accessing relationship data associated with serialized data stored in a data platform using the generic extraction code, such as with reference to an ontology library of the API. A type of a data item and a relationship of the data item with other data items stored in the data platform may thus be determined based on a structure of the serialized data accessed. A requested data item is then extracted from the data platform using the instantiated extraction code.
1 . An apparatus for extracting data stored in a data platform, the apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the processor, cause the apparatus to at least:
receive a request to extract data, wherein the request includes a requested data type;
instantiate an extraction code using the requested data type, wherein instantiating the extraction code comprises calling a generic extraction code, and accessing relationship data associated with serialized data stored in a data platform using the generic extraction code, wherein the relationship data is defined in an ontology library, wherein the relationship data is indicative of a structure of the serialized data accessed; and
extract a requested data item from the data platform using the instantiated extraction code.
2 . The apparatus of claim 1 , wherein the at least one memory and the computer program code are configured to, with the processor, cause the apparatus to extract the requested data item by extracting each data item related to the requested data type based on the relationship of the data item determined.
3 . The apparatus of claim 1 , wherein the at least one memory and the computer program code are configured to, with the processor, cause the apparatus to instantiate the extraction code by accessing definitions of protocol objects in a protocol buffer code used to serialize the serialized data.
4 . The apparatus of claim 1 , wherein the apparatus comprises the ontology library.
5 . The apparatus of claim 1 , wherein the request to extract data is a batch request.
6 . The apparatus of claim 1 , wherein the at least one memory and the computer program code are further configured to, with the processor, cause the apparatus to extract the requested data item by generating a JSON file.
7 . The apparatus of claim 1 , wherein the generic extraction code is in C# or Java programming language.
8 . A method for extracting data stored in a data platform, the method comprising:
receiving a request to extract data, wherein the request includes a requested data type;
instantiating an extraction code using the requested data type, wherein instantiating the extraction code comprises:
calling a generic extraction code, and
accessing relationship data associated with serialized data stored in a data platform using the generic extraction code,
wherein the relationship data is defined in an ontology library, wherein the relationship data is indicative of a structure of the serialized data accessed; and
extracting a requested data item from the data platform using the instantiated extraction code.
9 . The method of claim 8 , wherein extracting the requested data item comprises extracting each data item related to the requested data type based on the relationship of the data item determined.
10 . The method of claim 8 , wherein instantiating the extraction code comprises accessing definitions of protocol objects in a protocol buffer code used to serialize the serialized data.
11 . The method of claim 8 , wherein an apparatus running the extraction code comprises the ontology library.
12 . The method of claim 8 , wherein the request to extract data is a batch request.
13 . The method of claim 8 , wherein extracting the requested data item comprises generating a JSON file.
14 . A computer program product for extracting data stored in a data platform, wherein the computer program product comprises at least one non-transitory computer-readable storage medium having computer-executable program code portions stored therein, the computer-executable program code portions comprising program code instructions for:
receiving a request to extract data, wherein the request includes a requested data type;
instantiating an extraction code using the requested data type, wherein instantiating the extraction code comprises:
calling a generic extraction code, and
accessing relationship data associated with serialized data stored in a data platform using the generic extraction code,
wherein the relationship data is defined in an ontology library, wherein the relationship data is indicative of a structure of the serialized data accessed; and
extracting a requested data item from the data platform using the instantiated extraction code.
15 . The computer program product of claim 14 , wherein the program code instructions for extracting the requested data item further comprise program code instructions for extracting each data item related to the requested data type based on the relationship of the data item determined.
16 . The computer program product of claim 14 , wherein the program code instructions for instantiating the extraction code further comprise program code instructions for accessing definitions of protocol objects in a protocol buffer code used to serialize the serialized data.
17 . The computer program product of claim 14 , wherein an apparatus executing the program code instructions for instantiating the extraction code comprises the ontology library.
18 . The computer program product of claim 14 , wherein the request to extract data is a batch request.
19 . The computer program product of claim 14 , wherein the program code instructions for extracting the requested data item further comprise program code instructions for generating a JSON file.
20 . The computer program product of claim 14 , wherein the generic extraction code is in C# or Java programming language.