EMULATION OF RELATIONAL DATA TABLE RELATIONSHIPS USING A SCHEMA
A method and system for converting relational table data to a schema structure in a schema record of a referencing the relational table. A record of a table is identified that references the relational table, and a portion of a schema describing the record is updated to include the relevant data of the relational table as a hierarchical level of the record schema. The schema element includes data elements of the relational table relevant to the record, each element having its own type. As additional records of the same table that are related to the relational table are called, the schema element may be updated to include additional relational table data elements.
1 . A data storage device, comprising:
one or more memory modules; and
a controller comprising a processor configured to perform a method for data schema detection and migration, the method comprising:
identifying in a record of a file, a relationship to a second file comprising a plurality of records associated with the record;
creating a schema for the record, that includes a schema for the plurality of records of the second file;
converting the file and the second file to a table according to the schema; and
storing the table and schema in the one or more memory modules.
2 . The data storage device of claim 1 , wherein the schema comprises a hierarchical level comprising a data element of each of the plurality of records.
3 . The data storage device of claim 2 , wherein the method further comprises:
identifying in a record of the second file, a second relationship to a third file comprising a plurality of third records associated with the record of the second file; and
creating within the schema a second hierarchical level comprising a data element of each of the plurality of third child records.
4 . The data storage device of claim 3 , wherein the method further comprises identifying a mismatched field, comprising a field of the file that is not matched to a the schema element or a second schema element.
5 . The data storage device of claim 2 , wherein the mismatched field comprises one of a new field type, a changed field type, and a missing field type.
6 . The data storage device of claim 2 , wherein the schema is updated to an updated schema based on the mismatched field type.
7 . The data storage device of claim 6 , wherein previously converted records of the file are converted based on the updated schema.
8 . A controller for a data storage device, comprising:
an I/O to one or more memory devices; and
a processor configured to execute a method for data schema detection and migration, the method comprising:
receiving a file comprising a plurality of records;
detecting a relationship between at least one of the plurality of records to a second file comprising a plurality of second records;
defining a schema for the file that includes a reference to a data element of at least two of the plurality of second records;
converting the file and second file to a serialized format file; and
storing the serialized format file and the schema.
9 . The controller of claim 8 , the method further comprising wherein the relationship is removed.
10 . The controller of claim 9 , the method further comprising wherein the reference is listed in a hierarchical level of the schema.
11 . The controller of claim 10 , wherein the method further comprises defining a data table based on the serialized format file and the schema.
12 . The controller of claim 11 , wherein the method further comprises executing one of a query, a record insert, a record update, and a record deletion, on the data table.
13 . The controller of claim 11 , wherein the method further comprises detecting a field mismatch comprising one of detecting a new field not present in the schema, a change of data type, or a missing field.
14 . The controller of claim 13 , wherein the method further comprises generating a new schema by updating the schema based on the field mismatch, wherein updating the schema comprises one of:
updating the schema to include the new field;
updating the data type; and
updating the schema field designation to one of required and optional.
15 . The controller of claim 14 , wherein the method further comprises updating the data table based on the new schema.
16 . The controller of claim 14 , wherein the method further comprises converting additional data from the file to the data table, based on the new schema.
17 . The controller of claim 8 , wherein the method further comprises identifying a type of one of the plurality of field-delimited units of as one of hierarchy, repeated, and optional.
18 . A system for storing data, comprising:
one or more memory means; and
an SSD controller means configured to carry out a method for data schema detection and migration, the method comprising:
detecting a field hierarchy of a file and a reference to a second file comprising a second data element;
defining a schema means based on the field hierarchy, the schema means comprising a data type of the second data element; and
defining a data table based on the schema means, the file, and the second file.
19 . The system of claim 18 , wherein the reference is one of a one to many relationship, a many to many relationship, and a one to one relationship.
20 . The system of claim 18 , wherein one of the file and the second file is an SQL formatted file, and the data table is in a Binary XML Protobuf (BXP) format.