Importing data using metadata
View Patent ↗A method and system for importing data into a data store in accordance with metadata. The import system provides metadata that specifies how the import data for various types of import sources is to be imported into the data store. The import sources may be categorized according to the type of data provided by the import sources. When the import system receives the import data from the import source, it identifies the type of import source and retrieves the metadata defined for that type of import source. The import system then imports the received import data into the data store in accordance with the retrieved metadata.
1. A method in a computer system for importing import data into a data store, the method comprising:
providing metadata that defines a schema for the data store and defines how the import data is to be stored in the data store;
receiving import data to be stored in the data store;
after receiving the import data, generating the data store in accordance with the schema defined by the provided metadata; and
storing data into the generated data store in accordance with how the import data is to be stored in the data store as indicated by the provided metadata
wherein the metadata includes an indication of a name of each table of the data store,
wherein the metadata includes for each table of the data store and indication of each property of the table, and
wherein the metadata includes an attribute for each property indicating whether that property should be included in a hash value.
2. A method in a computer system for importing import data into a data store, the method comprising:
providing metadata that defines a schema for the data store and defines how the import data is to be stored in the data store;
receiving import data to be stored in the data store;
after receiving the import data, generating the data store in accordance with the schema defined by the provided metadata; and
storing data into the generated data store in accordance with how the import data is to be stored in the data store as indicated by the provided metadata
wherein the metadata includes an indication of a name of each table of the data store,
wherein the metadata includes for each table of the data store and indication of each property of the table, and
wherein the metadata includes an attribute for each property indicating whether that property should be includes in a key.
3. A method in a computer system for importing import data into a data store, the method comprising:
providing metadata that defines a schema for the data store and defines how the import data is to be stored in the data store;
receiving import data to be stored in the data store;
after receiving the import data, generating the data store in accordance with the schema defined by the provided metadata; and
storing data into the generated data store in accordance with how the import data is to be stored in the data store as indicated by the provided metadata
wherein the metadata includes an indication of a name of each table of the data store,
wherein the metadata includes for each table of the data store and indication of each property of the table, and
wherein the metadata include an attribute for each property indicating whether a value for that property should be derived from a related dimension table.
4. A method in a computer system for importing import data into a data store, the method comprising:
providing metadata that defines a schema for the data store and defines how the import data is to be stored in the data store;
receiving import data to be stored in the data store;
after receiving the import data, generating the data store in accordance with the schema defined by the provided metadata; and
storing data into the generated data store in accordance with how the import data is to be stored in the data store as indicated by the provided metadata
wherein the metadata includes an indication of a name of each table of the data store,
wherein the metadata includes for each table of the data store and indication of each property of the table, and
wherein the metadata includes an attribute for each property indicating whether the import data for that property should be grouped into buckets.
5. A computer system for importing import data into a data store, comprising:
metadata store containing metadata that defines a schema for the data store and defines how the import data is to be stored in the data store;
import data store containing import data to be stored in the data store;
a data store generating component that generates the data store in accordance with the schema defined by the metadata; and
a storing component that stores data into the generated data store in accordance with how the import data is to be stored in the data store as indicated by the metadata
wherein the metadata includes an indication of a name of each table of the data store,
wherein the metadata includes for each table of the data store an indication of each property of the table, and
wherein the metadata includes an attribute for each property indicating whether that property should be included in a hash value.
6. A computer system for importing import data into a data store, comprising:
metadata store containing metadata that defines a schema for the data store and defines how the import data is to be stored in the data store;
import data store containing import data to be stored in the data store;
a data store generating component that generates the data store in accordance with the schema defined by the metadata; and
a storing component that stores data into the generated data store in accordance with how the import data is to be stored in the data store as indicated by the metadata
wherein the metadata includes an indication of a name of each table of the data store,
wherein the metadata includes for each table of the data store an indication of each property of the table, and
wherein the metadata includes an attribute for each property indicating whether that property should be includes in a key.
7. A computer system for importing import data into a data store, comprising:
metadata store containing metadata that defines a schema for the data store and defines how the import data is to be stored in the data store;
import data store containing import data to be stored in the data store;
a data store generating component that generates the data store in accordance with the schema defined by the metadata; and
a storing component that stores data into the generated data store in accordance with how the import data is to be stored in the data store as indicated by the metadata
wherein the metadata includes an indication of a name of each table of the data store,
wherein the metadata includes for each table of the data store an indication of each Property of the table, and
wherein the metadata include an attribute for each property indicating whether a value for that property should be derived from a related dimension table.
8. A computer system for importing import data into a data store, comprising:
metadata store containing metadata that defines a schema for the data store and defines how the import data is to be stored in the data store;
import data store containing import data to be stored in the data store;
a data store generating component that generates the data store in accordance with the schema defined by the metadata; and
a storing component that stores data into the generated data store in accordance with how the import data is to be stored in the data store as indicated by the metadata
wherein the metadata includes an indication of a name of each table of the data store,
wherein the metadata includes for each table of the data store an indication of each Property of the table, and
wherein the metadata includes an attribute for each property indicating whether the import data for that property should be grouped into buckets.