Managing heterogeneous data
View Patent ↗Methods of managing data. A master catalog of properties may be generated. An object model catalog containing a plurality of object models may be generated, each object model including at least one property listed in the master catalog. A data set including a plurality of data objects may be defined, each data object an instantiation of a respective object model from the object model catalog. Data may be collected in accordance with the data set definition. Data collection may be performed, at least in part, by an automatic data collection system.
1. A method of managing heterogeneous data, comprising:
generating a master catalog listing a plurality of properties, each property of the plurality of properties representing a data item, each property of the plurality of properties including at least one attribute defining the represented data item and two or more profiles indicating how the data item is managed, the profiles including a collection profile indicating how the represented data item is collected and a storage profile indicating how the represented data item is stored, wherein the master catalog and the object model catalog are be written in extensible markup language or another markup language;
preparing an object model catalog containing a plurality of object models, each object model of the plurality of object models including at least one property listed in the master catalog;
defining a data set definition including a plurality of data objects, each data object contains an instantiation of a respective object model from the object model catalog, the data set definition including multiple instantiations of at least one object model; and
collecting data in accordance with the data set definition, collecting data performed, at least in part, by an automatic data collection system, wherein the collecting data comprises: parsing the data set definition and associated object models and properties to provide instructions for the automatic data collection system;
generating reports based on the collected data, wherein the generating reports include referring to the data set definition;
and retrieving, from the master catalog, attributes and profiles for the properties used in the data set definition to determine how each data item is collected and stored.
2. The method of claim 1 , wherein the at least one attribute includes a unique identifier.
3. The method of claim 2 , wherein the at least one attribute also includes a data type.
4. The method of claim 1 , further comprising:
selecting the collection profile from a first plurality of predetermined profiles defining respective data collection techniques; and
selecting the storage profile from a second plurality of predetermined profiles defining respective data storage techniques.
5. The method of claim 4 , wherein
the two or more profiles include a third profile in addition to the collection profile and the storage profile,
the third profile selected from a third plurality of predetermined profiles.
6. The method of claim 1 , wherein generating reports is performed, at least in part, by an automatic report generator.
7. A method of managing heterogeneous data, comprising:
defining a data set definition including a plurality of data objects, each data object contains an instantiation of a respective object model from an object model catalog of a plurality of object models, the data set definition including multiple instantiations of at least one object model, each model of the plurality of object models including at least one property from a master catalog listing a plurality of properties, wherein the master catalog lists all properties included in the plurality of object models,
wherein
each property of the plurality of properties represents a data item,
each property of the plurality of properties includes at least one attribute defining the represented data item,
each property of the plurality of properties includes two or more profiles indicating how the data item is managed, the two or more profiles including a collection profile indicating how the represented data item is collected and a storage profile indicating how the represented data item is stored, and
the master catalog and the object model catalog are written in extensible markup language or another markup language;
collecting data in accordance with the data set definition, collecting data performed, at least in part, by an automatic data collection system, the collecting data including parsing the data set definition and associated object models and properties to provide instructions for the automatic data collection system; and
generating reports based on the collected data, generating reports including referring to the data set definition and retrieving, from the master catalog, attributes and profiles for the properties used in the data set definition to determine how each data item is collected and stored.
8. The method of claim 7 , wherein the at least one attribute includes a unique identifier.
9. The method of claim 8 , wherein the at least one attribute also includes a data type.
10. The method of claim 7 , wherein
the collection profile is one of a first plurality of predetermined profiles defining respective data collection techniques, and
the storage profile is one of a second plurality of predetermined profiles defining respective data storage techniques.
11. The method of claim 10 , wherein
the two or more profiles include a third profile in addition to the collection profile and the storage profile,
the third profile is one of a third plurality of predetermined profiles.
12. The method of claim 7 , wherein generating reports is performed, at least in part, by an automatic report generator.