Multiple source data management using a conflict rule
View Patent ↗A solution for managing data received from multiple sources is provided. In particular, when conflicting data values are received from multiple sources for a data element, a conflict rule is used to determine the main data value for the data element, which is subsequently stored for use. The conflict rule can define any automatic, semi-automatic, or manual procedure for resolving the conflict. The conflict rule, or an identifier thereof, can be stored with each data value and the main data value for the data element.
1. A system for managing data received from a plurality of sources, the system comprising:
a system for obtaining a multi-dimensional set of data from each of the plurality of sources, each multi-dimensional set of data including a common data element;
a system for generating a main multi-dimensional set of data based on a combination of the sets of data, the system for generating including:
a system for obtaining a data value for the data element from each of the sets of data obtained from the plurality of sources;
a system for determining whether a conflict exists between the obtained data values;
a system for using a conflict rule to determine a main data value for the data element in the main multi-dimensional set of data when the conflict exists;
a system for storing a derivation record for the main data value for the data element in the main multi-dimensional set of data, the derivation record including: the main data value, the data value received from each of the plurality of sources, and the conflict rule;
a system for obtaining the stored derivation record;
a system for modifying the conflict rule, which is stored in the derivation record; and
a system for determining a new main data value using the modified conflict rule.
2. The system of claim 1 , further comprising a system for obtaining one of a plurality of conflict rules for use as the conflict rule for the data element.
3. The system of claim 1 , further comprising a system for using the data value as the main data value when the conflict does not exist.
4. The system of claim 1 , wherein the system for using includes a system for automatically selecting the data value received from one of the plurality of sources based on a corresponding priority for each of the plurality of sources.
5. The system of claim 1 , wherein the system for using includes:
a system for selecting the data value received from one of the plurality of sources based on a corresponding priority for each of the plurality of sources;
a system for presenting the selected data value for evaluation by at least one of the sources; and
a system for obtaining the main data value based on the evaluation.
6. The system of claim 1 , wherein the system for using includes:
a system for providing the plurality of data values for evaluation by a third party; and
a system for obtaining the main data value based on the evaluation.
7. A computer program comprising program code stored on a non-transitory computer-readable medium, which when executed, enables a computer system to implement a process for managing data received from a plurality of sources, the process comprising:
obtaining a multi-dimensional set of data from each of the plurality of sources, each multi-dimensional set of data including a common data element;
generating a main multi-dimensional set of data based on a combination of the sets of data, the generating including:
obtaining a data value for the data element from each of the sets of data obtained from the plurality of sources;
determining whether a conflict exists between the obtained data values;
using a conflict rule to determine a main data value for the data element in the main multi-dimensional set of data when the conflict exists;
storing a derivation record for the main data value for the data element in the main multi-dimensional set of data, the derivation record including: the main data value, the data value received from each of the plurality of sources, and the conflict rule;
obtaining the stored derivation record;
modifying the conflict rule, which is stored in the derivation record; and
determining a new main data value using the modified conflict rule.
8. The computer program of claim 7 , the process further comprising obtaining one of a plurality of conflict rules for use as the conflict rule for the data element.
9. The computer program of claim 7 , the process further comprising using the data value as the main data value when the conflict does not exist.
10. The computer program of claim 7 , wherein the using includes automatically selecting the data value received from one of the plurality of sources based on a corresponding priority for each of the plurality of sources.
11. The computer program of claim 7 , wherein the using includes:
selecting the data value received from one of the plurality of sources based on a corresponding priority for each of the plurality of sources;
presenting the selected data value for evaluation by at least one of the sources; and
obtaining the main data value based on the evaluation.
12. The computer program of claim 7 , wherein the using includes:
providing the plurality of data values for evaluation by a third party; and
obtaining the main data value based on the evaluation.
13. A method of generating a system for managing data received from a plurality of sources, the method comprising:
providing a computer system operable to:
obtain a multi-dimensional set of data from each of the plurality of sources, each multi-dimensional set of data including a common data element;
generate a main multi-dimensional set of data based on a combination of the sets of data, the generating including:
obtaining a data value for the data element from each of the sets of data obtained from the plurality of sources;
determining whether a conflict exists between the obtained data values;
using a conflict rule to determine a main data value for the data element in the main multi-dimensional set of data when the conflict exists;
storing a derivation record for the main data value for the data element in the main multi-dimensional set of data, the derivation record including: the main data value, the data value received from each of the plurality of sources, and the conflict rule;
obtaining the stored derivation record;
modifying the conflict rule, which is stored in the derivation record; and
determining a new main data value using the modified conflict rule.