METHOD AND APPARATUS FOR MANAGING MULTIPLE DOCUMENT VERSIONS IN A LARGE SCALE DOCUMENT REPOSITORY
In a large scale data repository, a single logical view of multiple versions of the same data is presented. In order to determine which data versions are equivalent without comparing each pair of entries in the database, the database entries are clustered with a clustering algorithm and then comparisons between entries are made only between the entries in each cluster. Once a set of entries has been determined to be equivalent, a composite master entry is constructed from those entries in the set that contain preferred metadata and the composite master entry is made available for searches and display to the user.
1 . A computer-implemented method for displaying a single logical view of multiple document versions in a large scale document repository storage, comprising:
(a) representing each document version with a separate data entry, each data entry having a fixed number of data fields and being stored in the repository storage;
(b) assigning each data entry a quality level based on a source that generated the data entry;
(c) creating sets of equivalent data entries by comparing data fields of pairs of data entries; and
(d) creating a master entry from at least one set of equivalent data entries by creating a blank data entry in the repository storage and filling data fields in the blank entry with data taken from the data entries in the set starting with the data entry having the highest quality level and, for unfilled data fields, proceeding to examine data entries with lower quality levels.
2 . The method of claim 1 wherein step (d) is performed when a data entry in the set of equivalent data entries must be edited.
3 . The method of claim 2 wherein the step (d) is performed and then the master entry is made available for editing instead of a data entry in the set of equivalent entries.
4 . The method of claim 1 wherein step (d) is performed when license rights must be assigned to a data entry in the set of equivalent data entries.
5 . The method of claim 4 wherein the step (d) is performed and then license rights are assigned to the master entry instead of a data entry in the set of equivalent entries.
6 . The method of claim 1 wherein step (d) comprises filling only pre-selected data fields in the blank entry by sequentially examining data entries in the set until either the pre-selected data fields have been filled or all data entries in the set have been examined.
7 . The method of claim 1 wherein step (d) comprises filling data fields in the blank entry by sequentially examining data entries in the set until either all data fields have been filled or all data entries in the set have been examined.
8 . The method of claim 1 wherein step (c) comprises:
(c1) clustering the database entries with a clustering algorithm and for each cluster, comparing at least one data field of each entry in that cluster; and
(c2) marking as equivalent in the repository storage data entries in a cluster that are determined to be equivalent by the comparison in step (c1).
9 . The method of claim 1 wherein, in step (c), data field values are normalized prior to comparison.
10 . The method of claim 1 wherein each data entry comprises a preferred flag and wherein the method further comprises for each set of equivalent data entries, setting the preferred flag of the data entry with the highest quality level to indicate that when one of the data entries in the set is selected during a search, the data entry in the set whose flag is set is presented for display instead of the selected data entry.
11 . The method of claim 10 wherein step (d) comprises setting the preferred flag in the master data entry to indicate that when one of the data entries in the set is selected during a search, the master data entry is presented for display and clearing the preferred flag in the data entry whose flag had previously been set.