Verifying data consistency among structured files
View Patent ↗A scalable comparison structure and methodology is provided that is suitable for comparing select data content in hundreds or thousands of files in an efficient manner. Section delimiters are defined to identify the sections of the files within which the select data content is located, and sets of unique sections are identified based on the select data content within the section. Thereafter, comparisons and reports are based on these unique content sections. If multiple files include a common set of data, a single unique content section is used to represent these multiple files. File groups are optionally defined, and different sets of select data content can be compared based on these file groups. The result of the comparison is presented in multiple hierarchical forms, including an identification of which files are different from each other, and an identification of the differences among the unique content segments.
1. A method for comparing a plurality of files, comprising:
identifying, at a data processing device, a section of each file of the plurality of files based on one or more section selection identifiers,
defining, by the data processing device, a set of unique content sections among the plurality of files based on a comparison of content of each of the sections of the plurality of files,
creating an association between each of the unique content sections and one or more of the files that include a section corresponding to the unique content section, and
creating, by the data processing device, one or more comparison reports based on the content of, and the files associated with, one or more of the unique content sections,
wherein:
at least one of the comparison reports is based on a hierarchy of information based on the set of unique content sections and
the hierarchy includes:
an identification of a group to which each file is associated,
an identification of the sections within each group, and
an identification of the unique content sections among the sections within each group.
2. The method of claim 1 , wherein identifying the section of each file includes defining parameters that identify a start and end of one or more elements of the section in each file.
3. The method of claim 1 , wherein defining the set of unique content sections includes:
comparing the content of the section of each file with each unique content section of the set of unique content sections, and
if the content of the section does not correspond to any of the current set of unique content sections, adding the section to the set of unique content sections.
4. The method of claim 3 , wherein comparing the content of the sections of each file with each unique content section is performed without regard to an order of the content.
5. The method of claim 1 , wherein the plurality of files include files that identify configurations of devices of a network.
6. The method of claim 5 , wherein the plurality of files correspond to a defined group of devices.
7. The method of claim 1 , wherein at least one of the comparison reports is based on a count of the files that include sections corresponding to at least one of the set of unique content sections.
8. The method of claim 1 , wherein at least one of the comparison reports is based on a count of unique content sections in the set of unique content sections.
9. The method of claim 1 , wherein at least one of the comparison reports includes an identification of the files that include sections corresponding to at least one of the set of unique content sections.
10. The method of claim 1 , wherein the hierarchy further includes an identification of the files that include sections corresponding to each of the unique content sections among the sections within each group.
11. The method of claim 1 , wherein the hierarchy further includes an identification of content within each unique content section.
12. The method of claim 1 , wherein membership at one or more levels of the hierarchy is based on a user supplied membership definition.
13. The method of claim 1 , wherein at least one of the comparison reports includes display that illustrates the files that include sections corresponding to each of the set of unique content sections.
14. The method of claim 1 , wherein at least one of the comparison reports includes display that illustrates content of the sections that are included in each of the set of unique content sections.
15. The method of claim 14 , wherein at least one of the comparison reports illustrates an order of the content of the sections that are included in each of the set of unique content sections.
16. The method of claim 1 , wherein the section of each file is identified based on an XML expression that is used in the file.
17. A system comprising:
a processor that is configured to embody:
a compiler that receives one or more section selection identifiers that facilitate an identification of a section of each file of a plurality of files, and
an extractor that:
determines a set of unique content sections among the plurality of files based on content of the sections of the plurality of files, and
creates, in a memory element, an association between each of the unique content sections and one or more of the files that include a section corresponding to the unique content section, and
a reporter that accesses the memory element and provides one or more comparison reports based on the content of, and the files associated with, the set of unique content sections,
wherein:
at least one of the comparison reports is based on a hierarchy of information based on the set of unique content sections, and
the hierarchy includes:
an identification of a group to which each file is associated,
an identification of the sections within each group, and
an identification of the unique content sections among the sections within each group.
18. The system of claim 17 , wherein the section identifiers include parameters that identify a start and end of one or more elements of the section in each file.
19. The system of claim 17 , wherein the extractor determines the set of unique content sections by:
comparing the content of the section of each file with each unique content section of the set of unique content sections, and
if the content of the section does not correspond to any of the current set of unique content sections, adding the section to the set of unique content sections.
20. The system of claim 19 , wherein comparing the content of the sections of each file with each unique content section is performed without regard to an order of the content.
21. The system of claim 17 , wherein the plurality of files include files that identify configurations of devices of a network.
22. The system of claim 21 , wherein the plurality of files correspond to a defined group of devices.
23. The system of claim 17 , wherein the reporter displays the information based on a count of the files that include sections corresponding to at least one of the set of unique content sections.
24. The system of claim 17 , wherein the reporter displays the information based on a count of unique content sections in the set of unique content sections.
25. The system of claim 17 , wherein at least one of the comparison reports includes an identification of the files that include sections corresponding to at least one of the set of unique content sections.
26. The system of claim 17 , wherein the hierarchy further includes an identification of the files that include sections corresponding to each of the unique content sections among the sections within each group.
27. The system of claim 17 , wherein the hierarchy further includes an identification of content within each unique content section.
28. The system of claim 17 , wherein membership at one or more levels of the hierarchy is based on a user supplied membership definition.
29. The system of claim 17 , wherein the reporter displays information that illustrates the files that include sections corresponding to each of the set of unique content sections.
30. The system of claim 17 , wherein the reporter displays information that illustrates content of the sections that are included in each of the set of unique content sections.
31. The system of claim 30 , wherein at least one of the comparison reports illustrates an order of the content of the sections that are included in each of the set of unique content sections.
32. The system of claim 17 , wherein the compiler identifies the section of each file based on one or more XML expressions.