Identifying versions of file sets on a computer system
View Patent ↗Target files in a search space are scanned to identify which versions of software components are present in the search space. A reference library is populated with indicia such as source code fragments of known versions of software components. A file scanner reads file data used to identify matches between the reference library content and target files, and a version detector determines which match candidates represent unique component versions. Once a component version is identified, a vulnerability module determines based on data in a vulnerabilities database what vulnerabilities are associated with the identified version, and a license module identifies which if any licensing schemes are applicable to the identified version. In one embodiment a report is automatically produced providing an indication of all matched files, their versions, vulnerabilities, and licensing schemes.
1. A computer-implemented method for identifying software component versions on a file system the method comprising:
scanning, by a computer, a plurality of target files to obtain content-based file identifiers;
comparing, by the computer, each content-based file identifier to identifiers in a reference library to determine a plurality of candidate versions of software components, each candidate version corresponding to at least one of the content-based file identifiers;
identifying a subset of candidate versions from the plurality of candidate versions as present on the file system by, for each candidate version in the plurality of candidate versions:
determining, using the reference library, whether the content-based file identifiers uniquely identify the candidate version, a content-based file identifier uniquely identifying the candidate version responsive to the content-based file identifier matching an identifier in the reference library that is associated with the candidate version but is not associated with other candidate versions; and
responsive to the content-based file identifiers uniquely identifying the candidate version, determining that the candidate version is present on the file system; and
producing a report including the subset of candidate versions identified as present on the file system.
2. The method of claim 1 , wherein the content based file identifiers comprise MD5 digests.
3. The method of claim 1 , wherein the content based file identifiers comprise code fingerprints.
4. The method of claim 1 , wherein determining that the candidate version is present on the file system further comprises:
determining whether a directory structure of the scanned target files matches a directory structure of at least one release of the candidate version; and
responsive to the content-based file identifiers uniquely identifying the candidate version and the directory structure matching the at least one release of the candidate version, determining that the candidate version is present on the file system.
5. The method of claim 1 , wherein producing a report comprises:
comparing the subset of candidate versions to a vulnerabilities database, the vulnerabilities database including vulnerability information for a plurality of versions of components; and
producing a vulnerability report including vulnerability information for the subset of candidate versions based on the comparison.
6. The method of claim 1 , wherein producing a report comprises:
comparing the subset of candidate versions to a licensing database, the licensing database including licensing information for a plurality of versions of components; and
producing a licensing report including licensing information for the subset of candidate versions based on the comparison.
7. The method of claim 1 , wherein determining that the candidate version is present on the file system comprises:
determining whether the content-based file identifiers uniquely identify at least one release of the candidate version; and
responsive to whether the content-based file identifiers uniquely identify the candidate version and whether the content-based file identifiers uniquely identify the at least one release of the candidate version, determining that the candidate version is present on the file system.
8. The method of claim 1 , wherein the reference library comprises a plurality of the identifiers, and:
wherein the plurality of candidate versions of software components are determined by comparing the content-based file identifiers to only a subset of the plurality of the identifiers in the reference library, and
wherein the content-based file identifiers are determined to uniquely identify the candidate version by comparing the content-based file identifiers to all of the plurality of the identifiers in the reference library.
9. A computer program product for identifying software component versions on a file system, the computer program product comprising a non-transitory computer readable medium having computer executable code for performing the steps of:
scanning a plurality of target files to obtain content-based file identifiers;
comparing each content-based file identifier to identifiers in a reference library to determine a plurality of candidate versions of software components, each candidate version corresponding to at least one of the content-based file identifiers;
identifying a subset of candidate versions from the plurality of candidate versions as present on the file system by, for each candidate version in the plurality of candidate versions:
determining whether the content-based file identifiers uniquely identify the candidate version using the reference library, a content-based file identifier uniquely identifying the candidate version responsive to the content-based file identifier matching an identifier in the reference library that is associated with the candidate version but is not associated with other candidate versions; and
responsive to the content-based file identifiers uniquely identifying the candidate version, determining that the candidate version is present on the file system; and
producing a report including the subset of candidate versions identified as present on the file system.
10. The computer program product of claim 9 , wherein the content based file identifiers comprise MD5 digests.
11. The computer program product of claim 9 , wherein the content based file identifiers comprise code fingerprints.
12. The computer program product of claim 9 , wherein determining that the candidate version is present on the file system further comprises:
determining whether a directory structure of the scanned target files matches a directory structure of at least one release of the candidate version; and
responsive to the content-based file identifiers uniquely identifying the candidate version and the directory structure matching the at least one release of the candidate version, determining that the candidate version is present on the file system.
13. The computer program product of claim 9 , wherein producing a report comprises:
comparing the subset of candidate versions to a vulnerabilities database, the vulnerabilities database including vulnerability information for a plurality of versions of components; and
producing a vulnerability report including vulnerability information for the subset of candidate versions based on the comparison.
14. The computer program product of claim 9 , wherein producing a report comprises:
comparing the subset of candidate versions to a licensing database, the licensing database including licensing information for a plurality of versions of components; and
producing a licensing report including licensing information for the subset of candidate versions based on the comparison.
15. The computer program product of claim 9 , wherein determining that the candidate version is present on the file system comprises:
determining whether the content-based file identifiers uniquely identify at least one release of the candidate version; and
responsive to whether the content-based file identifiers uniquely identify the candidate version and whether the content-based file identifiers uniquely identify the at least one release of the candidate version, determining that the candidate version is present on the file system.
16. A system for identifying software component versions on a file system, the system comprising:
a processor; and
a non-transitory computer-readable medium having executable code, the executable code executed by the processor to perform steps of:
scanning a plurality of target files to obtain content-based file identifiers;
comparing each content-based file identifier to identifiers in a reference library to determine a plurality of candidate versions of software components, each candidate version corresponding to at least one of the content-based file identifiers;
identifying a subset of candidate versions from the plurality of candidate versions as present on the file system by, for each candidate version in the plurality of candidate versions:
determining whether the content-based file identifiers uniquely identify the candidate version using the reference library, a content-based file identifier uniquely identifying the candidate version responsive to the content-based file identifier matching an identifier in the reference library that is associated with the candidate version but is not associated with other candidate versions; and
responsive to the content-based file identifiers uniquely identifying the candidate version, determining that the candidate version is present on the file system; and
producing a report including the subset of candidate versions identified as present on the file system.
17. The system of claim 16 , wherein determining that the candidate version is present on the file system comprises:
determining whether a directory structure of the scanned target files matches a directory structure of at least one release of the candidate version; and
responsive to the content-based file identifiers uniquely identifying the candidate version and the directory structure matching the at least one release of the candidate version, determining that the candidate version is present on the file system.
18. The system of claim 16 , wherein producing a report comprises:
comparing the subset of candidate versions to a vulnerabilities database, the vulnerabilities database including vulnerability information for a plurality of versions of components; and
producing a vulnerability report including vulnerability information for the subset of candidate versions based on the comparison.
19. The system of claim 16 , wherein producing a report comprises:
comparing the subset of candidate versions to a licensing database, the licensing database including licensing information for a plurality of versions of components; and
producing a licensing report including licensing information for the subset of candidate versions based on the comparison.