Catalog for managing modular code
A catalog of pipelines for modular coding integrates resources for consistent use and verification of individual pipeline components. The platform may incorporate tools and metadata for version control, verification, and licensing in order to support a user when creating and deploying applications using resources from the catalog.
1 . A computer program product comprising computer executable code embodied in a non-transitory computer readable medium that, when executing on one or more computing devices, causes the one or more computing devices to perform the steps of:
storing a catalog of pipelines for performing security functions, wherein the catalog of pipelines includes one or more local data stores or remote data stores;
storing a description of a pipeline in the catalog of pipelines, wherein:
the description includes an identifier, a version, and a definition,
the definition includes one or more inputs to the pipeline, one or more outputs of the pipeline, one or more steps executable by a computing device to perform the security functions, and a graph of other pipelines from the catalog that contain code segments used in the pipeline, and
the graph characterizes a location for accessing the code segments for each other one of the pipelines and a functional location of the code segments for each of the other pipelines in the pipeline;
traversing one or more other graphs for each other pipeline in the definition including any sub-graphs until all source code modules for the pipeline have been identified;
adding graph data from the one or more other graphs to the graph of other pipelines, thereby providing an integrated graph for all of the code segments used in the pipeline;
adding security compliance data for each of the code segments in the integrated graph to the description of the pipeline;
storing the integrated graph and the security compliance data in the description of the pipeline;
evaluating a compliance of the pipeline with a security policy for an enterprise based on the description of the pipeline, the description including the security compliance data for each of the code segments in the integrated graph; and
in response to the compliance of the pipeline with the security policy meeting a predetermined criterion, publishing the pipeline for use in the enterprise along with a second security compliance data for the pipeline derived from the security compliance data for each of the code segments in the integrated graph of the description of the pipeline.
2 . The computer program product of claim 1 , wherein the catalog is distributed among two or more different data centers.
3 . The computer program product of claim 1 , wherein the catalog is stored in a central data repository accessible to registered users of the catalog.
4 . The computer program product of claim 1 , further comprising computer executable code that, when executing on one or more computing devices, causes the one or more computing devices to perform the step of: synchronizing the catalog using a plurality of pipelines stored in two or more remote repositories of pipelines.
5 . The computer program product of claim 4 , wherein synchronizing includes retrieving one or more of the plurality of pipelines from one or more of the remote repositories of pipelines to the catalog.
6 . The computer program product of claim 1 , wherein the description includes at least one of a digital signature for verifying a source of the pipeline, a second digital signature for verifying a second source of the other pipelines in the graph of other pipelines from the catalog, and a third digital signature for verifying a third source of one of the code segments used in the pipeline.
7 . A method comprising:
storing a catalog of pipelines for performing security functions;
storing a description of a pipeline in the catalog of pipelines, wherein:
the description includes an identifier, a version, and a definition, and
the definition includes one or more inputs to the pipeline, one or more outputs of the pipeline, and a graph that characterizes a location for accessing resources for each other one or more pipelines in the catalog of pipelines and a functional location of the resources for each of the one or more other pipelines in the pipeline;
verifying security compliance data for each of the one or more other pipelines from the catalog containing resources used in the pipeline, thereby providing a verification of a compliance for the pipeline with a security policy; and
in response to the verification of the compliance for the pipeline with the security policy, publishing the pipeline for use along with a second security compliance data for the pipeline derived from the security compliance data for the each of the one or more other pipelines from the catalog containing resources used in the pipeline in the description of the pipeline.
8 . The method of claim 7 , wherein verifying the security compliance data for the each of the one or more other pipelines from the catalog containing resources used in the pipeline includes verifying an operation on one or more corresponding resources for at least one of the other pipelines.
9 . The method of claim 7 , wherein verifying the security compliance data for the each of the one or more other pipelines from the catalog containing resources used in the pipeline includes verifying a digital signature for at least one of the other pipelines.
10 . The method of claim 7 , wherein verifying the security compliance data for the each of the one or more other pipelines from the catalog containing resources used in the pipeline includes verifying a programmatic interface between at least two of the other pipelines associated by the graph.
11 . The method of claim 7 , wherein verifying the security compliance data for the each of the one or more other pipelines from the catalog containing resources used in the pipeline includes verifying a source of at least one of the other pipelines.
12 . The method of claim 7 , wherein verifying the security compliance data for the each of one or more other pipelines from the catalog containing resources used in the pipeline includes receiving one or more licensing requirements for at least one of the other pipelines and explicitly accepting the one or more licensing requirements for use of the at least one of the other pipelines.
13 . The method of claim 12 , further comprising automatically securing an acceptance of the one or more licensing requirements by a user requesting the pipeline from the catalog.
14 . The method of claim 7 , further comprising storing a result of the verification in the description of the pipeline.
15 . The method of claim 7 , wherein publishing the pipeline in the catalog includes conditionally publishing the pipeline when the verification satisfies a predetermined condition.
16 . A system comprising:
a data repository storing a catalog of pipelines for performing security functions;
a description of a pipeline stored in the catalog of pipelines, the description including:
an identifier,
a version, and
a definition including one or more inputs to the pipeline, one or more outputs of the pipeline, and a graph of other pipelines from the catalog containing resources used in the pipeline,
wherein the graph characterizes a location for accessing the resources for each other one of the pipelines, a functional location of the resources for each of the other pipelines in the pipeline, one or more compatible versions of at least one of the other pipelines identified in the graph, and security compliance data for each of the other pipelines in the pipeline, the security compliance data providing a compliance of a corresponding one of the other pipelines with a security policy; and
a search interface for searching the catalog for pipelines of interest, wherein the search interface in response to the compliance of the corresponding one of the other pipelines with the security policy publishes the pipeline to users along with a second security compliance data for the pipeline derived from the security compliance data for the each of the other pipelines in pipeline in the graph in the description of the pipeline.
17 . The system of claim 16 , further comprising an integrated development environment for creating and deploying an application using the catalog of pipelines, the integrated development environment including a user interface for selecting and arranging pipelines from the catalog into the application.
18 . The system of claim 16 , further comprising a version identifier specifying, for the pipeline stored in the catalog, a compatibility with one or more prior versions of the pipeline.
19 . The system of claim 16 , wherein the data repository is a cloud-based data repository.
20 . The system of claim 16 , wherein the data repository is a federated data store.