EVENT BASED SOURCE REPLICATION ARCHITECTURE
Examples of an extensible event based source replication architecture for management services are described. In some examples, an orchestrator service identifies management data source services and a particular management data source service maintains a corresponding database. Network-service-specific replication pipelines are generated for a set of network services. A particular replication pipeline is registered in association with one or more tenant identifiers and one or more entity identifiers. Event data is received as a number of database update messages are received. A subset of the event data is identified according to the entity identifier and the tenant identifier and is replicated into the particular replication pipeline for a particular network service.
1 . A method, comprising:
identifying, by an orchestrator service of a management computing environment, a plurality of management data source services, wherein a particular management data source service maintains a corresponding database;
generating, by the orchestrator service, a plurality of network-service-specific replication pipelines for a corresponding plurality of network services, wherein a particular replication pipeline is registered in association with at least one tenant identifier and at least one entity identifier;
receiving, by the orchestrator service, a plurality of database update messages collectively comprising event data for a plurality of entity identifiers and a plurality of tenant identifiers; and
replicating, by the orchestrator service, a subset of the event data into the particular replication pipeline, wherein a particular network service receives the subset of the event data through the particular replication pipeline, and the replicated subset of the event data is identified using the at least one tenant identifier and the at least one entity identifier registered for the particular replication pipeline.
2 . The method according to claim 1 , wherein the corresponding plurality of network services are external to the management computing environment.
3 . The method according to claim 1 , further comprising:
generating, by the orchestrator service, a plurality of source-service-specific replication pipelines corresponding to the plurality of management data source services.
4 . The method according to claim 3 , further comprising:
receiving, by the orchestrator service, a plurality of source registration requests for the plurality of management data source services, wherein the source-service-specific replication pipelines are generated in response to the source registration requests.
5 . The method according to claim 1 , wherein the plurality of management data source services are internal to the management computing environment.
6 . The method according to claim 1 , wherein the particular replication pipeline uses a messaging platform to provide the subset of the event data to the particular network service.
7 . The method according to claim 1 , wherein the particular management data source service transmits a subset of the plurality of database update messages based at least in part on changes to data in the corresponding database maintained by the particular management data source service.
8 . A non-transitory computer-readable medium embodying instructions executable by at least one computing device, wherein the instructions, when executed, cause the at least one computing device to at least:
identify, by an orchestrator service of a management computing environment, a plurality of management data source services, wherein a particular management data source service maintains a corresponding database;
generate, by the orchestrator service, a plurality of network-service-specific replication pipelines for a corresponding plurality of network services, wherein a particular replication pipeline is registered in association with at least one tenant identifier and at least one entity identifier;
receive, by the orchestrator service, a plurality of database update messages collectively comprising event data for a plurality of entity identifiers and a plurality of tenant identifiers; and
replicate, by the orchestrator service, a subset of the event data into the particular replication pipeline, wherein a particular network service receives the subset of the event data through the particular replication pipeline, and the replicated subset of the event data is identified using the at least one tenant identifier and the at least one entity identifier registered for the particular replication pipeline.
9 . The non-transitory computer-readable medium according to claim 8 , wherein the corresponding plurality of network services are external to the management computing environment.
10 . The non-transitory computer-readable medium according to claim 8 , wherein the instructions, when executed, cause the at least one computing device to at least:
generate, by the orchestrator service, a plurality of source-service-specific replication pipelines corresponding to the plurality of management data source services.
11 . The non-transitory computer-readable medium according to claim 10 , wherein the instructions, when executed, cause the at least one computing device to at least:
receive, by the orchestrator service, a plurality of source registration requests for the plurality of management data source services, wherein the source-service-specific replication pipelines are generated in response to the source registration requests.
12 . The non-transitory computer-readable medium according to claim 8 , wherein the plurality of management data source services are internal to the management computing environment.
13 . The non-transitory computer-readable medium according to claim 8 , wherein the particular replication pipeline uses a messaging platform to provide the subset of the event data to the particular network service.
14 . The non-transitory computer-readable medium according to claim 8 , wherein the particular management data source service transmits a subset of the plurality of database update messages based at least in part on changes to data in the corresponding database maintained by the particular management data source service.
15 . A system, comprising:
at least one computing device; and
instructions accessible by the at least one computing device, wherein the instructions, when executed, cause the at least one computing device to at least:
identify, by an orchestrator service of a management computing environment, a plurality of management data source services, wherein a particular management data source service maintains a corresponding database;
generate, by the orchestrator service, a plurality of network-service-specific replication pipelines for a corresponding plurality of network services, wherein a particular replication pipeline is registered in association with at least one tenant identifier and at least one entity identifier;
receive, by the orchestrator service, a plurality of database update messages collectively comprising event data for a plurality of entity identifiers and a plurality of tenant identifiers; and
replicate, by the orchestrator service, a subset of the event data into the particular replication pipeline, wherein a particular network service receives the subset of the event data through the particular replication pipeline, and the replicated subset of the event data is identified using the at least one tenant identifier and the at least one entity identifier registered for the particular replication pipeline.
16 . The system of claim 15 , wherein the corresponding plurality of network services are external to the management computing environment.
17 . The system of claim 15 , wherein the instructions, when executed, cause the at least one computing device to at least:
generate, by the orchestrator service, a plurality of source-service-specific replication pipelines corresponding to the plurality of management data source services.
18 . The system of claim 15 , wherein the plurality of management data source services are internal to the management computing environment.
19 . The system of claim 15 , wherein the particular replication pipeline uses a messaging platform to provide the subset of the event data to the particular network service.
20 . The system of claim 15 , wherein the particular management data source service transmits a subset of the plurality of database update messages based at least in part on changes to data in the corresponding database maintained by the particular management data source service.