Distributed architecture for information management services in cloud environments
Distributed architecture for executing information management services using shared platform microservices, containerization techniques, and regional core services. This architecture decentralizes the traditional model by segmenting the various functions of the centralized control and information manager into modular cloud microservices. This modularization not only enhances system flexibility but also allows for a more dynamic configuration, with certain elements being deployable as containers. The resilient architecture leverages the inherent scalability and adaptability of cloud technology.
1 . A distributed information management system, comprising: one or more hardware processors and non-transitory computer-readable memory storing instructions that, when executed, cause the distributed information management system to:
operate a global management cell configured to store global information management policies and global configuration metadata;
operate shared platform services comprising a plurality of microservices deployed on hardware servers, the shared platform services comprising one or more of: (i) an authentication service; (ii) an authorization service; (iii) an audit service; (iv) a scheduler service; (v) a configuration service maintaining read replicas of management metadata;
execute at least one of the plurality of microservices as a container deployed on a hardware server of the shared platform services;
maintain a management database stored in non-transitory memory and synchronized with at least one database cache associated with the at least one of the plurality of microservices executed as a container;
implement, in each of a plurality of geographic regions, a regional core services cell comprising one or more of: (i) a regional storage manager configured to manage information management operations for that region; (ii) one or more regional core services configured to perform read and write operations to storage devices in the region; (iii) a regional cache storing region-specific operational and metadata information; (iv) a service bus providing bidirectional messaging between the regional core services cell and the shared platform services;
receive, via an aggregator service operating on hardware processors, a request from an administrative console, determine a region associated with the request, and transmit the request to one or more microservices of the determined region; and
generate, using the aggregator service, a consolidated response based on operational responses received from the microservices of the determined region.
2 . The distributed information management system of claim 1 , wherein the aggregator service communicates with a discovery service to locate a microservice instance based on a region and a requested service type.
3 . The distributed information management system of claim 1 , wherein the scheduler service submits job tasks to a message queue, and a job manager executed within the regional core services cell processes the submitted job tasks.
4 . The distributed information management system of claim 1 , wherein the audit service stores audit events in an audit history database synchronized across regional core services cells.
5 . The distributed information management system of claim 1 , wherein the shared platform services further include a telemetry service configured to ingest trace identifiers and correlate distributed service calls across HTTP, REST, SQL, and messaging layers.
6 . The distributed information management system of claim 1 , wherein executing the at least one of the plurality of microservices as a container comprises executing at least one of: the scheduler service, the audit service, the configuration service, or a telemetry service.
7 . The distributed information management system of claim 1 , wherein the regional storage manager updates job state and operational status in the management database in response to messages received from a job manager.
8 . The distributed information management system of claim 1 , wherein the aggregator service consolidates regional responses by retrieving metadata from the management database and augmenting the metadata with runtime operational information received from the microservices.
9 . The distributed information management system of claim 1 , wherein the global management cell distributes configuration updates to the shared platform services and to the regional core services cells via a global configuration manager.
10 . The distributed information management system of claim 1 , wherein the regional core services cell performs region-specific read or write operations on a storage device using a regional core service responsive to requests routed by the aggregator service.
11 . A computer-implemented method for managing information in a distributed information management system, the method executed by one or more hardware processors and comprising:
operating a global management cell storing global information management policies;
executing shared platform microservices on hardware servers, the shared platform microservices including authentication, authorization, audit, scheduler, and configuration services;
executing at least one microservice as a container deployed on hardware of the shared platform microservices;
synchronizing a management database with at least one database cache associated with the at least one microservice;
operating, for each of a plurality of geographic regions, a regional core services cell comprising a regional storage manager, one or more core services, and a regional cache;
receiving, via an aggregator service, a request from an administrative console;
determining a region associated with the request;
routing the request to one or more microservices of the determined region; and
returning a consolidated response based on operational information received from the microservices of the determined region.
12 . The computer-implemented method of claim 11 , further comprising identifying a microservice instance using a discovery service.
13 . The computer-implemented method of claim 11 , further comprising submitting job tasks to a message queue and processing the job tasks using a job manager operating within the determined region.
14 . The computer-implemented method of claim 11 , further comprising updating configuration metadata across regions using a global configuration manager.
15 . The computer-implemented method of claim 11 , further comprising storing audit events in an audit history database and synchronizing the audit history database across regions.
16 . The computer-implemented method of claim 11 , further comprising generating telemetry data using a telemetry service to correlate distributed service calls across transport and messaging layers.
17 . The computer-implemented method of claim 11 , further comprising performing region-specific write operations on a storage device using core services of the determined region.
18 . The computer-implemented method of claim 11 , further comprising updating job state in the management database upon receiving status messages from a job manager.
19 . The computer-implemented method of claim 11 , further comprising constructing the consolidated response by retrieving metadata from the management database and augmenting the metadata with live operational responses.
20 . The computer-implemented method of claim 11 , wherein executing the at least one microservice comprises deploying, scaling, or restarting a containerized instance performing one of the shared platform microservices.