Identity domain snapshot consumption using versioning and related systems and methods
Techniques for identity domain snapshotting and snapshot consumption using versioning are disclosed. A snapshot of an updated identity domain is received and applied to an identity domain to change the active version of the identity domain from a prior current version to the updated version. The snapshot is consumed by loading data objects in a hierarchical manner into an updated identity domain. While data objects belonging to the snapshot are loaded during consumption of the snapshot, client traffic continues to be served by the prior, non-updated version of the identity domain. Once consumption of the snapshot is completed successfully, the updated version of the identity domain becomes the active version. The prior version is then recorded in a cleanup table denoting that cleanup operations shall be performed for entities related to the data objects and associated with the prior version.
1 . One or more non-transitory computer readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:
accessing a domain snapshot for an updated version of an identity domain;
loading entity data for a first entity from the domain snapshot into a data object associated with the identity domain;
updating metadata associated with the identity domain to reference the updated version of the identity domain;
activating the updated version of the identity domain by updating an active version of the identity domain to the updated version; and
updating metadata for a related entity, the related entity being related to the first entity, to reference the entity data for the first entity loaded from the domain snapshot for the updated version of the identity domain.
2 . The non-transitory media of claim 1 , the operations further comprising:
loading entity data for a plurality of entities from the domain snapshot into a plurality of data objects associated with the identity domain during the loading of the entity data for the plurality of entities from the domain snapshot.
3 . The non-transitory media of claim 1 , the operations further comprising:
based on a prior version of the identity domain being the active version of the identity domain, returning, for the data object, the entity data loaded according to the prior version; and
based on the updated version of the identity domain being the active version of the identity domain, returning, for the data object, the entity data loaded from the domain snapshot for the updated version.
4 . The non-transitory media of claim 1 , wherein:
activating the updated version of the identity domain comprises updating a domain lookup table to reference the updated version of the identity domain as the active version for the identity domain.
5 . The non-transitory media of claim 1 , the operations further comprising:
removing a prior record for a prior version of the identity domain from a domain lookup table;
adding a new record to a cleanup domain based on the prior record; and
cleaning up the prior version of the identity domain by removing a dangling entity from the prior version of the identity domain.
6 . The non-transitory media of claim 1 , the operations further comprising:
routing traffic for a service to the updated version of the identity domain based on a global unique identifier for the updated version of the identity domain being mapped to an identity domain associated with the service.
7 . The non-transitory media of claim 1 , wherein:
duplicates for an identity-related entity for different versions of the identity domain are distinguished by a primary key comprised of a global unique identifier assigned to a corresponding version of the identity domain and an identifier assigned to the first entity.
8 . The non-transitory media of claim 1 , further comprising:
loading the entity data for the first entity by copying the entity data for the first entity and one or more related entities from the domain snapshot into one or more entity tables for the identity domain; and
updating the metadata associated with the identity domain to reference the entity data for the first entity and one or more related entities from the domain snapshot copied into the one or more entity tables.
9 . The non-transitory media of claim 1 , further comprising:
responsive to detecting a failure condition associated with the updated version of the identity domain, updating a domain lookup table to reference the updated version of the identity domain as inactive and to reference a different version of the identity domain as active.
10 . The non-transitory media of claim 1 , further comprising:
storing up to a threshold number of prior versions of the identity domain in a cleanup domain;
in response to receiving a request to store an additional version of the identity domain exceeding the threshold number of prior versions, removing an oldest version of the identity domain from the cleanup domain; and
storing the additional version of the identity domain in the cleanup domain.
11 . A method comprising:
accessing a domain snapshot for an updated version of an identity domain;
loading entity data for a first entity from the domain snapshot into a data object associated with the identity domain;
updating metadata associated with the identity domain to reference the updated version of the identity domain;
activating the updated version of the identity domain by updating an active version of the identity domain to the updated version; and
updating metadata for a related entity, the related entity being related to the first entity, to reference the entity data for the first entity loaded from the domain snapshot for the updated version of the identity domain, wherein
the method is performed by at least one device including a hardware processor.
12 . The method of claim 11 , further comprising:
loading entity data for a plurality of entities from the domain snapshot into a plurality of data objects associated with the identity domain during the loading of the entity data for the plurality of entities from the domain snapshot.
13 . The method of claim 11 , further comprising:
based on a prior version of the identity domain being the active version of the identity domain, returning, for the data object, the entity data loaded according to the prior version; and
based on the updated version of the identity domain being the active version of the identity domain, returning, for the data object, the entity data loaded from the domain snapshot for the updated version.
14 . The method of claim 11 , wherein:
activating the updated version of the identity domain comprises updating a domain lookup table to reference the updated version of the identity domain as the active version for the identity domain.
15 . The method of claim 11 , further comprising:
removing a prior record for a prior version of the identity domain from a domain lookup table;
adding a new record to a cleanup domain based on the prior record; and
cleaning up the prior version of the identity domain by removing a dangling entity from the prior version of the identity domain.
16 . The method of claim 11 , further comprising:
routing traffic for a service to the updated version of the identity domain based on a global unique identifier for the updated version of the identity domain being mapped to an identity domain associated with the service.
17 . The method of claim 11 , further comprising:
loading the entity data for the first entity by copying the entity data for the first entity and one or more related entities from the domain snapshot into one or more entity tables for the identity domain; and
updating the metadata associated with the identity domain to reference the entity data for the first entity and one or more related entities from the domain snapshot copied into the one or more entity tables.
18 . A system comprising:
at least one device including a hardware processor;
the system being configured to perform operations comprising:
accessing a domain snapshot for an updated version of an identity domain;
loading entity data for a first entity from the domain snapshot into a data object associated with the identity domain;
updating metadata associated with the identity domain to reference the updated version of the identity domain; and
activating the updated version of the identity domain by updating an active version of the identity domain to the updated version;
based on a prior version of the identity domain being the active version of the identity domain, returning, for the data object, the entity data loaded according to the prior version; and
based on the updated version of the identity domain being the active version of the identity domain, returning, for the data object, the entity data loaded from the domain snapshot for the updated version.
19 . The system of claim 18 , wherein the operations further comprise:
updating metadata for a related entity, the related entity being related to the first entity, to reference the entity data for the first entity loaded from the domain snapshot for the updated version of the identity domain.
20 . The system of claim 18 , wherein the operations further comprise:
loading entity data for a plurality of entities from the domain snapshot into a plurality of data objects associated with the identity domain during the loading of the entity data for the plurality of entities from the domain snapshot.