Reconciliation of the edge state in a telemetry platform
Various embodiments disclosed herein are related to a non-transitory computer readable storage medium. In some embodiments, the medium includes instructions stored thereon that, when executed by a processor, cause the processor to receive a stored configuration state of a cluster, receive a snapshot of the configuration state of the cluster, determine that an entity of the cluster is different between the stored configuration state and the snapshot, determine that a first timestamp of the stored configuration state is less than a second timestamp of the snapshot, and send an indication that the entity is changed.
1. A non-transitory computer readable storage medium comprising instructions stored thereon that, when executed by a processor, cause the processor to:
receive a change event associated with an entity of a cluster, wherein the cluster comprises one or more virtualized workloads;
update a stored configuration state of the cluster based on the change event;
receive a snapshot of the configuration state of the cluster;
determine that a first entity of the cluster is different between the stored configuration state and the snapshot;
determine that a first timestamp of the stored configuration state is less than a second timestamp of the snapshot; and
send an indication that the first entity is changed.
2. The medium of claim 1 , wherein the entity of the cluster is different between the stored configuration state and the snapshot based on one or more of a network issue, the cluster, and a cloud server, a cloud server failure, or an occurrence of an error during processing by a data processing pipeline of the cloud server.
3. The medium of claim 1 , further comprising instructions that, when executed by the processor, cause the processor to compare first metadata of the stored configuration state to second metadata of the snapshot.
4. The medium of claim 1 , further comprising instructions that, when executed by the processor, cause the processor to compare a first list of entities of the stored configuration state to a second list of entities of the snapshot.
5. The medium of claim 1 , further comprising instructions that, when executed by the processor, cause the processor to determine that a first status of the entity in the stored configuration state is active and a second status of the entity in the entity in the snapshot is inactive.
6. The medium of claim 1 , further comprising instructions that, when executed by the processor, cause the processor to receive the snapshot in chunks.
7. The medium of claim 6 , further comprising instructions that, when executed by the processor, cause the processor to aggregate the chunked snapshot after a determination that all chunks have been received for the snapshot.
8. The medium of claim 1 , further comprising instructions that, when executed by the processor, cause the processor to roll back the configuration state of the cluster to the stored configuration state.
9. The medium of claim 1 , wherein the change event is received from an edge device, wherein the edge device collects and processes data about nodes and services running on the cluster.
10. An apparatus comprising a processor and a memory, wherein the memory includes programmed instructions that, when executed by the processor, cause the apparatus to:
receive a change event associated with an entity of a cluster, wherein the cluster comprises one or more virtualized workloads;
update a stored configuration state of the cluster based on the change event;
receive a snapshot of the configuration state of the cluster;
determine that a first entity of the cluster is different between the stored configuration state and the snapshot;
determine that a first timestamp of the stored configuration state is less than a second timestamp of the snapshot; and
send an indication that the first entity is changed.
11. The apparatus of claim 10 , wherein the entity of the cluster is different between the stored configuration state and the snapshot based on one or more of a network issue, the cluster, and a cloud server, a cloud server failure, or an occurrence of an error during processing by a data processing pipeline of the cloud server.
12. The apparatus of claim 10 , wherein the memory further includes programmed instructions that, when executed by the processor, cause the apparatus to compare first metadata of the stored configuration state to second metadata of the snapshot.
13. The apparatus of claim 10 , wherein the memory further includes programmed instructions that, when executed by the processor, cause the apparatus to compare a first list of entities of the stored configuration state to a second list of entities of the snapshot.
14. The apparatus of claim 10 , wherein the memory further includes programmed instructions that, when executed by the processor, cause the apparatus to determine that a first status of the entity in the stored configuration state is active and a second status of the entity in the entity in the snapshot is inactive.
15. The apparatus of claim 10 , wherein the memory further includes programmed instructions that, when executed by the processor, cause the apparatus to receive the snapshot in chunks.
16. The apparatus of claim 15 , wherein the memory further includes programmed instructions that, when executed by the processor, cause the apparatus to aggregate the chunked snapshot.
17. The apparatus of claim 10 , wherein the memory further includes programmed instructions that, when executed by the processor, cause the apparatus to roll back the configuration state of the cluster to the stored configuration state.
18. A computer-implemented method comprising:
receiving, by a processor, a change event associated with an entity of a cluster, wherein the cluster comprises one or more virtualized workloads;
updating a stored configuration state of the cluster based on the change event;
receiving a snapshot of the configuration state of the cluster;
determining that a first entity of the cluster is different between the stored configuration state and the snapshot;
determining that a first timestamp of the stored configuration state is less than a second timestamp of the snapshot; and
sending an indication that the first entity is changed.
19. The method of claim 18 , wherein the entity of the cluster is different between the stored configuration state and the snapshot based on one or more of a network issue, the cluster, and a cloud server, a cloud server failure, or an occurrence of an error during processing by a data processing pipeline of the cloud server.
20. The method of claim 18 , further comprising comparing first metadata of the stored configuration state to second metadata of the snapshot.
21. The method of claim 18 , further comprising determining that a first status of the entity in the stored configuration state is active and a second status of the entity in the entity in the snapshot is inactive.
22. The method of claim 18 , further comprising receiving the snapshot in chunks.
23. The method of claim 22 , further comprising aggregating the chunked snapshot.
24. The method of claim 23 , wherein the chunked snapshot is aggregated after a determination that all chunks for the snapshot are received.
25. The method of claim 18 , further comprising rolling back the configuration state of the cluster to the stored configuration state.