Single node and multiple node datastore architecture in a network routing environment
Systems, methods, and devices for offloading network data to a datastore. A system includes a plurality of instances of a datastore node in a single networking device, each of the plurality of instances of the datastore node comprising: a datastore; a publisher independent of the datastore for publishing data to the datastore; a subscriber independent of the datastore for receiving information from the datastore; a replicator agent configured to connect to the datastore as a publisher or a subscriber; and a persistent storage agent configured to connect to the datastore as a publisher or a subscriber.
1. A system comprising:
a datastore node in a single networking device, wherein the single networking device is a switch or a router, and wherein the datastore node comprises:
a datastore stored on the single networking device;
a publisher executing on the single networking device; and
a subscriber executing on the single networking device; and
an index server in communication with the datastore node;
wherein the index server updates a list of publishers and subscribers in response to receiving a notification from the subscriber indicating a desire to subscribe to a certain dataset;
wherein the index server comprises one or more processors configured to execute instructions stored in non-transitory computer readable storage media, the instructions comprising:
maintaining a database index comprising a mapping of datasets in the datastore node;
maintaining the list of publishers and subscribers for each of the datasets in the datastore node;
updating the database index in response to receiving a notification that one or more of the datasets in the datastore node has been modified; and
updating the list of publishers and subscribers in response to receiving a notification from the subscriber indicating a desire to subscribe to a certain dataset.
2. The system of claim 1 , wherein the system comprises a plurality of instances of the datastore node on the single networking device.
3. The system of claim 1 , wherein the publisher is independent of the datastore and configured to publish data to the datastore;
wherein the subscriber is independent of the datastore and configured to receive information from the datastore.
4. The system of claim 1 , wherein the datastore comprises a database storing best path information for a plurality of switches and a plurality of routers operating within a network topology.
5. The system of claim 1 , wherein the datastore comprises a database storing state information for the single networking device, and wherein the state information comprises one or more of CPU utilization, temperature, or fan speed.
6. The system of claim 1 , wherein the datastore comprises a database index and further comprises a plurality of database hosts; and
wherein each of the plurality of database hosts comprises a processor and cache memory.
7. The system of claim 1 , further comprising a plurality of datastore nodes each physically located in the single networking device, and wherein each of the plurality of datastore nodes comprises an independent instance of:
the datastore, wherein the datastore stores state information;
the publisher; and
the subscriber.
8. The system of claim 7 , wherein the index server is a single instance of the index server configured to register and subscribe interests to certain datasets stored across the plurality of datastore nodes.
9. The system of claim 7 , further comprising a replicator agent configured to replicate a database between two or more of the plurality of datastore nodes in the single networking device.
10. The system of claim 9 , wherein the replicator agent is a consumer for all data objects produced by the plurality of datastore nodes in the single networking device.
11. The system of claim 10 , wherein the replicator agent is a producer for data objects produced on a remote datastore node that is not physically located in the single networking device.
12. The system of claim 7 , further comprising a persistent storage agent in communication with each of the plurality of datastore nodes located in the single networking device.
13. The system of claim 12 , wherein the persistent storage agent comprises a plurality of shared storage devices collectively storing a plurality of datasets, and wherein each of the plurality of shared storage devices is accessible by each instance of a host server.
14. The system of claim 1 , wherein the publisher is configured to communicate with a hosting server and publish additions, modifications, deletions, and data objects to the hosting server.
15. The system of claim 1 , wherein the index server notifies the subscriber of additions, modifications, and deletions to data objects connected to an appropriate hosting server.
16. The system of claim 1 , further comprising controller logic offloaded to cloud-based storage, wherein the controller logic is accessible to the datastore node.
17. The system of claim 1 , wherein the instructions executed by the index server further comprise wherein the instructions further comprise retrieving controller logic from cloud-based storage.
18. The system of claim 1 , wherein the instructions executed by the index server further comprise receiving a message from a persistent storage agent configured to store data objects in a persistent data storage device, wherein the persistent storage agent can interact with the index server as a publisher or as a subscriber.
19. A system comprising:
a datastore node in a single networking device, wherein the single networking device is a switch or a router, and wherein the datastore node comprises:
a datastore stored on the single networking device;
a publisher executing on the single networking device; and
a subscriber executing on the single networking device; and
an index server in communication with the datastore node;
wherein the index server updates a list of publishers and subscribers in response to receiving a notification from the subscriber indicating a desire to subscribe to a certain dataset;
further comprising a plurality of datastore nodes each physically located in the single networking device, and wherein each of the plurality of datastore nodes comprises an independent instance of:
the datastore, wherein the datastore stores state information;
the publisher; and
the subscriber; wherein the index server is a single instance of the index server configured to register and subscribe interests to certain datasets stored across the plurality of datastore nodes;
wherein the single instance of the index server manages the plurality of datastore nodes located in the single networking device, and wherein the single instance of the index server is configured to:
maintain a database index comprising a mapping of datasets in the plurality of datastore nodes; and
maintain the list of publishers and subscribers for each of a plurality of datasets distributed across the plurality of datastore nodes.