Systems and methods for storing and transporting configuration data to edge servers
Systems and methods for ingesting, managing, and distributing configuration data in one or more computing networks are provided. In examples, a flexible configuration definition framework is provided to allow for simplified ingestion, management, and distribution of configuration data to various computing devices in complex networks. Rather than table data, the framework permits expression of configuration settings in a non-relational, text-based data format to allow easy searching and filtering of configuration data and targeted distribution of data to machines and applications within the network(s).
1 . A system, comprising:
at least one processing circuit; and
memory, operatively connected to the at least one processing circuit and storing instructions that, when executed by the at least one processing circuit, cause the system to perform a method, the method comprising:
storing at least one configuration document comprising a plurality of configuration tags, wherein the at least one configuration document comprises a non-relational, text-based data format, and wherein, for each configuration tag of the plurality of configuration tags, a configuration tag name and a configuration setting array, and wherein the configuration setting array comprises at least one configuration value and at least one configuration scope;
determining a first subset of the configuration tags of the at least one configuration document applicable to a first edge node of a network;
determining a second subset of the configuration tags of the at least one configuration document applicable to a second edge node of the network;
providing at least a first configuration tag-value (CTV) pair for the first subset of the configuration tags; and
providing at least a second CTV pair for the second subset of the configuration tags,
wherein providing the first CTV pair comprises:
receiving a configuration file request, wherein the configuration file request comprises an indication of a configuration file template and at least one text string comprising a first configuration tag name;
searching the at least one configuration document for the first configuration tag name;
replacing the at least one text string in the configuration file template with the at least one configuration value for the first configuration tag name to generate a configuration file; and
returning the configuration file.
2 . The system of claim 1 , wherein the method further comprises:
providing, at a configuration provisioning system of a network, a configuration input interface, wherein the configuration input interface requires, for each configuration tag of the plurality of configuration tags, the configuration tag name and the configuration setting array;
sending, by the configuration provisioning system and based on the at least one configuration document, a first configuration document to a first intermediate server and a second configuration document to a second intermediate server, wherein the first configuration document and the second configuration document are different;
wherein the first intermediate server determines the first subset from the first configuration document and the second intermediate server determines the second subset from the second configuration document.
3 . The system of claim 2 , wherein determining, by the first intermediate server, the first subset comprises determining a first set of agents operating at the first edge node of the network and determining that the first subset is applicable to the first set of agents.
4 . The system of claim 3 , wherein determining, by the first intermediate server, the first subset comprises receiving at least one query for configuration tags from the first edge node.
5 . The system of claim 3 , wherein determining, by the first intermediate server, the first subset comprises searching the first configuration document for any configuration scope satisfied by an agent in the first set of agents.
6 . The system of claim 5 , wherein searching the first configuration document for any configuration scope satisfied by an agent in the first set of agents comprises determining that a first set of devices is operating at the first edge node and that a first set of applications is operating on the first set of devices at the first edge node.
7 . The system of claim 6 , wherein the first set of agents comprises a first application executing on a first device of the first edge node and a second application executing on the first device of the first edge node, and wherein providing at least the first configuration tag-value (CTV) pair for the first subset of the configuration tags comprises providing the first CTV pair for the first application and a third CTV pair for the second application.
8 . The system of claim 7 , wherein each of the configuration tag names of the plurality of configuration tags includes a domain and a property, and wherein the method further comprises determining that the first CTV pair is associated with the first application based on at least one of the domain or the property of a first configuration tag name.
9 . The system of claim 1 , wherein the plurality of configuration tags includes a first configuration tag, and the first configuration tag comprises a first setting array comprising a first configuration setting and a second configuration setting, and the first configuration setting comprises a first configuration value and a first configuration scope, and the second configuration setting comprises a second configuration value and a second configuration scope.
10 . The system of claim 1 , wherein:
the plurality of configuration tags comprises a first configuration tag and a second configuration tag;
the first configuration tag comprises a first configuration tag name, a first configuration tag value, and a first configuration tag scope; and
the second configuration tag comprises a second configuration tag name, a second configuration tag value, and a second configuration tag scope that is defined based on the first configuration tag.
11 . The system of claim 2 , wherein providing the first CTV pair comprises sending the first CTV pair to the first edge node from the first intermediate node.
12 . A method, comprising:
storing at least one configuration document comprising a plurality of configuration tags, wherein the at least one configuration document comprises a non-relational, text-based data format, and wherein, for each configuration tag of the plurality of configuration tags, a configuration tag name and a configuration setting array, and wherein the configuration setting array comprises at least one configuration value and at least one configuration scope;
determining a first subset of the configuration tags of the at least one configuration document applicable to a first edge node of a network;
determining a second subset of the configuration tags of the at least one configuration document applicable to a second edge node of the network;
providing at least a first configuration tag-value (CTV) pair for the first subset of the configuration tags; and
providing at least a second CTV pair for the second subset of the configuration tags,
wherein providing the first CTV pair comprises:
receiving a configuration file request, wherein the configuration file request comprises an indication of a configuration file template and at least one text string comprising a first configuration tag name;
searching the at least one configuration document for the first configuration tag name;
replacing the at least one text string in the configuration file template with the at least one configuration value for the first configuration tag name to generate a configuration file; and
returning the configuration file.
13 . The method of claim 12 , further comprising:
providing, at a configuration provisioning system of a network, a configuration input interface, wherein the configuration input interface requires, for each configuration tag of the plurality of configuration tags, the configuration tag name and the configuration setting array;
sending, by the configuration provisioning system and based on the at least one configuration document, a first configuration document to a first intermediate server and a second configuration document to a second intermediate server, wherein the first configuration document and the second configuration document are different;
wherein the first intermediate server determines the first subset from the first configuration document and the second intermediate server determines the second subset from the second configuration document.
14 . The method of claim 13 , wherein determining, by the first intermediate server, the first subset comprises determining a first set of agents operating at the first edge node of the network and determining that the first subset is applicable to the first set of agents.
15 . The method of claim 14 , wherein determining, by the first intermediate server, the first subset comprises searching the first configuration document for any configuration scope satisfied by an agent in the first set of agents.
16 . The method of claim 15 , wherein searching the first configuration document for any configuration scope satisfied by an agent in the first set of agents comprises determining that a first set of devices is operating at the first edge node and that a first set of applications is operating on the first set of devices at the first edge node.
17 . The method of claim 13 , wherein providing the first CTV pair comprises sending the first CTV pair to the first edge node from the first intermediate node.
18 . A method, comprising:
providing, at a configuration provisioning system of a network, a configuration input interface, wherein the configuration input interface requires, for each configuration tag of a plurality of configuration tags, a configuration tag name and a configuration setting array;
storing at least one configuration document comprising the plurality of configuration tags, wherein the at least one configuration document comprises a non-relational, text-based data format, and wherein, for each configuration tag of the plurality of configuration tags, the configuration tag name and the configuration setting array, and wherein the configuration setting array comprises at least one configuration value and at least one configuration scope;
sending, by the configuration provisioning system and based on the at least one configuration document, a first configuration document to a first intermediate server and a second configuration document to a second intermediate server, wherein the first configuration document and the second configuration document are different;
determining a first subset of the configuration tags of the at least one configuration document applicable to a first edge node of the network, wherein the first intermediate server determines the first subset from the first configuration document;
determining a second subset of the configuration tags of the at least one configuration document applicable to a second edge node of the network, wherein the second intermediate server determines the second subset from the second configuration document;
providing at least a first configuration tag-value (CTV) pair for the first subset of the configuration tags; and
providing at least a second CTV pair for the second subset of the configuration tags,
wherein providing the first CTV pair comprises:
receiving a configuration file request, wherein the configuration file request comprises an indication of a configuration file template and at least one text string comprising a first configuration tag name;
searching the at least one configuration document for the first configuration tag name;
replacing the at least one text string in the configuration file template with the at least one configuration value for the first configuration tag name to generate a configuration file; and
returning the configuration file.