Autonomous configuration-based release orchestration
A method and apparatus for autonomous configuration-based release orchestration. A first engine obtains stagger configuration data that includes an indication of container clusters in each stagger and a stagger order, selects a current stagger based on the order, and attempts to deploy the feature release to the current stagger by causing an app config update to be sent to a second engine within each container cluster of the current stagger, and receives an indication of success or failure of the attempted deployment of the feature release to the current stagger. Responsive to the indication of success or failure, the first engine performs one of a plurality of actions that include attempting to deploy the feature release to a next one of the staggers according to the order responsive to the indication indicating success, and causing a roll back of the current stagger responsive to the indication indicating failure.
1 . A method for autonomous configuration-based release orchestration that supports deployment of a staggered feature release to a plurality of container clusters in different staggers, wherein the container clusters include instances of an application having a plurality of features that each have a state that may be changed, the method comprising:
by a first engine outside of the container clusters, managing the deployment of the staggered feature release to a plurality of staggers, each stagger including a subset of the plurality of container clusters, the managing including:
obtaining stagger configuration data indicative of the subset of container clusters to be included in each of the plurality of staggers and indicative of an order of the staggers;
selecting one of the plurality of staggers as a current stagger based on the order;
sending data indicative of an application configuration update to a respective second engine within each container cluster of the subset of container clusters in the current stagger, wherein the data indicative of the application configuration update causes the respective second engine within each container cluster of the subset of container clusters in the current stagger to update the state of at least one of the features of the application to enabled or disabled;
receiving an indication of success or failure of the feature release to the current stagger; and
responsive to the indication of success or failure, performing one of a plurality of actions, wherein the plurality of actions includes i) processing a next one of the plurality of staggers according to the order responsive to the indication indicating success, and ii) causing a roll back of the current stagger responsive to the indication indicating failure.
2 . The method of claim 1 , wherein the data indicative of an application configuration update includes an indication of the application, and wherein the indication of the application enables the second engines within the container clusters to identify which containers within the container clusters are one of the containers including an instance of the application.
3 . The method of claim 1 , wherein the first engine includes a release manager and a third engine, wherein the release manager performs the selecting and the performing one of a plurality of actions, wherein the third engine performs the sending and the receiving, and wherein the method further comprises:
by the release manager, sending an indication of the current stagger to the third engine.
4 . The method of claim 1 , further comprising:
by one of the second engines within a respective one of the container clusters, attempting to deploy the feature release to the respective container cluster, by:
identifying which containers within the respective container cluster are ones of the containers including an instance of the application;
changing the state of the features as indicated in the application configuration update;
causing the change to be applied to the identified containers;
determining an indication of success or failure of the attempted deployment of the feature release to the respective container cluster;
responsive to the indication indicating failure, causing a roll back of the respective container cluster; and
providing, to the first engine, the indication of success or failure of the attempted deployment of the feature release to the respective container cluster.
5 . The method of claim 1 , further comprising:
by a monitor outside of the container clusters, collecting information regarding the deployment of the feature release to the current stagger based on logs generated by the container clusters and/or instances of the application in the current stagger, and wherein the indication of success or failure is based on the collected information.
6 . The method of claim 1 , wherein the stagger configuration data includes a stagger-level threshold associated with each stagger of the plurality of staggers, and wherein the first engine rolls back the staggered feature release responsive to a result of the deployment of the feature release to the current stagger being indicative of the stagger-level threshold associated with the current stagger not being met.
7 . The method of claim 1 , wherein the obtaining the stagger configuration data comprises:
generating the stagger configuration data based on a set of one or more inputs, wherein the set of one or more inputs includes at least indications of geographic regions where the container clusters are located.
8 . An article of manufacture comprising:
a non-transitory machine-readable storage medium that provides instructions that, if executed by a set of one or more processors, are configurable to cause the set of processors to perform operations for autonomous configuration-based release orchestration that supports deployment of a staggered feature release to a plurality of container clusters in different staggers, wherein the container clusters include instances of an application having a plurality of features that each have a state that may be changed, the operations comprising,
by a first engine outside of the container clusters, managing the deployment of the staggered feature release to a plurality of staggers, each stagger including a subset of the plurality of container clusters, the managing including:
obtaining stagger configuration data indicative of the subset of container clusters to be included in each of the plurality of staggers and indicative of an order of the staggers;
selecting one of the plurality of staggers as a current stagger based on the order;
sending data indicative of an application configuration update to a respective second engine within each container cluster of the subset of container clusters in the current stagger, wherein the data indicative of the application configuration update causes the respective second engine within each container cluster of the subset of container clusters in the current stagger to update the state of at least one of the features of the application to enabled or disabled;
receiving an indication of success or failure of the feature release to the current stagger; and
responsive to the indication of success or failure, performing one of a plurality of actions, wherein the plurality of actions includes i) processing a next one of the plurality of staggers according to the order responsive to the indication indicating success, and ii) causing a roll back of the current stagger responsive to the indication indicating failure.
9 . The article of manufacture of claim 8 , wherein the data indicative of an application configuration update includes an indication of the application, and wherein the indication of the application enables the second engines within the container clusters to identify which containers within the container clusters are one of the app containers including an instance of the application.
10 . The article of manufacture of claim 8 , wherein the first engine includes a release manager and a third engine, wherein the release manager performs the selecting and the performing one of a plurality of actions, wherein the third engine performs the sending and the receiving, and wherein the operations further comprise:
by the release manager, sending an indication of the current stagger to the third engine.
11 . The article of manufacture of claim 8 , the operations further comprising:
by one of the second engines within a respective one of the container clusters, attempting to deploy the feature release to the respective container cluster, by:
identifying which containers within the respective container cluster are ones of the containers including an instance of the application;
changing the state of the features as indicated in the application configuration update;
causing the change to be applied to the identified containers;
determining an indication of success or failure of the attempted deployment of the feature release to the respective container cluster;
responsive to the indication indicating failure, causing a roll back of the respective container cluster; and
providing, to the first engine, the indication of success or failure of the attempted deployment of the feature release to the respective container cluster.
12 . The article of manufacture of claim 8 , the operations further comprising:
by a monitor outside of the container clusters, collecting information regarding the deployment of the feature release to the current stagger based on logs generated by the container clusters and/or instances of the application in the current stagger, and wherein the indication of success or failure is based on the collected information.
13 . The article of manufacture of claim 8 , wherein the stagger configuration data includes a stagger-level threshold associated with each stagger of the plurality of staggers, and wherein the first engine rolls back the staggered feature release responsive to a result of the deployment of the feature release to the current stagger being indicative of the stagger-level threshold associated with the current stagger not being met.
14 . The article of manufacture of claim 8 , wherein the obtaining the stagger configuration data comprises:
generating the stagger configuration data based on a set of one or more inputs, wherein the set of one or more inputs includes at least indications of geographic regions where the container clusters are located.
15 . An apparatus comprising:
a set of one or more processors; and
a non-transitory machine-readable storage medium that provides instructions that, if executed by the set of one or more processors, are configurable to cause the apparatus to perform operations for autonomous configuration-based release orchestration that supports deployment of a staggered feature release to a plurality of container clusters in different staggers, wherein the container clusters include instances of an application having a plurality of features that each have a state that may be changed, the operations comprising,
by a first engine outside of the container clusters, managing the deployment of the staggered feature release to a plurality of staggers, each stagger including a subset of the plurality of container clusters, the managing including:
obtaining stagger configuration data indicative of the subset of container clusters to be included in each of the plurality of staggers and indicative of an order of the staggers;
selecting one of the plurality of staggers as a current stagger based on the order;
sending data indicative of an application configuration update to a respective second engine within each container cluster of the subset of container clusters in the current stagger, wherein the data indicative of the application configuration update causes the respective second engine within each container cluster of the subset of container clusters in the current stagger to update the state of at least one of the features of the application to enabled or disabled;
receiving an indication of success or failure of the feature release to the current stagger; and
responsive to the indication of success or failure, performing one of a plurality of actions, wherein the plurality of actions includes i) processing a next one of the plurality of staggers according to the order responsive to the indication indicating success, and ii) causing a roll back of the current stagger responsive to the indication indicating failure.
16 . The apparatus of claim 15 , wherein the data indicative of an application configuration update includes an indication of the application, and wherein the indication of the application enables the second engines within the container clusters to identify which containers within the container clusters are one of the containers including an instance of the application.
17 . The apparatus of claim 15 , wherein the first engine includes a release manager and a third engine, wherein the release manager performs the selecting and the performing one of a plurality of actions, wherein the third engine performs the sending and the receiving, and wherein the operations further comprise:
by the release manager, sending an indication of the current stagger to the third engine.
18 . The apparatus of claim 15 , the operations further comprising:
by one of the second engines within a respective one of the container clusters, attempting to deploy the feature release to the respective container cluster, by:
identifying which containers within the respective container cluster are ones of the containers including an instance of the application;
changing the state of the features as indicated in the application configuration update;
causing the change to be applied to the identified containers;
determining an indication of success or failure of the attempted deployment of the feature release to the respective container cluster;
responsive to the indication indicating failure, causing a roll back of the respective container cluster; and
providing, to the first engine, the indication of success or failure of the attempted deployment of the feature release to the respective container cluster.
19 . The apparatus of claim 15 , the operations further comprising:
by a monitor outside of the container clusters, collecting information regarding the deployment of the feature release to the current stagger based on logs generated by the container clusters and/or instances of the application in the current stagger, and wherein the indication of success or failure is based on the collected information.
20 . The apparatus of claim 15 , wherein the stagger configuration data includes a stagger-level threshold associated with each stagger of the plurality of staggers, and wherein the first engine rolls back the staggered feature release responsive to a result of the deployment of the feature release to the current stagger being indicative of the stagger-level threshold associated with the current stagger not being met.