Artificial-intelligence modeling utility system

1 . A method comprising:

receiving, by a modeling manager from an experience component, a request for data associated with an experience having multiple levels of testing, each lower level of testing having a set of one or more variants chained to a variant of a higher level of testing;

based on the request, determining which variant of the multiple levels of testing to provide to a user, the determining comprising:

detecting a lowest segment associated with the experience the user is a member of, each segment level corresponding to a level of testing;

selecting a variant from one of a corresponding set of one or more variants of the lowest segment, a chained variant of a parent segment, or a control value, the selecting comprising using the modeling manager to concurrently execute a plurality of models targeted at different sets of users, evaluating a performance of each of the concurrently executed models, and selecting a model of the plurality of models based on the evaluated performance; and

removing a lowest level of testing from the multiple levels of testing, wherein members of a segment corresponding to the lowest level of testing are removed to fall into an immediate parent segment;

transmitting, by the modeling manager, a response to the experience component that includes the selected variant; and

causing presentation, by the experience component, of the experience with the selected variant to the user.

2 . The method of claim 1 , further comprising:

adding a next level of testing to the experience that is at a lower level than any existing levels of testing, the adding comprising:

selecting members of a segment corresponding to a previous lowest level of testing to be added to a next segment corresponding to the next level of testing; and

chaining a further set of one or more variants associated with the next segment to a variant of the parent segment.

3 . The method of claim 1 , wherein selecting the variant is based in part on a percentage of users assigned to receive each of the one or more variants of the lowest segment.

4 . The method of claim 1 , further comprising:

chaining lower-level segments across different parent segments, wherein the lowest segment of the user is part of the chained lower-level segments.

5 . The method of claim 1 , further comprising:

monitoring, by an experiment tracking system, for an interaction with the experience having the selected variant.

6 . The method of claim 5 , further comprising:

based on the monitoring, increasing or decreasing a percentage of users assigned to receive each variant from the corresponding set of one or more variants of the lowest segment.

7 . The method of claim 1 , further comprising:

detecting a conflict between presenting the experience based on the variants associated with the lowest segment and presenting the experience based on variants associated with a second segment the user also is a member of;

determining a priority assigned to the lowest segment and a priority assigned to the second segment; and

causing presentation of the experience based on the variants associated with a higher priority, the experience associated with the lowest segment having the higher priority.

8 . The method of claim 1 , further comprising:

detecting a conflict between presenting the experience based on the variants associated with the lowest segment and the experience based on variants associated with a second segment the user also is a member of;

determining that a priority is not assigned to the lowest segment or the second segment; and

causing presentation of the experience based on the variants associated with a segment with a least number of members, the experience associated with the lowest segment having the least number of members.

9 . A system comprising:

one or more processors; and

a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving, by a modeling manager from an experience component, a request for data associated with an experience having multiple levels of testing, each lower level of testing having a set of one or more variants chained to a variant of a higher level of testing;

based on the request, determining which variant of the multiple levels of testing to provide to a user, the determining comprising:

detecting a lowest segment associated with the experience the user is a member of, each segment level corresponding to a level of testing;

selecting a variant from one of a corresponding set of one or more variants of the lowest segment, a chained variant of a parent segment, or a control value, the selecting comprising using the modeling manager to concurrently execute a plurality of models targeted at different sets of users, evaluating a performance of each of the concurrently executed models, and selecting a model of the plurality of models based on the evaluated performance; and

removing a lowest level of testing from the multiple levels of testing, wherein members of a segment corresponding to the lowest level of testing are removed to fall into an immediate parent segment;

transmitting, by the modeling manager, a response to the experience component that includes the selected variant; and

causing presentation, by the experience component, of the experience with the selected variant to the user.

10 . The system of claim 9 , wherein the operations further comprise:

adding a next level of testing to the experience that is at a lower level than any existing levels of testing, the adding comprising:

selecting members of a segment corresponding to a previous lowest level of testing to be added to a next segment corresponding to the next level of testing; and

chaining a further set of one or more variants associated with the next segment to a variant of a parent segment.

11 . The system of claim 9 , wherein selecting the variant is based in part on a percentage of users assigned to receive each of the one or more variants of the lowest segments.

12 . The system of claim 9 , wherein the operations further comprise:

chaining lower-level segments across different parent segments, wherein the lowest segment of the user is part of the chained lower-level segments.

13 . The system of claim 9 , wherein the operations further comprise:

monitoring, by an experiment tracking system, for an interaction with the experience having the selected variant.

14 . The system of claim 13 , wherein the operations further comprise:

based on the monitoring, increasing or decreasing a percentage of users assigned to receive each variant from the corresponding set of one or more variants of the lowest segment.

15 . The system of claim 9 , wherein the operations further comprise:

detecting a conflict between presenting the experience based on the variants associated with the lowest segment and presenting the experience based on variants associated with a second segment the user also is a member of;

determining a priority assigned to the lowest segment and a priority assigned to the second segment; and

causing presentation of the experience based on the variants associated with a higher priority, the experience associated with the lowest segment having the higher priority.

16 . The system of claim 9 , wherein the operations further comprise:

detecting a conflict between presenting the experience based on the variants associated with the lowest segment and the experience based on variants associated with a second segment the user also is a member of;

determining that a priority is not assigned to the lowest segment or the second segment; and

causing presentation of the experience based on the variant associated with a segment with a least number of members, the experience associated with the lowest segment having the least number of members.

17 . A machine-storage medium comprising instructions which, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving, by a modeling manager from an experience component, a request for data associated with an experience having multiple levels of testing, each lower level of testing having a set of one or more variants chained to a variant of a higher level of testing;

based on the request, determining which variant of the multiple levels of testing to provide to a user, the determining comprising:

detecting a lowest segment associated with the experience the user is a member of, each segment level corresponding to a level of testing;

selecting a variant from one of a corresponding set of one or more variants of the lowest segment, a chained variant of a parent segment, or a control value, the selecting comprising using the modeling manager to concurrently execute a plurality of models targeted at different sets of users, evaluating a performance of each of the concurrently executed models, and selecting a model of the plurality of models based on the evaluated performance; and

removing a lowest level of testing from the multiple levels of testing, wherein members of a segment corresponding to the lowest level of testing are removed to fall into an immediate parent segment;

transmitting, by the modeling manager, a response to the experience component that includes the selected variant; and

causing presentation, by the experience component, of the experience with the selected variant to the user.