EVENT OPTIMIZATION IN A MULTI-TENANT COMPUTING ENVIRONMENT
Machine learning-based techniques are described that enable modifying an event timing schedule in a multi-tenant computing environment. The multi-tenant computing environment stores tenant data of multiple tenants. Each tenant of the multiple tenants offers subscription services to subscribers. Multiple events involving multiple subscribers of a particular tenant are attempted. The multiple events include a first subset of successfully executed events and a second subset of unsuccessfully executed events. One or more training datasets are generated based on the first subset and the second subset. The one or more training datasets include contextual information corresponding to each of the multiple events. The contextual information includes multilevel data. A machine learning model is trained to output a timing schedule for retrying a particular unsuccessfully executed event of a particular subscriber.
1 . A method of modifying an event timing schedule in a multi-tenant computing environment, the multi-tenant computing environment storing tenant data of multiple tenants, each tenant of the multiple tenants offering subscription services to subscribers, the method comprising:
attempting to execute multiple events involving multiple subscribers of a particular tenant of the multiple tenants, the multiple events including a first subset of successfully executed events and a second subset of unsuccessfully executed events;
generating one or more training datasets based on the first subset of successfully executed events and the second subset of unsuccessfully executed events, the one or more training datasets comprising contextual information corresponding to each of the multiple events, the contextual information comprising multilevel data;
training, based on the one or more training datasets, a retry optimization machine learning model to output a timing schedule for retrying a particular unsuccessfully executed event associated with a particular subscriber, the timing schedule being based on contextual information associated with the particular unsuccessfully executed event; and
retrying the particular unsuccessfully executed event in accordance with the outputted timing schedule.
2 . The method of claim 1 , wherein the multiple events are a plurality of attempted payment transactions, the particular unsuccessfully executed event is a particular attempted payment transaction corresponding to a particular subscriber of the particular tenant, the timing schedule is a payment retry timing schedule, and the multilevel data comprises any combination of two or more of subscriber level data, tenant level data, account level data, and invoice and payment level data.
3 . The method of claim 2 , wherein the multilevel data comprises the subscriber level data, and the subscriber level data comprises an oldest subscription age of the particular subscriber with respect to the particular tenant.
4 . The method of claim 2 , wherein the multilevel data comprises the account level data, the account level data comprising a historical document success rate (DSR) indicative of a number of previous payments that were unsuccessfully executed and a number of previous payments that were successfully executed.
5 . The method of claim 2 , wherein the multilevel data comprises the tenant level data, the tenant level data comprising a category or industry that the tenant belongs to, and a revenue band that the tenant belongs to.
6 . The method of claim 2 , wherein the payment retry timing schedule is implemented by:
obtaining an overall payment retry period for retrying the particular attempted payment transaction;
obtaining a required number of retries within a duration of the overall payment retry period; and
scheduling an initial retry at least a threshold number of days before a last day of the overall payment retry period, wherein the threshold number of days is based on the required number of remaining retries.
7 . The method of claim 2 , further comprising:
in response to training the retry optimization machine learning model, testing the trained retry optimization machine learning model using one or more testing datasets to evaluate the training of the retry optimization machine learning model.
8 . The method of claim 7 , further comprising:
in response to testing the trained retry optimization machine learning model, providing feedback to the trained retry optimization machine learning model based on the testing, wherein the feedback comprises one or more particular attributes that were associated with highest error rates, compared to other attributes, or that the one or more particular attributes were associated with error rates above a particular threshold;
generating one or more additional training datasets based on the feedback, wherein the one or more additional training datasets comprise the particular attributes; and
retraining the retry optimization machine learning model based on the generated one or more additional training datasets.
9 . The method of claim 2 , the training of the retry optimization machine learning model is further based on a type of error associated with the particular attempted payment transaction.
10 . The method of claim 9 , wherein the type of error comprises a network connectivity or an electronic transmission error.
11 . The method of claim 1 , wherein the outputting of the timing schedule is tenant-specific and comprises determining one or more durations between successive retry events, the determining of the one or more durations being based on one or more historical success rates or historical probabilities of success associated with previous durations between historical successive retried events.
12 . A system for modifying an event timing schedule in a multi-tenant computing environment, the multi-tenant computing environment storing tenant data of multiple tenants, each tenant of the multiple tenants offering subscription services to subscribers, the system comprising:
at least one memory storing computer-executable instructions; and
at least one processor configured to access the at least one memory and execute the computer-executable instructions to:
attempt to execute multiple events involving multiple subscribers of a particular tenant of the multiple tenants, the multiple events including a first subset of successfully executed events and a second subset of unsuccessfully executed events;
generate one or more training datasets based on the first subset of successfully executed events and the second subset of unsuccessfully executed events, the one or more training datasets comprising contextual information corresponding to each of the multiple events, the contextual information comprising multilevel data;
train, based on the one or more training datasets, a retry optimization machine learning model to output a timing schedule for retrying a particular unsuccessfully executed event associated with a particular subscriber, the timing schedule being based on contextual information associated with the particular unsuccessfully executed event; and
retry the particular unsuccessfully executed event in accordance with the outputted timing schedule.
13 . The system of claim 12 , wherein the multiple events are a plurality of attempted payment transactions, the particular unsuccessfully executed event is a particular attempted payment transaction corresponding to a particular subscriber of the particular tenant, the timing schedule is a payment retry timing schedule, and the multilevel data comprises any combination of two or more of subscriber level data, tenant level data, account level data, and invoice and payment level data.
14 . The system of claim 13 , wherein the multilevel data comprises the subscriber level data, and the subscriber level data comprises an oldest subscription age of the particular subscriber with respect to the particular tenant.
15 . The system of claim 13 , wherein the multilevel data comprises the account level data, the account level data comprising a historical document success rate (DSR) indicative of a number of previous payments that were unsuccessfully executed and a number of previous payments that were successfully executed.
16 . The system of claim 13 , wherein the multilevel data comprises the tenant level data, the tenant level data comprising a category or industry that the tenant belongs to, and a revenue band that the tenant belongs to.
17 . The system of claim 13 , wherein the payment retry timing schedule is implemented by:
obtaining an overall payment retry period for retrying the particular attempted payment transaction;
obtaining a required number of retries within a duration of the overall payment retry period; and
scheduling an initial retry at least a threshold number of days before a last day of the overall payment retry period, wherein the threshold number of days is based on the required number of remaining retries.
18 . The system of claim 13 , wherein the at least one processor is further configured to execute the computer-executable instructions to:
in response to training the retry optimization machine learning model, testing the trained retry optimization machine learning model using one or more testing datasets to evaluate the training of the retry optimization machine learning model.
19 . The system of claim 18 , wherein the at least one processor is further configured to execute the computer-executable instructions to:
in response to testing the trained retry optimization machine learning model, providing feedback to the trained retry optimization machine learning model based on the testing, wherein the feedback comprises one or more particular attributes that were associated with highest error rates, compared to other attributes, or that the one or more particular attributes were associated with error rates above a particular threshold;
generating one or more additional training datasets based on the feedback, wherein the one or more additional training datasets comprise the particular attributes; and
retraining the retry optimization machine learning model based on the generated one or more additional training datasets.
20 . The system of claim 13 , wherein the training of the retry optimization machine learning model is further based on a type of error associated with the particular attempted payment transaction.
21 . The system of claim 20 , wherein the type of error comprises a network connectivity or an electronic transmission error.
22 . The system of claim 12 , wherein the outputting of the timing schedule is tenant-specific and comprises determining one or more durations between successive retry events, the determining of the one or more durations being based on one or more historical success rates or historical probabilities of success associated with previous durations between historical successive retried events.