IP Library Granted Patent US 12,437,253
Granted Patent B2
US 12,437,253 · App. 18/147,802 · Granted Oct 7, 2025

Automated workflow composer using unmodeled metric-based goals

Inventors: Sarath Sreedharan (Tempe, AZ); Tathagata Chakraborti (Cambridge, MA); Vinod Muthusamy (Austin, TX); Yara Rizk (Cambridge, MA); Yasaman Khazaeni (Needham, MA)
Assignee: International Business Machines Corporation
G06Q10/0633G06F9/4881
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,437,253
App. No.
18/147,802
Granted
Oct 7, 2025
Kind
B2
Abstract

Embodiments of the invention are directed to a programmable computer system that includes a processor system operable to perform processor system operations. The processor system operations include using a workflow composer to perform an automated workflow composition process that generates a composed workflow that is operable to, when executed by a host device, satisfy a target logical goal. Performing the automated workflow composition process includes using a workflow-metric model to control the automated workflow composition process such that the composed workflow is operable to, when executed by the host device, satisfy the target logical goal in a manner that optimizes a target metric goal. The target metric goal quantifies a performance feature of the composed workflow.

Claims (81)

1. An automated workflow composer comprising-a processor system that performs processor system operations comprising:

using a workflow generator of the processor system to perform an automated workflow composition process that generates a composed workflow that includes logical and metric goal characteristics comprising the composed workflow, when executed by a host device in a domain, satisfying a target logical goal in a manner that optimizes a target unmodeled metric goal;

wherein the composed workflow further includes a workflow sequence structure comprising multiple tasks and multiple cases;

wherein the multiple tasks comprise atomic tasks, multi-instance tasks, and multi-instance block tasks;

wherein the multiple cases are configured to execute on the host device in parallel and independently of one another;

wherein the automated workflow composition process comprises performing iterations of a sequential workflow evaluation process;

wherein each iteration of the sequential workflow evaluation process advances the automated workflow process toward generating the composed workflow that includes the logical and metric goal characteristics comprising the composed workflow, when executed by the host device in the domain, satisfying the target logical goal in the manner that optimizes the target unmodeled metric goal;

wherein each iteration of the sequential workflow evaluation process comprises:

using the workflow generator and an optimization engine to perform workflow generator operations and optimization engine operations to generate a candidate workflow sequence structure that is a candidate for the composed workflow, the candidate workflow sequence structure having an associated candidate logical goal that is a candidate for satisfying the target logical goal;

using the workflow-metric model of the workflow generator to incorporate a workflow-metric function into the workflow sequence generation operations and the optimization engine operations, wherein the workflow-metric function generates a predicted metric that results from executing the candidate workflow sequence, wherein the predicted metric is a candidate for satisfying the target unmodeled metric goal; and

using the workflow metric model and the optimization engine to bias the workflow sequence generation operations toward the target unmodeled metric goal by using the predicted metric to determine how close the candidate workflow is to satisfying the target logical goal; and

wherein the workflow-metric model has been trained, using a historical workflow-metric corpus and a neural network that implements a sequential decision-making (SDM) algorithm and a long short-term memory (LSTM) algorithm, to uncover the workflow-metric function;

wherein the historical workflow-metric corpus is generated by:

accessing already-performed workflow sequences from multiple domains; and

labeling the already-performed workflow sequences with multiple types of metrics that measure performance results of the already-performed historical workflow sequences; and

wherein the target unmodeled metric goals are unmodeled in that the target unmodeled metric goals correspond to the multiple types of metrics that measure the performance results of the already-performed historical workflow sequences; and

responsive to generating the composed workflow, converting the composed workflow into host-executable instructions, storing the host-executable instructions in non-volatile memory of the host device for execution of parallel threads corresponding to the multiple cases, such that each thread executes its respective case independently and in parallel, and wherein execution of the composed workflow by the host device expressly modifies a memory state of the host device in real time as the workflow progresses.

2. The automated workflow composer of claim 1 , wherein the target unmodeled metric goal quantifies a performance feature of the composed workflow.

3. The automated workflow composer of claim 1 , wherein the workflow-metric function comprises learned relationships between workflow sequences and metric-based goals.

4. The automated workflow composer of claim 1 , wherein the workflow sequence generation operations comprise searching a plurality of combinations of possible workflows.

5. The automated workflow composer of claim 1 , wherein:

the host device comprises a conversational agent; and

the target logical goal comprises a state of the conversational agent that can be either true or false.

6. The automated workflow composer of claim 1 , wherein the automated workflow composition process generates the composed workflow based at least in part on the target logical goal, the target unmodeled metric goal, and features of the domain.

7. The automated workflow composer of claim 1 , wherein:

the target unmodeled metric goal comprises a key performance indicator (KPI) goal; and

the workflow-metric model comprises a sequence-to-value predictor.

8. A computer-implemented method comprising:

using a workflow generator comprising a processor system to perform an automated workflow composition process that generates a composed workflow that includes logical and metric goal characteristics comprising the composed workflow, when executed by a host device in a domain, satisfying a target logical goal in a manner that optimizes a target unmodeled metric goal;

wherein the composed workflow further includes a workflow sequence structure comprising multiple tasks and multiple cases;

wherein the multiple tasks comprise atomic tasks, multi-instance tasks, and multi-instance block tasks;

wherein the multiple cases are configured to execute on the host device in parallel and independently of one another; wherein the automated workflow composition process comprises performing iterations of a sequential workflow evaluation process;

wherein each iteration of the sequential workflow evaluation process advances the automated workflow process toward generating the composed workflow that includes the logical and metric goal characteristics comprising the composed workflow, when executed by the host device in the domain, satisfying the target logical goal in the manner that optimizes the target unmodeled metric goal;

wherein each iteration of the sequential workflow evaluation process comprises:

using the workflow generator and an optimization engine to perform workflow generator operations and optimization engine operations to generate a candidate workflow sequence structure that is a candidate for the composed workflow, the candidate workflow sequence structure having an associated candidate logical goal that is a candidate for satisfying the target logical goal;

using the workflow-metric model of the workflow generator to incorporate a workflow-metric function into the workflow sequence generation operations and the optimization engine operations, wherein the workflow-metric function generates a predicted metric that results from executing the candidate workflow sequence, wherein the predicted metric is a candidate for satisfying the target unmodeled metric goal; and

using the workflow metric model and the optimization engine to bias the workflow sequence generation operations toward the target unmodeled metric goal by using the predicted metric to determine how close the candidate workflow is to satisfying the target logical goal;

wherein the workflow-metric model has been trained, using a historical workflow-metric corpus and a neural network that implements a sequential decision-making (SDM) algorithm and a long short-term memory (LSTM) algorithm, to uncover the workflow-metric function;

wherein the historical workflow-metric corpus is generated by:

accessing already-performed workflow sequences from multiple domains; and

labeling the already-performed workflow sequences with multiple types of metrics that measure performance results of the already-performed historical workflow sequences; and

wherein the target unmodeled metric goals are unmodeled in that the target unmodeled metric goals correspond to the multiple types of metrics that measure the performance results of the already-performed historical workflow sequences; and

responsive to generating the composed workflow, converting the composed workflow into host-executable instructions, storing the host-executable instructions in non-volatile memory of the host device for execution of parallel threads corresponding to the multiple cases, such that each thread executes its respective case independently and in parallel, and wherein execution of the composed workflow by the host device expressly modifies a memory state of the host device in real time as the workflow progresses.

9. The computer-implemented method of claim 8 , wherein the target unmodeled metric goal quantifies a performance feature of the composed workflow.

10. The computer-implemented method of claim 8 , wherein the workflow-metric function comprises learned relationships between workflow sequences and metric-based goals.

11. The computer-implemented method of claim 8 , wherein the workflow sequence generation operations comprise searching a plurality of combinations of possible workflows.

12. The computer-implemented method of claim 8 , wherein:

the host device comprises a conversational agent; and

the target logical goal comprises a state of the conversational agent that can be either true or false.

13. The computer-implemented method of claim 8 , wherein the automated workflow composition process generates the composed workflow based at least in part on the target logical goal, the target unmodeled metric goal, and features of the domain.

14. The computer-implemented method of claim 8 , wherein:

the target unmodeled metric goal comprises a key performance indicator (KPI) goal; and

the workflow-metric model comprises a sequence-to-value predictor.

15. A computer program product comprising a computer readable program stored on a computer readable storage medium, wherein the computer readable program, when executed on a processor system, causes the processor system to perform processor system operations comprising:

using a workflow generator of the processor system to perform an automated workflow composition process that generates a composed workflow that includes logical and metric goal characteristics comprising the composed workflow, when executed by a host device in a domain, satisfying a target logical goal in a manner that optimizes a target unmodeled metric goal;

wherein the composed workflow further includes a workflow sequence structure comprising multiple tasks and multiple cases;

wherein the multiple tasks comprise atomic tasks, multi-instance tasks, and multi-instance block tasks;

wherein the multiple cases are configured to execute on the host device in parallel and independently of one another;

wherein the automated workflow composition process comprises performing iterations of a sequential workflow evaluation process;

wherein each iteration of the sequential workflow evaluation process advances the automated workflow process toward generating the composed workflow that includes the logical and metric goal characteristics comprising the composed workflow, when executed by the host device in the domain, satisfying the target logical goal in the manner that optimizes the target unmodeled metric goal;

wherein each iteration of the sequential workflow evaluation process comprises:

using the workflow generator and an optimization engine to perform workflow generator operations and optimization engine operations to generate a candidate workflow sequence structure that is a candidate for the composed workflow, the candidate workflow sequence structure having an associated candidate logical goal that is a candidate for satisfying the target logical goal;

using the workflow-metric model of the workflow generator to incorporate a workflow-metric function into the workflow sequence generation operations and the optimization engine operations, wherein the workflow-metric function generates a predicted metric that results from executing the candidate workflow sequence, wherein the predicted metric is a candidate for satisfying the target unmodeled metric goal; and

using the workflow metric model and the optimization engine to bias the workflow sequence generation operations toward the target unmodeled metric goal by using the predicted metric to determine how close the candidate workflow is to satisfying the target logical goal;

wherein the workflow-metric model has been trained, using a historical workflow-metric corpus and a neural network that implements a sequential decision-making (SDM) algorithm and a long short-term memory (LSTM) algorithm, to uncover the workflow-metric function;

wherein the historical workflow-metric corpus is generated by:

accessing already-performed workflow sequences from multiple domains; and

labeling the already-performed workflow sequences with multiple types of metrics that measure performance results of the already-performed historical workflow sequences; and

wherein the target unmodeled metric goals are unmodeled in that the target unmodeled metric goals correspond to the multiple types of metrics that measure the performance results of the already-performed historical workflow sequences; and

responsive to generating the composed workflow, converting the composed workflow into host-executable instructions, storing the host-executable instructions in non-volatile memory of the host device for execution of parallel threads corresponding to the multiple cases, such that each thread executes its respective case independently and in parallel, and wherein execution of the composed workflow by the host device expressly modifies a memory state of the host device in real time as the workflow progresses.

16. The computer program product of claim 15 , wherein the target unmodeled metric goal quantifies a performance feature of the composed workflow.

17. The computer program product of claim 15 , wherein:

the workflow-metric function comprises learned relationships between workflow sequences and metric-based goals; and

the workflow sequence generation operations comprise searching a plurality of combinations of possible workflows.

18. The computer program product of claim 15 , wherein:

the host device comprises a conversational agent; and

the target logical goal comprises a state of the conversational agent that can be either true or false.

19. The computer program product of claim 15 , wherein the automated workflow composition process generates the composed workflow based at least in part on the target logical goal, the target unmodeled metric goal, and features of the domain.

20. The computer program product of claim 15 , wherein:

the target unmodeled metric goal comprises a key performance indicator (KPI) goal; and

the workflow-metric model comprises a sequence-to-value predictor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2022
From: SREEDHARAN, SARATH; CHAKRABORTI, TATHAGATA; MUTHUSAMY, VINOD; RIZK, YARA; KHAZAENI, YASAMAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 062233/0590 →
Continuity (1)
Related Publication 20240220898A1 · Jul 4, 2024
References Cited (81)
US 5734837A · Flores · 1998 [cited by examiner]
US 7580911B2 · Sun · 2009 [cited by examiner]
US 8042091B2 · Koehler · 2011 [cited by examiner]
US 8136099B2 · Haller · 2012 [cited by examiner]
US 8332864B2 · Bose · 2012 [cited by examiner]
US 8442852B2 · Sun · 2013 [cited by examiner]
US 8756093B2 · Isozaki · 2014 [cited by examiner]
US 10032136B1 · Hamilton · 2018 [cited by examiner]
US 10079721B2 · Nair et al. · 2018 [cited by applicant]
US 10176003B2 · Zeng · 2019 [cited by applicant]
US 10282690B1 · DelFranco · 2019 [cited by examiner]
US 10554817B1 · Sullivan · 2020 [cited by examiner]
US 10586196B2 · Chen et al. · 2020 [cited by applicant]
US 10664777B2 · Volkov · 2020 [cited by examiner]
US 10832681B1 · Jethva · 2020 [cited by applicant]
US 10887423B2 · Somech et al. · 2021 [cited by applicant]
US 10909503B1 · Dias · 2021 [cited by examiner]
US 10923109B2 · Chakraborty · 2021 [cited by examiner]
US 10963642B2 · Douglas et al. · 2021 [cited by applicant]
US 11120379B2 · DelFranco · 2021 [cited by examiner]
US 11200539B2 · Iyer · 2021 [cited by examiner]
US 11397873B2 · Kalluri · 2022 [cited by examiner]
US 11477142B1 · Lewis · 2022 [cited by examiner]
US 11551171B2 · Rafferty · 2023 [cited by examiner]
US 11587007B2 · Geigel · 2023 [cited by examiner]
US 11615339B2 · Badhwar · 2023 [cited by examiner]
US 11625152B1 · Johnston · 2023 [cited by examiner]
US 11681964B2 · Shetty · 2023 [cited by examiner]
US 11755603B1 · Venkatesan · 2023 [cited by examiner]
US 11887034B2 · Shetty · 2024 [cited by examiner]
US 20040162741A1 · Flaxer · 2004 [cited by examiner]
US 20050043982A1 · Nguyen · 2005 [cited by examiner]
US 20050262489A1 · Streeter · 2005 [cited by examiner]
US 20070094211A1 · Sun · 2007 [cited by examiner]
US 20070118563A1 · Haller · 2007 [cited by examiner]
US 20080229276A1 · Koehler · 2008 [cited by examiner]
US 20080320486A1 · Bose · 2008 [cited by examiner]
US 20100287016A1 · Isozaki · 2010 [cited by examiner]
US 20140229225A1 · Bernier · 2014 [cited by examiner]
US 20170098180A1 · Chandraghatgi · 2017 [cited by examiner]
US 20180341533A1 · Shanbhag · 2018 [cited by examiner]
US 20190019112A1 · Gelfenbeyn et al. · 2019 [cited by applicant]
US 20190205726A1 · Khabiri et al. · 2019 [cited by applicant]
US 20190205792A1 · Huang · 2019 [cited by examiner]
US 20190238487A1 · Ciano · 2019 [cited by examiner]
US 20190251488A1 · Delfranco · 2019 [cited by examiner]
US 20190325304A1 · Gottin · 2019 [cited by examiner]
US 20190354874A1 · Shah et al. · 2019 [cited by applicant]
US 20200004874A1 · Gupta · 2020 [cited by examiner]
US 20200183961A1 · Dhoolia · 2020 [cited by examiner]
US 20200219494A1 · Dhoolia · 2020 [cited by examiner]
US 20200234190A1 · Beaver · 2020 [cited by applicant]
US 20200342032A1 · Subramaniam et al. · 2020 [cited by applicant]
US 20200364511A1 · Brown · 2020 [cited by examiner]
US 20210089860A1 · Heere et al. · 2021 [cited by applicant]
US 20210089990A1 · Day · 2021 [cited by examiner]
US 20210107140A1 · Singh · 2021 [cited by examiner]
US 20210110394A1 · Chen · 2021 [cited by examiner]
US 20210279553A1 · Zhu · 2021 [cited by examiner]
US 20210383259A1 · Dmitriev · 2021 [cited by examiner]
US 20210383291A1 · Elliott · 2021 [cited by examiner]
US 20220147197A1 · Tross · 2022 [cited by examiner]
US 20220172220A1 · Ladkat · 2022 [cited by examiner]
US 20220180291A1 · Abeykoon · 2022 [cited by examiner]
US 20220309240A1 · Rizk · 2022 [cited by examiner]
US 20230083159A1 · Padmanabhan · 2023 [cited by examiner]
US 20230274095A1 · Kelkar · 2023 [cited by examiner]
US 20230376838A1 · El Hattami · 2023 [cited by examiner]
US 20230409584A1 · Venkatesan · 2023 [cited by examiner]
Fast, Ethan et al., A Conversational Agent for Complex Tasks CHI2018, ACM, Apr. 2018 (Year: 2018). [cited by examiner]
Sun, Ron et al., Sequence Learning: From Recognition and Prediction to Sequential Decision Making IEEE Intelligent Systems, 2001 (Year: 2001). [cited by examiner]
Zhang, Zhewei et al., A recurrent neural network framework for flexible and adaptive decision making based on sequence learning PLOS Computational Biology, vol. 16, No. 11, 2020 (Year: 2020). [cited by examiner]
“How to Use KPIs to Measure Your Business Process Management Goals.” Kissflow. https://kissflow.com/workflow/bpm/business-process-management-kpi/ (retrieved Dec. 15, 2022). Mar. 2021. 4 pages. [cited by applicant]
Chattopadhyay et al. “Evaluating visual conversational agents via cooperative human-ai games.” Fifth AAAI Conference on Human Computation and Crowdsourcing. 2017. 9 pages. [cited by applicant]
Jiang et al. “Automatic online evaluation of intelligent assistants.” Proceedings of the 24th International Conference on World Wide Web. 2015. 11 pages. [cited by applicant]
Kiseleva et al. “Predicting user satisfaction with intelligent assistants.” Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 2016. 11 pages. [cited by applicant]
Kostenko et al. “Creative virtual composer assistant based on the eBICA framework.” Procedia Computer Science 169 (2020): 606-614. [cited by applicant]
Kulkarni et al. “Explicable planning as minimizing distance from expected behavior.” AAMAS Conference proceedings. 2019. 3 pages. [cited by applicant]
Moreno. “Key Performance Indicators for Cloud BPM—Short and long term KPI's.” Flokzu. https://www.flokzu.com/2021/11/04/key-performance-indicators-bpm/ (retrieved Dec. 15, 2022). Nov. 2021. 7 pages. [cited by applicant]
Rizk et al. “A conversational digital assistant for intelligent process automation.” International Conference on Business Process Management. Springer, Cham, 2020. 15 pages. [cited by applicant]
Sreedharan, Sarath, et al. “Explainable composition of aggregated assistants.” arXiv preprint arXiv:2011.10707 (2020). 10 pages. [cited by applicant]